-- Logs begin at Tue 2022-08-30 16:41:22 UTC, end at Tue 2022-08-30 19:09:43 UTC. -- Aug 30 17:15:20.521147 n-d-852771-11 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 17:15:20.529098 n-d-852771-11 devstack@n-api.service[106242]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 17:15:20 2022] *** Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: nodename: n-d-852771-11 Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: machine: x86_64 Aug 30 17:15:20.531053 n-d-852771-11 devstack@n-api.service[106242]: clock source: unix Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: pcre jit disabled Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: detected number of CPU cores: 4 Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: current working directory: / Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: detected binary path: /usr/bin/uwsgi-core Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: your processes number limit is 47680 Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: your memory page size is 4096 bytes Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: detected max file descriptor number: 2048 Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: lock engine: pthread robust mutexes Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: thunder lock: enabled Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 17:15:20.531575 n-d-852771-11 devstack@n-api.service[106242]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 17:15:20.570582 n-d-852771-11 devstack@n-api.service[106242]: Python main interpreter initialized at 0x55bdd95fb9c0 Aug 30 17:15:20.570582 n-d-852771-11 devstack@n-api.service[106242]: python threads support enabled Aug 30 17:15:20.570582 n-d-852771-11 devstack@n-api.service[106242]: your server socket listen backlog is limited to 100 connections Aug 30 17:15:20.570582 n-d-852771-11 devstack@n-api.service[106242]: your mercy for graceful operations on workers is 90 seconds Aug 30 17:15:20.570970 n-d-852771-11 devstack@n-api.service[106242]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 17:15:20.571048 n-d-852771-11 devstack@n-api.service[106242]: *** Operational MODE: preforking *** Aug 30 17:15:20.571258 n-d-852771-11 devstack@n-api.service[106242]: *** uWSGI is running in multiple interpreter mode *** Aug 30 17:15:20.571258 n-d-852771-11 devstack@n-api.service[106242]: spawned uWSGI master process (pid: 106242) Aug 30 17:15:20.571446 n-d-852771-11 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 17:15:20.572540 n-d-852771-11 devstack@n-api.service[106242]: spawned uWSGI worker 1 (pid: 106243, cores: 1) Aug 30 17:15:20.572540 n-d-852771-11 devstack@n-api.service[106242]: spawned uWSGI worker 2 (pid: 106244, cores: 1) Aug 30 17:15:20.572540 n-d-852771-11 devstack@n-api.service[106242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 17:15:21.233496 n-d-852771-11 devstack@n-api.service[106243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:15:21.237650 n-d-852771-11 devstack@n-api.service[106244]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:15:22.315716 n-d-852771-11 devstack@n-api.service[106243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:15:22.315716 n-d-852771-11 devstack@n-api.service[106243]: from cryptography.utils import int_from_bytes Aug 30 17:15:22.316231 n-d-852771-11 devstack@n-api.service[106243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:15:22.316231 n-d-852771-11 devstack@n-api.service[106243]: from cryptography.utils import int_from_bytes Aug 30 17:15:22.319099 n-d-852771-11 devstack@n-api.service[106244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:15:22.319099 n-d-852771-11 devstack@n-api.service[106244]: from cryptography.utils import int_from_bytes Aug 30 17:15:22.319552 n-d-852771-11 devstack@n-api.service[106244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:15:22.319552 n-d-852771-11 devstack@n-api.service[106244]: from cryptography.utils import int_from_bytes Aug 30 17:15:24.834393 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:15:24.834990 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:15:24.835159 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:15:24.835535 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:15:24.835792 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:15:24.836181 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.836503 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.836821 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.836932 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:15:24.837301 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.837392 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:15:24.837482 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.837700 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:15:24.837805 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.838040 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.838249 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:15:24.838336 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.838660 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.838841 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:15:24.838924 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.839056 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.839206 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.839387 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.839554 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-11 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.839738 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.840528 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.840637 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.840852 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.840939 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841228 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841313 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841548 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841640 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841850 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.841944 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842170 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842256 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842429 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842514 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842746 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.842955 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.843071 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-11 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844115 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844260 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844370 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844500 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844644 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844759 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.844921 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845048 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845181 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845305 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845450 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845576 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845698 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845819 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.845819 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846065 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846211 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846336 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846458 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846581 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846717 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-11 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846851 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.846985 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847108 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847230 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847361 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847503 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847643 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847839 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.847967 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848090 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848222 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848400 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848536 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848716 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.848845 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849035 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849174 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-11 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849338 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849474 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849657 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849792 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.849973 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850100 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850286 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850414 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850599 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850732 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.850896 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851023 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851199 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851334 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851518 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851649 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851835 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.851963 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852135 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852264 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852434 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852561 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852684 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852860 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.852997 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853182 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853310 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853487 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853615 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853797 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.853932 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854108 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854243 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854375 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854508 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854638 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854768 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.854949 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855100 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855250 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855385 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855608 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855797 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.855949 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856136 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856313 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856469 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856595 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856726 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856853 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.856977 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857109 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857234 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857358 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857481 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857639 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857769 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.857986 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858120 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858246 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858374 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858544 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858681 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858851 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.858978 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859156 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859285 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859463 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859629 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859792 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.859919 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860117 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860261 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860419 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860560 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860718 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.860844 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861032 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861161 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861337 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861473 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861637 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861773 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.861938 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862073 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862238 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862379 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862550 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862678 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.862877 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863005 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863175 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863304 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863428 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863610 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863734 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.863858 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864016 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864145 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864325 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864454 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864624 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864751 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.864953 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865122 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865255 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865378 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865509 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865636 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865772 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.865896 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866065 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866205 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866365 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866502 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866663 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866798 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.866962 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867096 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867258 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867400 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867590 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867732 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.867890 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868032 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868229 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868366 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868490 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868613 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868784 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.868912 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869085 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869221 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869382 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869510 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869681 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869818 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.869981 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870156 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870282 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870417 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870576 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870702 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.870874 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871016 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871222 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871357 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871528 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871656 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871831 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.871975 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872143 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872270 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872445 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872572 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872745 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.872884 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873056 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873183 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873351 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873478 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873649 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873778 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.873958 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874087 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874258 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874387 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874557 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874685 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874853 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.874990 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.875156 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.875283 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.875437 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.875600 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876024 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876153 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876322 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876453 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876619 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876755 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.876913 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877048 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877226 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877353 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877540 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877668 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877840 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.877967 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878140 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878356 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878498 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878630 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878760 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.878892 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.879017 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.879150 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.879311 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.879447 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.879641 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.879771 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.879962 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.880099 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.880285 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.880412 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.880593 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.880726 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.880900 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.881029 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.881205 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.881334 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.881515 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.881643 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:15:24.881834 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.881963 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882140 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882267 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882445 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882573 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882750 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.882879 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883061 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883196 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883373 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883546 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883719 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.883849 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884031 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884166 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884341 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884484 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884652 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884779 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.884956 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885095 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885250 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885381 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885583 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885708 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885867 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.885994 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.886170 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.886305 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.886504 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.886632 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.887367 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.887529 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.887813 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.887972 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888097 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888219 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888355 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888549 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888692 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888827 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.888952 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889075 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889198 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889322 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889507 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889634 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889834 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.889950 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.890141 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.890300 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.890455 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.890619 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.890762 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891028 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891142 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891248 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891379 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891676 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891789 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.891897 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892001 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892190 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892315 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892517 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892631 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.892852 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.893113 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.893253 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.893476 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.893674 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.893802 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894100 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894225 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894412 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894645 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894773 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.894967 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895085 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895284 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895427 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895625 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895753 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.895938 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896066 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896248 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896394 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896558 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896693 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896864 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.896992 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897168 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897310 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897478 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897612 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897782 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.897920 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898091 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898227 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898405 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898554 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898715 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.898841 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899016 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899144 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899316 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899443 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899651 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899777 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.899957 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900085 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900263 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900390 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900565 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900701 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.900873 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901002 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901180 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901317 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901482 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901617 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901826 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.901965 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.902091 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.902214 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.902451 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903221 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903352 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903495 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903623 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903746 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.903870 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904013 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904162 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904298 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904489 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904618 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904800 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.904937 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905109 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905237 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905399 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905525 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905719 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.905865 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906025 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906151 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906334 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906462 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906646 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906774 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.906961 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907088 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907264 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907390 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907597 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907736 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.907916 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908042 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908228 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908356 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908527 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908663 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908834 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.908948 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909135 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909257 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909437 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909553 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909737 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.909852 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910042 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910169 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910343 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910466 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910675 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910813 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.910938 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911075 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911222 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911351 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911540 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911685 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.911898 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912042 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912168 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912292 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912449 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912578 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912749 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.912886 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913048 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913178 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913368 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913501 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913673 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913789 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.913997 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914112 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914309 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914436 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914617 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914746 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.914923 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915051 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915230 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915364 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915630 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915767 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.915893 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916018 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916160 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916296 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916468 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916590 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916775 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.916905 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917090 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917230 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917396 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917524 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917709 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.917838 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918117 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918258 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918434 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918591 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918764 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.918892 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919055 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919178 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919356 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919515 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919695 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.919823 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920016 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920158 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920331 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920467 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920647 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920856 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.920984 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921117 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921264 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921394 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921567 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921693 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.921871 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922079 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922208 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922332 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922463 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922588 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922767 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.922895 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923080 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923209 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923387 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923536 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923733 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.923862 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924039 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924167 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924355 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924483 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924661 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924790 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.924970 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925096 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925266 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925403 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925561 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925687 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.925882 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926011 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926190 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926331 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926508 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926636 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926815 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.926943 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927130 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927271 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927435 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927588 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927774 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.927899 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928078 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928217 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928381 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928509 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928682 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928818 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.928988 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929116 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929296 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929424 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929601 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929729 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.929908 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930037 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930210 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930338 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930515 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930648 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930817 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.930953 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931116 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931253 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931414 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931578 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931745 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.931874 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932129 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932263 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932392 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932515 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932649 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932773 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.932959 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933093 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933257 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933384 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933576 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933738 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.933905 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934032 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934187 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934323 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934485 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934637 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934772 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.934961 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935096 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935297 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935430 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935617 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935744 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.935893 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936021 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936217 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936337 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936530 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936657 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936835 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.936976 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937141 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937268 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937446 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937572 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937764 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.937900 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938078 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938206 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938383 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938508 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938685 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938819 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.938989 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939134 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939292 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939419 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939619 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939758 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.939913 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940042 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940227 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940353 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940528 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940655 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940835 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.940962 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941141 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941269 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941437 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941566 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941742 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.941869 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942051 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942191 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942393 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942619 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942749 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.942948 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943076 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943260 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943401 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943595 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943722 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.943904 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944031 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944234 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944360 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944522 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944665 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.944860 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945097 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945226 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945437 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945573 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945751 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.945879 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946053 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946180 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946355 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946475 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946661 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946789 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.946963 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947104 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947264 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947403 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947587 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947727 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.947892 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948020 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948191 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948327 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948491 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948619 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948791 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.948926 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.949088 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.949749 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.949924 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950164 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950291 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950480 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950615 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950790 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.950925 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951102 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951228 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951405 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951565 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951738 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.951872 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952048 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952175 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952429 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952576 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952703 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952826 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.952963 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953095 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953262 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953403 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953568 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953698 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.953893 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954022 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954206 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954344 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954503 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954632 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954808 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.954935 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955107 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955235 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955408 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955640 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955803 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.955929 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956070 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956197 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956321 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956452 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956607 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956738 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.956912 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957042 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957217 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957353 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957522 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957660 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957828 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.957957 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958127 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958262 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958429 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958566 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958725 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.958867 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959036 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959164 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959341 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959532 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959662 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959786 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.959953 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960092 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960241 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960388 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960548 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960677 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960846 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.960975 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961150 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961279 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961450 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961578 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961759 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.961887 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962057 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962186 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962355 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962497 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962694 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962823 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.962956 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963082 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963231 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963367 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963554 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963677 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.963873 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964000 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964177 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964303 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964476 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964606 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964794 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.964966 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965126 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965255 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965424 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965562 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965721 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.965883 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966030 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966159 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966337 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966476 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966646 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966773 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.966944 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967072 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967248 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967386 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967569 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967698 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.967872 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968001 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968172 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968381 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968516 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968646 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968771 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.968894 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969026 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969152 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969324 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969460 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969618 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969784 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.969927 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970053 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970232 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970360 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970491 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970615 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970787 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.970917 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971086 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971216 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971382 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971568 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971742 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.971872 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972040 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972168 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972343 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972481 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972648 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972852 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.972980 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973104 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973264 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973402 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973568 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973709 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973871 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.973998 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974175 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974312 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974471 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974606 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974780 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.974908 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975084 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975261 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975387 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975529 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975702 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975830 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.975999 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976135 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976306 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976437 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976612 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976734 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.976917 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977054 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977230 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977360 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977545 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977672 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977861 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.977988 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978156 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978282 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978459 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978588 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978763 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.978891 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979065 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979192 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979371 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979552 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979691 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979819 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.979996 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980123 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980302 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980471 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980682 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980807 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.980992 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981119 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981306 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981434 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981619 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981746 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.981925 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982064 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982234 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982369 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982532 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982657 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.982900 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983044 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983170 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983302 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983427 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983572 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983779 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.983898 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984092 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984221 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984401 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984530 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984699 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.984826 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985013 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985141 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985318 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985465 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985642 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985769 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.985952 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986119 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986243 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986365 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986553 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986690 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986860 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.986994 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.987172 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.987309 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.987513 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.987660 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.987912 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988038 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988222 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988350 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988530 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988668 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988834 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.988961 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989131 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989259 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989430 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989569 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989736 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.989865 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990053 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990191 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990348 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990487 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990647 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990775 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.990944 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991073 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991258 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991402 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991583 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991713 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.991900 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992029 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992271 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992400 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992583 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992711 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.992886 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993087 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993228 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993352 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993491 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993616 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993780 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.993917 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994102 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994230 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994407 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994536 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994729 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.994866 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995068 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995198 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995378 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995564 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995712 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.995847 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.996021 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.996784 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997052 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997343 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997343 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997592 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997718 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997856 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.997989 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998121 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998254 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998381 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998557 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998704 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998866 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.998995 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999182 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999311 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999532 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999677 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999863 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:24.999991 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.000178 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.000306 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.000498 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.000628 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001071 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001200 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001373 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001500 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001673 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001803 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.001978 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002107 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002277 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002407 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002577 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002707 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.002895 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003026 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003231 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003371 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003538 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003663 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003785 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.003972 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004092 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004279 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004415 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004586 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004720 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.004895 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005022 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005201 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005328 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005507 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005633 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005830 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.005956 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006136 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006263 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006448 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006574 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006814 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.006949 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007074 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007199 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007323 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007447 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007649 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007827 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.007955 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008088 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008236 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008365 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008571 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008707 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008867 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.008994 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009184 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009313 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009508 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009653 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009813 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.009940 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010123 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010251 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010435 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010563 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010741 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.010870 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.011049 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.011185 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.011352 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.011502 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.012263 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.012572 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.012744 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.012901 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.012901 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013149 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013354 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013491 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013624 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013749 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.013883 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014015 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014140 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014264 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014388 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014523 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014647 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014771 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.014895 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015060 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015189 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015386 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015562 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015743 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.015873 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016054 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016182 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016362 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016498 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016671 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016839 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.016966 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017090 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017260 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017390 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017559 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017689 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.017866 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018002 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018172 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018301 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018477 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018614 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018783 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.018919 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019102 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019232 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019407 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019549 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019755 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.019895 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020065 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020201 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020372 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020503 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020816 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.020984 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021111 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021292 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021419 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021595 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021724 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.021903 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022032 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022211 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022348 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022552 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022679 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.022856 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023026 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023162 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023397 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023583 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023709 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023833 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.023977 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024104 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024285 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024420 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024594 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024721 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.024902 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025029 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025208 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025337 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025513 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025639 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025818 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.025955 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.026125 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.026424 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.026551 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.026749 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.026917 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027068 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027206 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027419 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027629 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027780 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.027908 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028043 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028169 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028353 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028482 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028662 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028790 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.028975 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029104 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029296 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029424 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029596 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029735 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.029906 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030035 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030215 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030344 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030525 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030662 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030830 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.030967 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031134 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031265 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031441 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031611 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031775 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.031904 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032078 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032208 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032382 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032513 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032690 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032818 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.032998 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033126 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033316 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033469 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033667 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033797 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.033947 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034077 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034259 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034383 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034569 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034697 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.034878 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035016 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035194 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035394 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035571 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035736 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.035865 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036073 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036203 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036398 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036535 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036719 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.036848 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037019 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037147 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037452 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037592 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037717 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037852 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.037977 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038102 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038225 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038356 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038529 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038795 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.038925 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039119 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039248 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039435 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039603 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039771 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.039869 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040073 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040165 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040388 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040477 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040694 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.040792 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041036 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041220 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041345 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041561 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041650 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041873 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.041970 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042196 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042296 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042514 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042604 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042825 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.042930 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.043183 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.043303 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.043521 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.043794 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.043882 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044113 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044200 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044473 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044588 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044724 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.044957 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045045 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045308 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045409 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045613 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045710 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.045924 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046013 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046223 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046321 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046529 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046617 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046827 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.046924 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047146 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047243 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047449 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047604 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047786 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.047925 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048085 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048297 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048514 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048622 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048726 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048830 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.048994 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049126 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049313 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049441 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049626 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049755 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.049932 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050070 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050245 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050374 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050552 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.050881 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051010 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051188 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051316 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051528 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.051885 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052020 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052146 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052261 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052423 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052566 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052732 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.052861 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053040 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053169 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053346 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.053989 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054114 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054238 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054370 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054505 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054620 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054743 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054875 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.054999 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.055123 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.055259 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.055496 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.055699 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.055907 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056035 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056339 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056468 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056670 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056791 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.056999 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057175 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057311 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057445 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057592 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057721 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.057891 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.058020 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.058210 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.058339 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059018 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059159 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059339 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059671 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059819 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.059978 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.060107 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.060284 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.060556 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.060695 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.060880 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061007 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061184 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061313 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061487 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061626 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061793 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.061922 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062096 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062225 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062399 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062542 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062704 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.062833 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063008 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063137 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063315 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063454 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063679 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.063820 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064023 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064152 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064287 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064412 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064595 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064716 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.064907 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065042 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065209 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065346 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065514 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065642 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065820 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.065958 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066126 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066254 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066437 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066564 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066750 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.066893 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067059 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067234 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067361 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067525 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067696 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.067833 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068038 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068175 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068360 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068497 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068678 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068806 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.068983 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069113 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069298 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069427 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069612 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069743 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.069916 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070046 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070226 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070347 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070530 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070665 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070844 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.070975 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071176 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071316 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071509 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071640 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071822 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.071952 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072121 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072262 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072422 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072550 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072721 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.072851 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073025 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073163 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073338 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073467 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073643 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073780 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.073942 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.074221 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.074869 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075098 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075228 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075445 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075605 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075800 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.075937 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076139 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076268 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076485 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076623 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076796 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.076931 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077100 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077229 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077396 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077534 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077686 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077813 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.077984 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078112 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078283 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078412 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078581 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078716 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.078887 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079023 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079188 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079318 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079515 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079646 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079815 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.079944 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080114 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080244 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080412 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080542 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080724 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.080850 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081033 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081161 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081346 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081473 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081651 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081857 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.081989 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082113 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082244 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082374 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082541 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082677 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082847 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.082986 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083153 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083281 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083460 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083620 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083794 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.083924 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084102 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084306 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084480 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084623 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084751 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.084915 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085053 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085179 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085316 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085441 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085565 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085690 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085867 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.085995 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086171 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086308 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086493 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086622 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086797 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.086925 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087113 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087243 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087424 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087585 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087769 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.087880 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088083 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088219 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088389 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088517 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088709 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.088848 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089016 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089145 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089322 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089451 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089626 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089774 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.089991 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090121 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090248 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090457 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090651 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090789 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.090972 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091100 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091305 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091440 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091644 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091774 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.091973 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092103 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092296 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092426 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092618 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092745 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.092926 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093063 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093238 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093368 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093557 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093685 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093870 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.093997 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094186 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094336 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094530 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094658 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094783 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.094907 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095121 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095264 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095418 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095566 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095745 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.095872 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.096007 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:15:25.096143 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.096371 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.096691 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.097022 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.097355 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.097669 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.097997 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.098326 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.098675 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.098990 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.099336 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.099696 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.100015 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.100331 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.100641 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:15:25.100888 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:15:25.250272 n-d-852771-11 devstack@n-api.service[106243]: INFO dbcounter [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Registered counter for database nova_api Aug 30 17:15:25.255357 n-d-852771-11 devstack@n-api.service[106244]: INFO dbcounter [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Registered counter for database nova_api Aug 30 17:15:25.270739 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_db.sqlalchemy.engines [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.275807 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.277804 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writer thread running {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.283212 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writer thread running {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.334102 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.context [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=106243) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:15:25.337994 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:25.338423 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:25.340019 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:25.340375 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.context [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=106244) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:15:25.340748 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:25.341183 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:25.343113 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:25.344189 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:25.344675 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:25.345072 n-d-852771-11 devstack@n-api.service[106243]: INFO dbcounter [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Registered counter for database nova_cell0 Aug 30 17:15:25.346232 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:25.346977 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:25.347540 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:25.349145 n-d-852771-11 devstack@n-api.service[106243]: INFO dbcounter [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Registered counter for database nova_cell1 Aug 30 17:15:25.349489 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_concurrency.lockutils [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:25.351534 n-d-852771-11 devstack@n-api.service[106244]: INFO dbcounter [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Registered counter for database nova_cell0 Aug 30 17:15:25.356221 n-d-852771-11 devstack@n-api.service[106244]: INFO dbcounter [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Registered counter for database nova_cell1 Aug 30 17:15:25.357680 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_db.sqlalchemy.engines [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.359338 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_db.sqlalchemy.engines [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.363554 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.365601 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writer thread running {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.367014 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.367133 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writer thread running {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.369441 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writer thread running {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.512355 n-d-852771-11 devstack@n-api.service[106243]: INFO dbcounter [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Registered counter for database nova_cell0 Aug 30 17:15:25.513842 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writer thread running {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.518951 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_db.sqlalchemy.engines [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.523319 n-d-852771-11 devstack@n-api.service[106244]: INFO dbcounter [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Registered counter for database nova_cell0 Aug 30 17:15:25.523537 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writer thread running {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.532114 n-d-852771-11 devstack@n-api.service[106244]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:15:25.536725 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writer thread running {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:15:25.858819 n-d-852771-11 devstack@n-api.service[106243]: WARNING keystonemiddleware.auth_token [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:15:25.865943 n-d-852771-11 devstack@n-api.service[106244]: WARNING keystonemiddleware.auth_token [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:15:25.866332 n-d-852771-11 devstack@n-api.service[106243]: WARNING keystonemiddleware.auth_token [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:15:25.873718 n-d-852771-11 devstack@n-api.service[106244]: WARNING keystonemiddleware.auth_token [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:15:26.206421 n-d-852771-11 devstack@n-api.service[106243]: WARNING keystonemiddleware.auth_token [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:15:26.212376 n-d-852771-11 devstack@n-api.service[106243]: WARNING keystonemiddleware.auth_token [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:15:26.214548 n-d-852771-11 devstack@n-api.service[106244]: WARNING keystonemiddleware.auth_token [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:15:26.217585 n-d-852771-11 devstack@n-api.service[106243]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdd95fb9c0 pid: 106243 (default app) Aug 30 17:15:26.219656 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:26.220819 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 30 17:15:26.220926 n-d-852771-11 devstack@n-api.service[106244]: WARNING keystonemiddleware.auth_token [None req-0fb2d6d2-e631-4eb5-aa66-4139700d5c27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:15:26.221221 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Tue Aug 30 17:15:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:15:26.226245 n-d-852771-11 devstack@n-api.service[106244]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdd95fb9c0 pid: 106244 (default app) Aug 30 17:16:44.844404 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:44.845323 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 17:16:44.845705 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:16:44.858529 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_api:SELECT=3 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:44.859633 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_cell0:SELECT=3 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:44.860335 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_cell1:SELECT=3 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:44.861600 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:45.774949 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-f41a30f2-5d42-47dd-86fd-da3b0f0babde admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:45.807434 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-f41a30f2-5d42-47dd-86fd-da3b0f0babde admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953880 Aug 30 17:16:45.808376 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:16:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:16:48.188462 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:48.189612 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-528ce16f-b51d-4ed6-a7c5-2af34505968b None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003182 Aug 30 17:16:48.201661 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:48.644116 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-4ab459a8-7fbe-4067-8694-737c76f848a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:48.693374 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-4ab459a8-7fbe-4067-8694-737c76f848a2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496718 Aug 30 17:16:48.694527 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:16:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:16:48.708561 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_api:SELECT=3 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:48.710119 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_cell1:SELECT=3 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:48.711391 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_cell0:SELECT=3 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:48.712440 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:48.929284 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-153a66fa-6155-4523-9f80-21d34e2fb379 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:48.991056 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-153a66fa-6155-4523-9f80-21d34e2fb379 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288064 Aug 30 17:16:48.991888 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 17:16:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:51.373016 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-4ab459a8-7fbe-4067-8694-737c76f848a2 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:51.374038 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-4ab459a8-7fbe-4067-8694-737c76f848a2 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 30 17:16:51.383559 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:52.096866 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-71b852fa-0087-4847-9bf4-e3a42ec7cb2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "id": "d1"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:52.137282 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-71b852fa-0087-4847-9bf4-e3a42ec7cb2a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.751385 Aug 30 17:16:52.140623 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:16:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:16:52.150203 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-14154b1a-cce9-4607-8986-70c9a8f54bd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:52.186845 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-14154b1a-cce9-4607-8986-70c9a8f54bd3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040546 Aug 30 17:16:52.197880 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 17:16:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:16:54.839565 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-71b852fa-0087-4847-9bf4-e3a42ec7cb2a admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:54.841266 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-71b852fa-0087-4847-9bf4-e3a42ec7cb2a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Aug 30 17:16:54.842151 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:55.295656 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-4142fc24-a2ca-4379-859f-3f0e2e869ceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:55.317587 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-4142fc24-a2ca-4379-859f-3f0e2e869ceb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462276 Aug 30 17:16:55.319953 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:16:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:16:55.335337 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-ca8be521-d933-4b7d-bf05-a706f3812068 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:55.364024 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-ca8be521-d933-4b7d-bf05-a706f3812068 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035411 Aug 30 17:16:55.366453 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 17:16:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:57.848436 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-4142fc24-a2ca-4379-859f-3f0e2e869ceb admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:57.849755 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-4142fc24-a2ca-4379-859f-3f0e2e869ceb admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 30 17:16:57.850161 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:58.246823 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-9816476d-8ddd-4e23-a1bc-fa3af47ebf39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:58.280216 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-9816476d-8ddd-4e23-a1bc-fa3af47ebf39 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423812 Aug 30 17:16:58.283418 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:16:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:16:58.301045 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-90e3e919-053c-41cf-92c9-29f544ceb835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:58.339397 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-90e3e919-053c-41cf-92c9-29f544ceb835 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042689 Aug 30 17:16:58.340015 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 17:16:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:00.774398 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-9816476d-8ddd-4e23-a1bc-fa3af47ebf39 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:00.775104 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-9816476d-8ddd-4e23-a1bc-fa3af47ebf39 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 30 17:17:00.777416 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:01.243450 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:01.281480 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498773 Aug 30 17:17:01.282040 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:01.294553 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-9e012f5b-9ae9-4ff7-8836-600604bfa303 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:01.324321 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-9e012f5b-9ae9-4ff7-8836-600604bfa303 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033307 Aug 30 17:17:01.331631 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 17:17:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:17:03.820651 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:03.822358 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Aug 30 17:17:03.833802 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:04.272622 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-24963340-763d-4424-b317-aca705945ec5 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:04.306953 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-24963340-763d-4424-b317-aca705945ec5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477380 Aug 30 17:17:04.324639 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:17:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:06.702353 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:06.703564 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-2fe6deac-fc52-4933-a336-70601956b998 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Aug 30 17:17:06.704021 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:07.138975 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-9dfe38fd-cd7c-4245-be2f-839a09f6a98c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:07.158327 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-9dfe38fd-cd7c-4245-be2f-839a09f6a98c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.445758 Aug 30 17:17:07.158895 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:07.170968 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-a93b1917-2f60-4a86-835f-9199ff641569 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:07.195147 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-a93b1917-2f60-4a86-835f-9199ff641569 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027763 Aug 30 17:17:07.195752 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 17:17:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:09.966322 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-9dfe38fd-cd7c-4245-be2f-839a09f6a98c admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:09.967708 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-9dfe38fd-cd7c-4245-be2f-839a09f6a98c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Aug 30 17:17:09.968190 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:10.407460 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-188fe353-714a-4bbe-9252-bfc519610a5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:10.427982 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-188fe353-714a-4bbe-9252-bfc519610a5b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451302 Aug 30 17:17:10.428422 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:10.440845 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-1b84a01c-25d1-4c88-afa8-58d877a1b57e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:10.466528 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-1b84a01c-25d1-4c88-afa8-58d877a1b57e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029460 Aug 30 17:17:10.467108 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 17:17:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:12.857207 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-188fe353-714a-4bbe-9252-bfc519610a5b admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:12.858136 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-188fe353-714a-4bbe-9252-bfc519610a5b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 17:17:12.858535 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:13.296006 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-77472549-eb1b-4a5f-a02c-98fc02c1d517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:13.317479 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-77472549-eb1b-4a5f-a02c-98fc02c1d517 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.451456 Aug 30 17:17:13.323593 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:17:13.330434 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-d67b87ba-4730-44c9-a237-38d69eb4b757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:13.358879 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-d67b87ba-4730-44c9-a237-38d69eb4b757 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032043 Aug 30 17:17:13.359839 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 17:17:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:15.765303 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-77472549-eb1b-4a5f-a02c-98fc02c1d517 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:15.766301 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-77472549-eb1b-4a5f-a02c-98fc02c1d517 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 30 17:17:15.766706 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:17:16.179170 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-b26c9661-61be-4381-a90b-c34ef64bcca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:16.186007 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:16.202483 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-b26c9661-61be-4381-a90b-c34ef64bcca0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428168 Aug 30 17:17:16.203165 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:16.216423 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-5cf823c7-fd49-4351-97f8-445669a7a647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:16.242351 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-5cf823c7-fd49-4351-97f8-445669a7a647 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029791 Aug 30 17:17:16.243104 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 17:17:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:18.766612 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-b26c9661-61be-4381-a90b-c34ef64bcca0 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:18.767658 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-b26c9661-61be-4381-a90b-c34ef64bcca0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 30 17:17:18.768265 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:19.219572 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:19.228503 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:19.244007 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468331 Aug 30 17:17:19.244968 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 17:17:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:19.258398 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-d64a643f-8b25-430e-81a2-5bdfff62eb1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:19.289060 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-d64a643f-8b25-430e-81a2-5bdfff62eb1f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035442 Aug 30 17:17:19.289669 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 17:17:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:17:41.990028 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:41.991041 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 17:17:41.991446 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:42.002071 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:42.384066 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-ff8d3f04-1d7d-4f6b-8e52-80f09a2349dd admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:42.403113 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-ff8d3f04-1d7d-4f6b-8e52-80f09a2349dd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405450 Aug 30 17:17:42.403661 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:17:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:43.460987 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:43.461999 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-fbc4cb2f-baa4-45d4-b33d-e0a0c2883a88 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 30 17:17:43.462416 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:44.008306 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-20befeb2-b23c-43b8-8843-3b107900dedf admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:44.013895 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.wsgi [None req-20befeb2-b23c-43b8-8843-3b107900dedf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-20befeb2-b23c-43b8-8843-3b107900dedf admin admin] Request method failure captured: Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Accept: application/json Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Accept-Encoding: gzip, deflate Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Connection: keep-alive Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Content-Length: 0 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Host: 10.222.0.50 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: Openstack-System-Scope: None Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: User-Agent: python-novaclient Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Auth-Token: gAAAAABjDkY34RwUuzrS6FNGWnySL_q4Bmq32dpjoCXmWHACtJPYQA0Ks_7WYNoEzZONY5uXCVTX3e12ShGKabldVURID5qX7PCBjSpyfOvBpHRHghEX9qPynYmWb-qCvGlErF-KXVtJhPE1-u-MFinqy-Dbxe82zlR5tU_SWiQUKMEaEDj2SJ0 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Id: None Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Name: None Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Identity-Status: Confirmed Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Is-Admin-Project: True Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Id: default Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Name: Default Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Name: admin Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Role: admin,reader,member Aug 30 17:17:44.017122 n-d-852771-11 devstack@n-api.service[106244]: X-Roles: admin,reader,member Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant: admin Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Name: admin Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-User: admin Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Id: default Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Name: Default Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: X-User-Name: admin Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: method: > Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: exception: Flavor 42 could not be found. Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: action_args: {'id': '42'} Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:44.018781 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:44.020693 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.022103 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-20befeb2-b23c-43b8-8843-3b107900dedf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:44.023458 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-20befeb2-b23c-43b8-8843-3b107900dedf admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395643 Aug 30 17:17:44.023458 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:17:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:44.028786 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-ee0e33a0-97d3-4d2b-a7fe-df4b43498906 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:44.054266 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-ee0e33a0-97d3-4d2b-a7fe-df4b43498906 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029032 Aug 30 17:17:44.054820 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:44.069063 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-ea69af9a-3b1d-4939-a0b2-008bd082331a admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:44.091658 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-ea69af9a-3b1d-4939-a0b2-008bd082331a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026617 Aug 30 17:17:44.092184 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:17:44.101767 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-bd9bcc23-2723-497a-98b3-35e98f065ebd admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:44.107977 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.wsgi [None req-bd9bcc23-2723-497a-98b3-35e98f065ebd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-bd9bcc23-2723-497a-98b3-35e98f065ebd admin admin] Request method failure captured: Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Accept: application/json Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Accept-Encoding: gzip, deflate Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Connection: keep-alive Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Content-Length: 0 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Host: 10.222.0.50 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: Openstack-System-Scope: None Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: User-Agent: python-novaclient Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Auth-Token: gAAAAABjDkY34RwUuzrS6FNGWnySL_q4Bmq32dpjoCXmWHACtJPYQA0Ks_7WYNoEzZONY5uXCVTX3e12ShGKabldVURID5qX7PCBjSpyfOvBpHRHghEX9qPynYmWb-qCvGlErF-KXVtJhPE1-u-MFinqy-Dbxe82zlR5tU_SWiQUKMEaEDj2SJ0 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Id: None Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Name: None Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Identity-Status: Confirmed Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Is-Admin-Project: True Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Id: default Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Name: Default Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Name: admin Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Role: admin,reader,member Aug 30 17:17:44.111220 n-d-852771-11 devstack@n-api.service[106243]: X-Roles: admin,reader,member Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant: admin Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Name: admin Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-User: admin Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Id: default Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Name: Default Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: X-User-Name: admin Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: method: > Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: exception: Flavor 42 could not be found. Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: action_args: {'id': '42'} Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:44.112840 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:44.114060 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:44.115456 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-bd9bcc23-2723-497a-98b3-35e98f065ebd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:44.116742 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-bd9bcc23-2723-497a-98b3-35e98f065ebd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014519 Aug 30 17:17:44.116742 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:17:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:45.108023 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-ea69af9a-3b1d-4939-a0b2-008bd082331a admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:45.109040 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-ea69af9a-3b1d-4939-a0b2-008bd082331a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 30 17:17:45.109439 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:45.632636 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-f51e1d1d-aca6-4790-9dc0-5e93371a09fe admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:45.637905 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.wsgi [None req-f51e1d1d-aca6-4790-9dc0-5e93371a09fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-f51e1d1d-aca6-4790-9dc0-5e93371a09fe admin admin] Request method failure captured: Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Accept: application/json Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Accept-Encoding: gzip, deflate Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Connection: keep-alive Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Content-Length: 0 Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Host: 10.222.0.50 Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: Openstack-System-Scope: None Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: User-Agent: python-novaclient Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Auth-Token: gAAAAABjDkY5xarvm6D-SM6O4TRhCaQI2ppuA50gQVa1iG6H_KbW0rGUsPthje6xHnF1U8bgygfRh0lOAMH-3SQr8KSEn7c_hO_t1dz2Y0Ocxc-0NHT_OvoRFFvkBIp6yuYnM2ckAM541u4zS395rr5I7b0H4-6Xkw6dGNY61ubUxrHWp87G3aI Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Id: None Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Name: None Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Identity-Status: Confirmed Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Is-Admin-Project: True Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Id: default Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Name: Default Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Name: admin Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Role: admin,reader,member Aug 30 17:17:45.639401 n-d-852771-11 devstack@n-api.service[106243]: X-Roles: admin,reader,member Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant: admin Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Name: admin Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-User: admin Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Id: default Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Name: Default Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: X-User-Name: admin Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: method: > Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: exception: Flavor 84 could not be found. Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: action_args: {'id': '84'} Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:45.640848 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:45.641704 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.642917 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-f51e1d1d-aca6-4790-9dc0-5e93371a09fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:45.644804 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-f51e1d1d-aca6-4790-9dc0-5e93371a09fe admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394583 Aug 30 17:17:45.644804 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:17:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:45.651026 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-fbcd498e-1fa9-4888-b5da-a7bf2aa9f84e admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:45.666021 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-fbcd498e-1fa9-4888-b5da-a7bf2aa9f84e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018610 Aug 30 17:17:45.666545 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:45.675662 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-a9c096a5-01cd-4995-96c9-e9f59f709fa1 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:45.690408 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-a9c096a5-01cd-4995-96c9-e9f59f709fa1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018174 Aug 30 17:17:45.691505 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:45.700702 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-db6e9cd2-22d5-4653-8cd0-d0dbad08876e admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:45.705983 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.wsgi [None req-db6e9cd2-22d5-4653-8cd0-d0dbad08876e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-db6e9cd2-22d5-4653-8cd0-d0dbad08876e admin admin] Request method failure captured: Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Accept: application/json Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Accept-Encoding: gzip, deflate Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Connection: keep-alive Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Content-Length: 0 Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Host: 10.222.0.50 Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: Openstack-System-Scope: None Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: User-Agent: python-novaclient Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Auth-Token: gAAAAABjDkY5xarvm6D-SM6O4TRhCaQI2ppuA50gQVa1iG6H_KbW0rGUsPthje6xHnF1U8bgygfRh0lOAMH-3SQr8KSEn7c_hO_t1dz2Y0Ocxc-0NHT_OvoRFFvkBIp6yuYnM2ckAM541u4zS395rr5I7b0H4-6Xkw6dGNY61ubUxrHWp87G3aI Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Id: None Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Name: None Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Identity-Status: Confirmed Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Is-Admin-Project: True Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Id: default Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Name: Default Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Name: admin Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Role: admin,reader,member Aug 30 17:17:45.708479 n-d-852771-11 devstack@n-api.service[106244]: X-Roles: admin,reader,member Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant: admin Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Name: admin Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-User: admin Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Id: default Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Name: Default Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: X-User-Name: admin Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: method: > Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: exception: Flavor 84 could not be found. Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: action_args: {'id': '84'} Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:45.710010 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:45.711145 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:45.712478 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-db6e9cd2-22d5-4653-8cd0-d0dbad08876e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:45.713745 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-db6e9cd2-22d5-4653-8cd0-d0dbad08876e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012608 Aug 30 17:17:45.713745 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:17:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:46.681663 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-a9c096a5-01cd-4995-96c9-e9f59f709fa1 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:46.682685 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-a9c096a5-01cd-4995-96c9-e9f59f709fa1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 30 17:17:46.683216 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:47.210792 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-7820f748-1c3b-4d9c-a4ed-7e0a6af6247c admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:47.216551 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.wsgi [None req-7820f748-1c3b-4d9c-a4ed-7e0a6af6247c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-7820f748-1c3b-4d9c-a4ed-7e0a6af6247c admin admin] Request method failure captured: Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Accept: application/json Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Accept-Encoding: gzip, deflate Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Connection: keep-alive Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Content-Length: 0 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Host: 10.222.0.50 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: Openstack-System-Scope: None Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: User-Agent: python-novaclient Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Auth-Token: gAAAAABjDkY6icRphyVGkdJz7BIBbHv9-g4KEDeF6Ch7ieaF2ZxRZ7FVsWjW0_BPafvCdwBhnLScd2v_RjTh2fK6Isz1m-4tg2Vsy292REP1A2fqTPsSEQH9AwVEYfLv1lAhQ2uPlCW4E6ZzZSx0FdntZ2BikWzKNFT-6UwY0ZzXZ8Ca2rNf1H0 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Id: None Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Domain-Name: None Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Identity-Status: Confirmed Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Is-Admin-Project: True Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Id: default Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Domain-Name: Default Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Project-Name: admin Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Role: admin,reader,member Aug 30 17:17:47.218028 n-d-852771-11 devstack@n-api.service[106244]: X-Roles: admin,reader,member Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant: admin Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-Tenant-Name: admin Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-User: admin Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Id: default Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-User-Domain-Name: Default Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: X-User-Name: admin Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: method: > Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: exception: Flavor 451 could not be found. Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: action_args: {'id': '451'} Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:47.219609 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:47.220623 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.222090 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-7820f748-1c3b-4d9c-a4ed-7e0a6af6247c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:47.224188 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-7820f748-1c3b-4d9c-a4ed-7e0a6af6247c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394724 Aug 30 17:17:47.224188 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:17:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:47.229458 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-6a25a498-b448-46d4-adcb-997dff3766c0 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:47.244640 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-6a25a498-b448-46d4-adcb-997dff3766c0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018687 Aug 30 17:17:47.245161 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:47.254670 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:47.269891 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018740 Aug 30 17:17:47.270468 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 17:17:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:17:47.279935 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-88b0f72b-1524-459e-a15f-fb1310012dcd admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:47.285959 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.wsgi [None req-88b0f72b-1524-459e-a15f-fb1310012dcd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-88b0f72b-1524-459e-a15f-fb1310012dcd admin admin] Request method failure captured: Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Accept: application/json Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Accept-Encoding: gzip, deflate Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Connection: keep-alive Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Content-Length: 0 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Host: 10.222.0.50 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Openstack-Api-Version: compute 2.90 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: Openstack-System-Scope: None Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: User-Agent: python-novaclient Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Auth-Token: gAAAAABjDkY6icRphyVGkdJz7BIBbHv9-g4KEDeF6Ch7ieaF2ZxRZ7FVsWjW0_BPafvCdwBhnLScd2v_RjTh2fK6Isz1m-4tg2Vsy292REP1A2fqTPsSEQH9AwVEYfLv1lAhQ2uPlCW4E6ZzZSx0FdntZ2BikWzKNFT-6UwY0ZzXZ8Ca2rNf1H0 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Id: None Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Domain-Name: None Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Identity-Status: Confirmed Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Is-Admin-Project: True Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Id: default Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Domain-Name: Default Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Project-Name: admin Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Role: admin,reader,member Aug 30 17:17:47.287436 n-d-852771-11 devstack@n-api.service[106243]: X-Roles: admin,reader,member Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1520bd47b8b848fb9fe022f994eabc4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1520bd47b8b848fb9fe022f994eabc4d"}]}] Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant: admin Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Id: 1520bd47b8b848fb9fe022f994eabc4d Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-Tenant-Name: admin Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-User: admin Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Id: default Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-User-Domain-Name: Default Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-User-Id: d36626d2e1fe4d49a9bc4d33aacae766 Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: X-User-Name: admin Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: method: > Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: exception: Flavor 451 could not be found. Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: action_args: {'id': '451'} Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:47.289093 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:47.290171 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: ERROR nova.api.openstack.wsgi Aug 30 17:17:47.291245 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-88b0f72b-1524-459e-a15f-fb1310012dcd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:47.292385 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-88b0f72b-1524-459e-a15f-fb1310012dcd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012413 Aug 30 17:17:47.292676 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:17:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:17:48.262618 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:48.263882 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 30 17:17:48.264089 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:48.786532 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-1b57e98d-6f74-48c4-ae8f-0520803b0930 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:48.804848 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-1b57e98d-6f74-48c4-ae8f-0520803b0930 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401355 Aug 30 17:17:48.805378 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 17:17:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:49.810847 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:49.811873 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 30 17:17:49.812270 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:50.339188 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-14b66b1d-7832-4efd-aaa0-3b5664e8255a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:50.358296 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-14b66b1d-7832-4efd-aaa0-3b5664e8255a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406297 Aug 30 17:17:50.358836 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 17:17:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:51.322820 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:51.323848 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 30 17:17:51.324241 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:51.843529 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-3d4dfe55-cccd-440e-b185-25a11a92ae6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:51.862557 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-3d4dfe55-cccd-440e-b185-25a11a92ae6d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402265 Aug 30 17:17:51.863759 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 17:17:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:52.833485 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:52.834604 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 30 17:17:52.835003 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:53.368429 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-8bafdc09-ceef-49ad-b370-7eb00cc2f2d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:53.387663 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-8bafdc09-ceef-49ad-b370-7eb00cc2f2d2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414919 Aug 30 17:17:53.388212 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 17:17:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:17:54.349859 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:54.350862 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 30 17:17:54.351260 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:54.877743 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-d9df07a0-4d72-4128-a443-dd502b88f464 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:54.898812 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-d9df07a0-4d72-4128-a443-dd502b88f464 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408544 Aug 30 17:17:54.899353 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 30 17:17:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:18:48.326719 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.327779 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-8fdfcf67-f11c-4010-8476-ab1df0b3f1cc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 30 17:18:48.328189 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:18:48.339130 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:48.725402 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-118fa473-2cf9-457a-9a51-1699d3a35556 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.745520 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-118fa473-2cf9-457a-9a51-1699d3a35556 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410842 Aug 30 17:18:48.746047 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:18:48.767764 n-d-852771-11 devstack@n-api.service[106244]: DEBUG dbcounter [-] [106244] Writing DB stats nova_api:SELECT=14 {{(pid=106244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:48.772340 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-90edf0d9-a1d1-406d-a011-c5b0bc9f2fc8 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.780162 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-90edf0d9-a1d1-406d-a011-c5b0bc9f2fc8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013815 Aug 30 17:18:48.780684 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:48.792640 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-6282a7ad-392c-452a-8b5c-861133b0a74e admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.800147 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-6282a7ad-392c-452a-8b5c-861133b0a74e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011066 Aug 30 17:18:48.800646 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:48.811764 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.820086 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011796 Aug 30 17:18:48.820599 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:18:48.832109 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-ceecd058-8d53-43aa-9eee-697955c7778b admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:48.840208 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-ceecd058-8d53-43aa-9eee-697955c7778b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011496 Aug 30 17:18:48.840709 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 30 17:18:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:07.602769 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:07.603824 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 17:24:07.604240 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:24:07.743692 n-d-852771-11 devstack@n-api.service[106243]: DEBUG dbcounter [-] [106243] Writing DB stats nova_api:SELECT=6 {{(pid=106243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:07.897577 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:07.900970 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:07.901431 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:07.901877 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:07.902563 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:07.902989 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:07.903400 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:07.941986 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-4766529e-f70a-4512-91fa-a9ff9c15e4cc admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.199811 Aug 30 17:24:07.943048 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:24:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:24:08.768268 n-d-852771-11 devstack@n-api.service[106244]: DEBUG nova.api.openstack.wsgi [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] Calling method '>' {{(pid=106244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:08.769272 n-d-852771-11 devstack@n-api.service[106244]: INFO nova.api.openstack.requestlog [None req-29446ec7-bb71-4d35-a6c0-bf1297986833 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 30 17:24:08.769672 n-d-852771-11 devstack@n-api.service[106244]: [pid: 106244|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 17:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:24:08.964369 n-d-852771-11 devstack@n-api.service[106243]: DEBUG nova.api.openstack.wsgi [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Calling method '>' {{(pid=106243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:08.967773 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:08.968252 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:08.968682 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:08.969388 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:08.970349 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:08.970770 n-d-852771-11 devstack@n-api.service[106243]: DEBUG oslo_concurrency.lockutils [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:08.993758 n-d-852771-11 devstack@n-api.service[106243]: INFO nova.api.openstack.requestlog [None req-f4b75fa1-59c4-4a0b-9d5c-b7cf56b607b3 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.082088 Aug 30 17:24:08.994251 n-d-852771-11 devstack@n-api.service[106243]: [pid: 106243|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:24:08 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:24:53.066482 n-d-852771-11 devstack@n-api.service[106242]: Tue Aug 30 17:24:53 2022 - graceful shutdown triggered... Aug 30 17:24:53.066587 n-d-852771-11 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 17:24:53.067515 n-d-852771-11 devstack@n-api.service[106243]: Gracefully killing worker 1 (pid: 106243)... Aug 30 17:24:53.067887 n-d-852771-11 devstack@n-api.service[106244]: Gracefully killing worker 2 (pid: 106244)... Aug 30 17:24:54.066965 n-d-852771-11 devstack@n-api.service[106242]: worker 1 buried after 1 seconds Aug 30 17:24:54.066965 n-d-852771-11 devstack@n-api.service[106242]: worker 2 buried after 1 seconds Aug 30 17:24:54.066965 n-d-852771-11 devstack@n-api.service[106242]: goodbye to uWSGI. Aug 30 17:24:54.068554 n-d-852771-11 systemd[1]: devstack@n-api.service: Succeeded. Aug 30 17:24:54.069145 n-d-852771-11 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 17:24:54.072841 n-d-852771-11 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 17:24:54.089035 n-d-852771-11 devstack@n-api.service[122114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 17:24:54 2022] *** Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: nodename: n-d-852771-11 Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: machine: x86_64 Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: clock source: unix Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: pcre jit disabled Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: detected number of CPU cores: 4 Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: current working directory: / Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: detected binary path: /usr/bin/uwsgi-core Aug 30 17:24:54.105582 n-d-852771-11 devstack@n-api.service[122114]: your processes number limit is 47680 Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: your memory page size is 4096 bytes Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: detected max file descriptor number: 2048 Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: lock engine: pthread robust mutexes Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: thunder lock: enabled Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 17:24:54.106480 n-d-852771-11 devstack@n-api.service[122114]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 17:24:54.148409 n-d-852771-11 devstack@n-api.service[122114]: Python main interpreter initialized at 0x55b71a55d9c0 Aug 30 17:24:54.148409 n-d-852771-11 devstack@n-api.service[122114]: python threads support enabled Aug 30 17:24:54.148409 n-d-852771-11 devstack@n-api.service[122114]: your server socket listen backlog is limited to 100 connections Aug 30 17:24:54.148409 n-d-852771-11 devstack@n-api.service[122114]: your mercy for graceful operations on workers is 90 seconds Aug 30 17:24:54.148905 n-d-852771-11 devstack@n-api.service[122114]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 17:24:54.148905 n-d-852771-11 devstack@n-api.service[122114]: *** Operational MODE: preforking *** Aug 30 17:24:54.149107 n-d-852771-11 devstack@n-api.service[122114]: *** uWSGI is running in multiple interpreter mode *** Aug 30 17:24:54.149107 n-d-852771-11 devstack@n-api.service[122114]: spawned uWSGI master process (pid: 122114) Aug 30 17:24:54.149310 n-d-852771-11 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 17:24:54.150486 n-d-852771-11 devstack@n-api.service[122114]: spawned uWSGI worker 1 (pid: 122123, cores: 1) Aug 30 17:24:54.150486 n-d-852771-11 devstack@n-api.service[122114]: spawned uWSGI worker 2 (pid: 122124, cores: 1) Aug 30 17:24:54.150486 n-d-852771-11 devstack@n-api.service[122114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 17:24:54.821090 n-d-852771-11 devstack@n-api.service[122123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:24:54.821727 n-d-852771-11 devstack@n-api.service[122124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:24:56.012009 n-d-852771-11 devstack@n-api.service[122123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:24:56.012009 n-d-852771-11 devstack@n-api.service[122123]: from cryptography.utils import int_from_bytes Aug 30 17:24:56.012681 n-d-852771-11 devstack@n-api.service[122123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:24:56.012681 n-d-852771-11 devstack@n-api.service[122123]: from cryptography.utils import int_from_bytes Aug 30 17:24:56.016656 n-d-852771-11 devstack@n-api.service[122124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:24:56.016656 n-d-852771-11 devstack@n-api.service[122124]: from cryptography.utils import int_from_bytes Aug 30 17:24:56.017136 n-d-852771-11 devstack@n-api.service[122124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:24:56.017136 n-d-852771-11 devstack@n-api.service[122124]: from cryptography.utils import int_from_bytes Aug 30 17:24:58.490130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:24:58.490806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:24:58.490919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:24:58.491284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:24:58.491609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:24:58.492015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.492449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.492789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.493114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.493599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.493917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.494250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.494576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.494912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.495180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.495529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.495864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-11 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.496193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.496507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.496825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.497147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.497458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.498037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.498348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.498854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.499975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.499975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.499975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.500267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.500594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.500907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.501234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.501551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.501886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.502201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.502606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-11 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.502932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.503252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.503604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.504026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.504343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.504639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:24:58.505052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.505150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:24:58.505242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.505334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.505427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:24:58.505578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.505759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:24:58.505921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.506024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:24:58.506244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.506391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.506566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.506719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.506889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.507043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.507298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.507576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.507693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.507948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.508899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.509774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-11 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.510971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.511966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.512988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.513895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.514972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.515947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-11 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.516922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.517886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.518869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.519894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.520998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.521938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.522029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.522244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.522353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.522545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.522636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.523399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.523568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.523739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.523899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.524883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.525972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.526937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.527896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.528821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.529976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.530906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.531968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.532890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.533815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.534873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.535929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.536837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.537052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.537143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.537360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.537462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.537668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.537767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.537975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.538091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.538264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.539002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.539320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.539455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.539700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.539841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.540018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.540114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.540327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.540475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.540649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.540750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.540972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.541064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.541282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.541374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.541591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.541696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.541899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.541992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.542209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.542301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.542532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.542624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.542843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.542933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.543153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.543245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.543493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.543599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.543807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.543904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.544115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.544214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.544437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.544528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.544749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.544840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.545067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.545168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.545388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.545486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.545690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.545790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.546000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.546090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.546317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.546419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.546627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.546727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.546936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.547027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.547245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.547336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.547574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.547682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.547882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.547973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.548189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.548280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.548494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.548595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.548802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.548902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.549104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.549195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.549424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.549521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.549739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.549837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.550055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.550145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.550363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.550459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.550671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.550762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.550990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:24:58.551081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.551318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.551422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.551676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.551778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.552963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.553911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.554876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.555870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.556851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.557788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.558949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.559932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.560981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.561922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.562874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.563850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.564794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.565942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.566961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.567919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.568842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.569060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.569163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.569371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.569463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.570927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.571924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.572864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.573807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.574974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.575934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.576975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.577914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.578131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.578268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.578528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.578634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.578904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.579218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.579604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.579780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.579935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.580908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.581881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.582954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.583895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.584250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.584575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.584743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.584904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.585085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.585909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.586880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.587868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.588852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.589815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.590975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.591958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.592920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.593951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.594895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.595903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.596855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.597995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.598844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.599871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.600854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.601964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.602064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.602284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.602376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.602605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.602906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.603908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.604930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.605895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.606815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.607952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.608119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.608473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.608801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.608932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.609255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.609380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.609568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.609711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.609992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.610981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.611960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.612914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.613993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.614892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.615095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.615187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.615412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.615567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.615771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.616911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.617958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.618336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.618506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.618630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.618746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.618910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.619894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.620950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.621978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.622198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.622300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.622508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.622600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.623823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.624958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.625979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.626927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.627925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.628857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.629808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.630949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.631991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.632728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.632838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.633996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.634928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.635895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.636915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.637984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.638834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.639778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.640949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.641970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.642913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.643882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.644994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.645968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.646919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.647174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.647305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.647443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.647617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.648416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.648546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.648699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.648822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.649836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.650829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.651800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.652898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.653974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.654926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.655978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.656997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.657135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.657317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.657450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.657630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.657765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.658996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.659088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.659310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.659417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.659645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.659742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.660969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.661106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.661318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.661422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.661662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.661794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.662991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.663157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.663466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.663596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.663799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.663993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.664155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.664379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.664520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.664715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.664873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.667498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.667646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.667646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.667852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.667852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.668941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.669725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.670777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.671874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.672778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.673985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.674077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.674304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.674387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.674916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.675975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.676940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.677946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.678168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.678291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.678506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.678645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.678835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.679938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.680863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.681997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.682131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.682372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.682661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.682919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.683061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.683201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.683341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.683528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.684898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.685955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.686205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.686337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.686502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.686794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.686957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.687960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.688155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.688334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.688503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.688665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.688665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.689891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.690913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.691057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.691212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.691364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.691651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.691808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.692916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.693239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.693562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.693718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.693886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.694039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.695272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.695512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.695825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.695992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.696140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.696140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.696650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.696842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.697980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.698926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.699888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.700847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.701819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.702932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.703911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.704973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.705425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.705525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.705751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.705862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.706819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.707861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.708972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.709935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.710035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.710296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.710944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.711356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.711450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.711713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.711810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.712140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.712359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.712508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.712726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.712828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.713835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.714805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.715990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.716090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.716303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.716411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.716681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.716774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.717998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.718323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.718689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.718841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.719160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.719281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.719872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.720977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.721142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.741371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.741657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.741805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.741937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.742846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.743041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.743211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.743447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.744177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.744177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.745940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.746172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.746678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.747090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.749616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.749616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.749616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.749616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.749616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.750452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.750604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.750604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.750604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.750956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.751894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.752639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.753899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.754062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.754266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.754676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.754984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.755841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.756988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.757859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.758353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.758617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.758786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.759895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.760091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.760312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.760729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.760902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.761899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.762651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.763593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.763593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.763593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.763593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.764847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.765219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.765427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.765588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.765766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.765766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.766177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.766347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.766543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.766691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.766926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.767318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.768892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.769932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.770173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.771345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.771345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.771609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.771739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.771878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.772842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.773479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.773611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.773739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.773865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.774890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.775027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.776879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.776879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.776879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.776879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.776879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.778965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.779095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.779231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.779401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.779768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.779902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.780136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.780268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.780421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.780553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.780681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.781956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.782665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.783366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.783513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.783660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.783790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.783928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.784929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.785950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.786929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.787899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.788878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.789912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.790867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.791950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.792792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.793971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.794945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.795930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.796625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.797604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.797604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.797604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.797997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:24:58.798129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:24:58.857289 n-d-852771-11 devstack@n-api.service[122124]: INFO dbcounter [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Registered counter for database nova_api Aug 30 17:24:58.867061 n-d-852771-11 devstack@n-api.service[122123]: INFO dbcounter [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Registered counter for database nova_api Aug 30 17:24:58.879411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:58.887099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writer thread running {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:58.890137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_db.sqlalchemy.engines [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:58.897325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writer thread running {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:58.948259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.context [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122124) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:24:58.952341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.952838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.954424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.955159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.955682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.957903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.959998 n-d-852771-11 devstack@n-api.service[122124]: INFO dbcounter [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Registered counter for database nova_cell0 Aug 30 17:24:58.964888 n-d-852771-11 devstack@n-api.service[122124]: INFO dbcounter [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Registered counter for database nova_cell1 Aug 30 17:24:58.966126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.context [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122123) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:24:58.970237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.970723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.972402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.973119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.973561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.974016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:58.975641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.975780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:58.978173 n-d-852771-11 devstack@n-api.service[122123]: INFO dbcounter [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Registered counter for database nova_cell0 Aug 30 17:24:58.981854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writer thread running {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:58.982236 n-d-852771-11 devstack@n-api.service[122123]: INFO dbcounter [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Registered counter for database nova_cell1 Aug 30 17:24:58.983528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writer thread running {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:58.991073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_db.sqlalchemy.engines [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:58.992672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_db.sqlalchemy.engines [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:59.000129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writer thread running {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:59.002196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writer thread running {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:59.142677 n-d-852771-11 devstack@n-api.service[122124]: INFO dbcounter [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Registered counter for database nova_cell0 Aug 30 17:24:59.152113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:59.153956 n-d-852771-11 devstack@n-api.service[122123]: INFO dbcounter [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Registered counter for database nova_cell0 Aug 30 17:24:59.156864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writer thread running {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:59.162508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_db.sqlalchemy.engines [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:24:59.169120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writer thread running {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:24:59.482489 n-d-852771-11 devstack@n-api.service[122124]: WARNING keystonemiddleware.auth_token [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:24:59.489888 n-d-852771-11 devstack@n-api.service[122124]: WARNING keystonemiddleware.auth_token [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:24:59.490292 n-d-852771-11 devstack@n-api.service[122123]: WARNING keystonemiddleware.auth_token [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:24:59.498695 n-d-852771-11 devstack@n-api.service[122123]: WARNING keystonemiddleware.auth_token [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:24:59.841544 n-d-852771-11 devstack@n-api.service[122123]: WARNING keystonemiddleware.auth_token [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:24:59.842457 n-d-852771-11 devstack@n-api.service[122124]: WARNING keystonemiddleware.auth_token [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:24:59.847578 n-d-852771-11 devstack@n-api.service[122123]: WARNING keystonemiddleware.auth_token [None req-ba3dda3e-dc49-496d-a51f-540d6df28ae9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:24:59.848673 n-d-852771-11 devstack@n-api.service[122124]: WARNING keystonemiddleware.auth_token [None req-4dfb8ae3-9855-4114-b9c8-a866047d98d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:24:59.853593 n-d-852771-11 devstack@n-api.service[122123]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b71a55d9c0 pid: 122123 (default app) Aug 30 17:24:59.854634 n-d-852771-11 devstack@n-api.service[122124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b71a55d9c0 pid: 122124 (default app) Aug 30 17:25:39.029500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:39.030746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:39.031650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:39.032594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:40.372415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Calling method '.version_select at 0x7f2d9a49e3a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:40.382876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122123) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 17:25:40.383749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.384320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.384839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:40.413432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.414258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.414882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:40.429975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.430820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.431449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:40.438989 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f1322bc-075d-473f-b18f-037ad04e5165 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.415265 Aug 30 17:25:40.440147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1208 bytes} [Tue Aug 30 17:25:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:25:40.461815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:40.463297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:40.464276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:40.469541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:40.740197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8b38722-9a87-455a-ae29-387142a75f9d tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1025838410"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:40.761601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-e8b38722-9a87-455a-ae29-387142a75f9d tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Generated uuid 88c183ab-b706-4b0c-b1f6-33e095721326 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:40.856181 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8b38722-9a87-455a-ae29-387142a75f9d tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.400352 Aug 30 17:25:40.857305 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1/2] 10.222.0.50 () {62 vars in 1205 bytes} [Tue Aug 30 17:25:40 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:40.982737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '.version_select at 0x7f2d9a482f70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:40.984554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.985033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.985457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.003719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.004427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.005777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.016428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.017074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.017554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.025060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ba8fed0e-0894-4808-b048-2cecdf08e39e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.554701 Aug 30 17:25:41.032455 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:25:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:41.038113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7555006f-bf43-4649-bee3-f5455db8c943 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-473970281"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:41.211793 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7555006f-bf43-4649-bee3-f5455db8c943 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.178066 Aug 30 17:25:41.213226 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3/4] 10.222.0.50 () {62 vars in 1210 bytes} [Tue Aug 30 17:25:41 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:41.566594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:41.569957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.571613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.574059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.575284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.576367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.576987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.625672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe045372-1a49-4ba3-8d80-a3c8a487ac77 tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.410946 Aug 30 17:25:41.626825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 4/5] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 30 17:25:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:41.632106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1099b493-a3d7-4904-9f29-d84208012218 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:41.640246 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1099b493-a3d7-4904-9f29-d84208012218 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.012125 Aug 30 17:25:41.640812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 5/6] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:25:41 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:41.787827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-006158ff-4b59-4641-bcd7-405215c45160 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-35382397", "ram": 512, "vcpus": 1, "disk": 10, "id": 1226238462, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:41.821545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-006158ff-4b59-4641-bcd7-405215c45160 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.963082 Aug 30 17:25:41.822149 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2/7] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:41.834960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:41.836718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.837256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.838425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.839172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.839666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.840095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.845632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:41.855432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.856471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.857139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.858295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.859208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.860009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:41.892318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-878a7b3c-2d40-4bdc-ad9d-3b244dda216e tempest-AZAdminV2TestJSON-998658781 tempest-AZAdminV2TestJSON-998658781-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.068957 Aug 30 17:25:41.893330 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3/8] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:25:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:41.899549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba882dab-3d31-4ca7-bf87-827166d69028 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:41.903312 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02fb6940-972f-4d14-b138-148740af85fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.261280 Aug 30 17:25:41.903953 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 6/9] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:25:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:41.921440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba882dab-3d31-4ca7-bf87-827166d69028 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:41.922073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba882dab-3d31-4ca7-bf87-827166d69028 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:41.922669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba882dab-3d31-4ca7-bf87-827166d69028 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:42.243311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-519178143", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:42.711316 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba882dab-3d31-4ca7-bf87-827166d69028 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.816594 Aug 30 17:25:42.712434 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 4/10] 10.222.0.50 () {62 vars in 1232 bytes} [Tue Aug 30 17:25:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:42.909668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:25:42.932462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc6c4e53-3050-45f1-b0e5-fa4e1fd187cf tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:42.956267 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-fc6c4e53-3050-45f1-b0e5-fa4e1fd187cf tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] HTTP exception thrown: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc6c4e53-3050-45f1-b0e5-fa4e1fd187cf tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Request method failure captured: Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgS563t3exyHvQgEmQALRYEgqkYggjFjzm36OzYdcpdufWD4eB_5M9iEOR3ULnRLWiq3uDEFNe60Ii1xt6FcMyMcU5IK6oWK3Z7eQ3Ka0-Cd0hjMOwyO9mp88ZKM5W3w9wguQkNuE0hw5h9crudTMufgwz5sS7D3UTE40EPTnvK5zU Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:42.959449 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ccb7a0462e9411c84fe916eab921f1b"}]}] Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a32f5b6d303a43b3804539f54ff84ba8 Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:42.960884 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'flavor_id': '1226238462', 'id': 'hw:cpu_thread_policy'} Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:42.961589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc6c4e53-3050-45f1-b0e5-fa4e1fd187cf tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Returning 404 to user: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:42.962983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc6c4e53-3050-45f1-b0e5-fa4e1fd187cf tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] 10.222.0.50 "GET /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.247234 Aug 30 17:25:42.967590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 5/11] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:25:42 2022] GET /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:42.975005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7a6979a-1ba7-408c-b115-16be2b1742eb tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:42.986708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7a6979a-1ba7-408c-b115-16be2b1742eb tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:42.987348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7a6979a-1ba7-408c-b115-16be2b1742eb tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:42.987923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7a6979a-1ba7-408c-b115-16be2b1742eb tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:43.151442 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7a6979a-1ba7-408c-b115-16be2b1742eb tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.182670 Aug 30 17:25:43.159450 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 6/12] 10.222.0.50 () {62 vars in 1232 bytes} [Tue Aug 30 17:25:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:43.165087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b997812-31df-4d7c-8490-065c22c43305 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:43.168851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b997812-31df-4d7c-8490-065c22c43305 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a32f5b6d303a43b3804539f54ff84ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccb7a0462e9411c84fe916eab921f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b997812-31df-4d7c-8490-065c22c43305 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Request method failure captured: Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/flavors/1226238462/os-extra_specs HTTP/1.1 Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 66 Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgS563t3exyHvQgEmQALRYEgqkYggjFjzm36OzYdcpdufWD4eB_5M9iEOR3ULnRLWiq3uDEFNe60Ii1xt6FcMyMcU5IK6oWK3Z7eQ3Ka0-Cd0hjMOwyO9mp88ZKM5W3w9wguQkNuE0hw5h9crudTMufgwz5sS7D3UTE40EPTnvK5zU Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:43.173008 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ccb7a0462e9411c84fe916eab921f1b"}]}] Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a32f5b6d303a43b3804539f54ff84ba8 Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 30 17:25:43.174043 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'flavor_id': '1226238462', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:43.174640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 17:25:43.175583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:43.179321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b997812-31df-4d7c-8490-065c22c43305 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:43.180996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b997812-31df-4d7c-8490-065c22c43305 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] 10.222.0.50 "POST /compute/v2.1/flavors/1226238462/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020195 Aug 30 17:25:43.186001 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 7/13] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/flavors/1226238462/os-extra_specs => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:43.287100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:25:43.288082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:25:43.288682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:25:43.289205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:25:43.289811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:25:43.305324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:43.305889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:43.306331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:43.307059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:43.307907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:43.308349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:43.340561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Getting quotas for project c57f407e4b684ddf89dd95b5b61d2acd. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:25:43.346667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Getting quotas for user e4d2bbe9b4cd437492ae4bae3a4e335c and project c57f407e4b684ddf89dd95b5b61d2acd. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:25:43.358736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:25:43.361993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:25:43.421333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89dac49a-2643-415a-a194-d19221ce7ec7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516330 Aug 30 17:25:43.422286 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 7/14] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:25:43.428575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a85548f7-4d5d-4a82-8204-83a2a64ce8d5 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:43.454922 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a85548f7-4d5d-4a82-8204-83a2a64ce8d5 tempest-AggregatesAdminTestV241-1464554923 tempest-AggregatesAdminTestV241-1464554923-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.030597 Aug 30 17:25:43.455680 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 8/15] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:25:43 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:43.463443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4435a142-212a-4772-b03a-b7ac9fcb9cdd tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:43.463626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-428218a9-f9b1-44a7-92cf-fc9e78c46f98 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1242536224", "id": 2103221685, "os-flavor-access:is_public": "False"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:43.488563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-428218a9-f9b1-44a7-92cf-fc9e78c46f98 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.300543 Aug 30 17:25:43.490293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 8/16] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/flavors => generated 439 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:43.495520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-135e0ace-0b52-4e29-9680-c9c4ddd85cb8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:43.497032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-135e0ace-0b52-4e29-9680-c9c4ddd85cb8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:43.540402 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4435a142-212a-4772-b03a-b7ac9fcb9cdd tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1226238462/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083540 Aug 30 17:25:43.546470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 9/17] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/flavors/1226238462/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:43.551156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5eb8d053-0003-404d-b247-1a7c277dce2c tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-932080637"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:43.557022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-5eb8d053-0003-404d-b247-1a7c277dce2c tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 3942d9ce-0785-4c8e-b72c-232eabcdfb98 for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:43.603117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5eb8d053-0003-404d-b247-1a7c277dce2c tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.055392 Aug 30 17:25:43.603924 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 10/18] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:43.611131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-628d7215-e187-4b95-8a53-4c5aa1be2a9b tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:44.252539 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-628d7215-e187-4b95-8a53-4c5aa1be2a9b tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2103221685/action" status: 200 len: 97 microversion: 2.1 time: 0.647548 Aug 30 17:25:44.254000 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 11/19] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/flavors/2103221685/action => generated 97 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:44.261404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a074261e-514a-4919-9444-df71049ee5b0 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:44.263542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a074261e-514a-4919-9444-df71049ee5b0 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a32f5b6d303a43b3804539f54ff84ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccb7a0462e9411c84fe916eab921f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a074261e-514a-4919-9444-df71049ee5b0 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Request method failure captured: Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgS563t3exyHvQgEmQALRYEgqkYggjFjzm36OzYdcpdufWD4eB_5M9iEOR3ULnRLWiq3uDEFNe60Ii1xt6FcMyMcU5IK6oWK3Z7eQ3Ka0-Cd0hjMOwyO9mp88ZKM5W3w9wguQkNuE0hw5h9crudTMufgwz5sS7D3UTE40EPTnvK5zU Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:44.269125 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ccb7a0462e9411c84fe916eab921f1b"}]}] Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a32f5b6d303a43b3804539f54ff84ba8 Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:44.270307 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'flavor_id': '1226238462', 'id': 'hw:numa_nodes'} Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:44.270909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:44.271886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a074261e-514a-4919-9444-df71049ee5b0 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:44.273105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a074261e-514a-4919-9444-df71049ee5b0 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014471 Aug 30 17:25:44.276204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 12/20] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:25:44 2022] DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:44.279653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-baf655d8-227b-4ecd-b20c-7449f1f5a4ec tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:44.293567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-baf655d8-227b-4ecd-b20c-7449f1f5a4ec tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:44.294272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-baf655d8-227b-4ecd-b20c-7449f1f5a4ec tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:44.294857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-baf655d8-227b-4ecd-b20c-7449f1f5a4ec tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:44.671021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-135e0ace-0b52-4e29-9680-c9c4ddd85cb8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:44.696950 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-135e0ace-0b52-4e29-9680-c9c4ddd85cb8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1219 microversion: 2.1 time: 1.205188 Aug 30 17:25:44.702486 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 9/21] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:43 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1219 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:44.707461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95f048fa-1df5-4d08-9290-6e1d0736bb5c tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.222780 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-baf655d8-227b-4ecd-b20c-7449f1f5a4ec tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.947487 Aug 30 17:25:45.224060 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 13/22] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:45.229615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-303976a1-7e88-46f3-8722-3fb662290feb tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.259954 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-303976a1-7e88-46f3-8722-3fb662290feb tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1226238462/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034395 Aug 30 17:25:45.265802 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 14/23] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/flavors/1226238462/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:45.351581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-95f048fa-1df5-4d08-9290-6e1d0736bb5c tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95f048fa-1df5-4d08-9290-6e1d0736bb5c tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Request method failure captured: Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/flavors/2103221685/action HTTP/1.1 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 67 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVWDZnZSeZ0H6v159rG8F_0E4sh8wGPgdpOLbncEeFZ_ydEQiHb2Cv8RHlMcdTsrgiUu54gU-cV3Mwj0Jht-ABPSAeHSyPGCdJLsQUOYvaxKMLSEwL7N5NqrBL7fZmD_z-HD18kKVPFxMLBtor5POqOGW3IFfUrLRwJuKDwdXsvg8 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:45.366355 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c529c76123b94e45b20fdbb790cf1ea6"}]}] Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8f5c4236050342c5818c7d4dea59f82a Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} Aug 30 17:25:45.367759 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2103221685', 'body': {'addTenantAccess': {'tenant': '283706e58b8144b9ba17ce7df08155c9'}}} Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:25:45.368545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-283706e58b8144b9ba17ce7df08155c9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 17:25:45.369681 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 17:25:45.370826 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:25:45.373108 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-283706e58b8144b9ba17ce7df08155c9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 17, 25, 45, 345966), 'updated_at': None, 'flavor_id': 16, 'project_id': '283706e58b8144b9ba17ce7df08155c9'}] Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.374921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.380366 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:45.382612 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:45.384666 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. Aug 30 17:25:45.384666 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.384666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95f048fa-1df5-4d08-9290-6e1d0736bb5c tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 283706e58b8144b9ba17ce7df08155c9 combination. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:45.384666 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95f048fa-1df5-4d08-9290-6e1d0736bb5c tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2103221685/action" status: 409 len: 152 microversion: 2.1 time: 0.674804 Aug 30 17:25:45.384666 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 10/24] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 30 17:25:44 2022] POST /compute/v2.1/flavors/2103221685/action => generated 152 bytes in 676 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:25:45.391622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.405683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:45.406499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:45.407014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:45.444724 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-852771-11. Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 40 Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:45.454378 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: {"add_host": {"host": "n-h2-852771-11"}} Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:45.456029 n-d-852771-11 devstack@n-api.service[122124]: exception: Aggregate 2 already has host n-h2-852771-11. Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-852771-11'}}} Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:25:45.456927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852771-11-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 17:25:45.458806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 17:25:45.464133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:25:45.466792 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852771-11-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 17, 25, 45, 428585), 'updated_at': None, 'host': 'n-h2-852771-11', 'aggregate_id': 2}] Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.469514 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-852771-11. Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.471467 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-852771-11. Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:45.474540 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:45.477161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-852771-11. Aug 30 17:25:45.477161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.477161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-852771-11. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:45.477161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f4c582ef-ffc6-45b6-b9a1-b478083e0faf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 96 microversion: 2.1 time: 0.076123 Aug 30 17:25:45.477161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 11/25] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 96 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 30 17:25:45.479201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1f42954-e1f8-4f43-a280-87039cd18b0d tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.484320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1f42954-e1f8-4f43-a280-87039cd18b0d tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a32f5b6d303a43b3804539f54ff84ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccb7a0462e9411c84fe916eab921f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1f42954-e1f8-4f43-a280-87039cd18b0d tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Request method failure captured: Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 22 Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgS563t3exyHvQgEmQALRYEgqkYggjFjzm36OzYdcpdufWD4eB_5M9iEOR3ULnRLWiq3uDEFNe60Ii1xt6FcMyMcU5IK6oWK3Z7eQ3Ka0-Cd0hjMOwyO9mp88ZKM5W3w9wguQkNuE0hw5h9crudTMufgwz5sS7D3UTE40EPTnvK5zU Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:45.485940 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ccb7a0462e9411c84fe916eab921f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ccb7a0462e9411c84fe916eab921f1b"}]}] Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ccb7a0462e9411c84fe916eab921f1b Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a32f5b6d303a43b3804539f54ff84ba8 Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: {"hw:numa_nodes": "1"} Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:45.487023 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'flavor_id': '1226238462', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:45.488470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 17:25:45.491893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.495016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1f42954-e1f8-4f43-a280-87039cd18b0d tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:45.495016 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1f42954-e1f8-4f43-a280-87039cd18b0d tempest-FlavorsExtraSpecsNegativeTestJSON-830278156 tempest-FlavorsExtraSpecsNegativeTestJSON-830278156-project] 10.222.0.50 "PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021173 Aug 30 17:25:45.495016 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 12/26] 10.222.0.50 () {60 vars in 1265 bytes} [Tue Aug 30 17:25:45 2022] PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:45.500099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-278bcf5f-da3a-443a-a752-3b5bb8b2e187 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.590851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14e70459-2c17-4c15-ad99-dfb142627a3a tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-742253913", "id": 692909528, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.636325 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14e70459-2c17-4c15-ad99-dfb142627a3a tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.369405 Aug 30 17:25:45.636934 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 15/27] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/flavors => generated 427 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:45.651854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ecd4c9be-9941-4ddd-928c-550536f1a2e5 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.689850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd4c9be-9941-4ddd-928c-550536f1a2e5 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:45.693510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd4c9be-9941-4ddd-928c-550536f1a2e5 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:45.694635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd4c9be-9941-4ddd-928c-550536f1a2e5 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:45.876788 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ecd4c9be-9941-4ddd-928c-550536f1a2e5 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.237064 Aug 30 17:25:45.884849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 16/28] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:45.887408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db06adcf-e4c9-4c68-9487-3497ba8295c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:45.895957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-278bcf5f-da3a-443a-a752-3b5bb8b2e187 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2103221685/action" status: 200 len: 21 microversion: 2.1 time: 0.399876 Aug 30 17:25:45.896673 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 13/29] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/flavors/2103221685/action => generated 21 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:45.905202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:45.906691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3dbf8af-f21d-48cd-8e0a-2add053e0b82 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "fd134572bda04e9393e9a44062dc6aa6"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:45.916012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-db06adcf-e4c9-4c68-9487-3497ba8295c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] HTTP exception thrown: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db06adcf-e4c9-4c68-9487-3497ba8295c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Request method failure captured: Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgU21T6ZH7EnG9olCLAwBAOblKc-EFVVsKpEkWhcK9f9jDE5RLrlYPJ-4h69E6IN7Kgqqg8QXD1mj19G-NckvoLXOuZeo20S-3oobFjkLQevi8o5kct4Xn2D1F2VQS1BSZO4jP-bZJTk20K5b7rWKcBmAGd8PhDSORhPjISCF8TmrA Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:45.918984 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96aa4fa576664e4caf9ff6e910195d7c"}]}] Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ca8ae8240d4540b9964b0f2fc9181e26 Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:45.920218 n-d-852771-11 devstack@n-api.service[122123]: exception: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'flavor_id': '1226238462', 'id': 'hw:cpu_thread_policy'} Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:45.920851 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. Aug 30 17:25:45.921955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:45.922901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db06adcf-e4c9-4c68-9487-3497ba8295c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Returning 404 to user: Flavor 1226238462 has no extra specs with key hw:cpu_thread_policy. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:45.924014 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db06adcf-e4c9-4c68-9487-3497ba8295c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.042349 Aug 30 17:25:45.924805 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 17/30] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:25:45 2022] DELETE /compute/v2.1/flavors/1226238462/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:45.932571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:45.933760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:45.950463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:45.951324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:45.951887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:45.952670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:45.953230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:45.953891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:46.153993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:46.171364 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-053a89f4-824e-47c9-b9d4-da313c4f2fe8 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1277 microversion: 2.1 time: 0.245296 Aug 30 17:25:46.172072 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 18/31] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:45 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:46.178366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-418c82a9-17f0-48d4-8e17-fd5b3a563316 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.201709 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-418c82a9-17f0-48d4-8e17-fd5b3a563316 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.028603 Aug 30 17:25:46.202838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 19/32] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:46 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:46.212731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15c5a10f-f47c-4fb2-993b-85339998d199 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.258292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15c5a10f-f47c-4fb2-993b-85339998d199 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2103221685" status: 202 len: 0 microversion: 2.1 time: 0.051262 Aug 30 17:25:46.259227 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 20/33] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:46 2022] DELETE /compute/v2.1/flavors/2103221685 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:46.269901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2735e85-c1ff-4a84-ac21-e5395b914f40 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.277930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c2735e85-c1ff-4a84-ac21-e5395b914f40 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2735e85-c1ff-4a84-ac21-e5395b914f40 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Request method failure captured: Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 27 Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgU21T6ZH7EnG9olCLAwBAOblKc-EFVVsKpEkWhcK9f9jDE5RLrlYPJ-4h69E6IN7Kgqqg8QXD1mj19G-NckvoLXOuZeo20S-3oobFjkLQevi8o5kct4Xn2D1F2VQS1BSZO4jP-bZJTk20K5b7rWKcBmAGd8PhDSORhPjISCF8TmrA Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:46.280356 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96aa4fa576664e4caf9ff6e910195d7c"}]}] Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ca8ae8240d4540b9964b0f2fc9181e26 Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: {"hw:cpu_policy": "shared"} Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:46.281432 n-d-852771-11 devstack@n-api.service[122123]: exception: Request body and URI mismatch Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'flavor_id': '1226238462', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.282134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.283168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:46.283168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:46.283168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 30 17:25:46.283168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.286545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2735e85-c1ff-4a84-ac21-e5395b914f40 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:46.287579 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2735e85-c1ff-4a84-ac21-e5395b914f40 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026993 Aug 30 17:25:46.288246 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 21/34] 10.222.0.50 () {60 vars in 1265 bytes} [Tue Aug 30 17:25:46 2022] PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:25:46.292900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3a3d1de-1904-4856-b525-dd7333ba49be tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1565605785"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.296538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-f3a3d1de-1904-4856-b525-dd7333ba49be tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid ad305a76-6f31-49e2-aa5c-a86b7a19ad45 for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:46.322624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3a3d1de-1904-4856-b525-dd7333ba49be tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033157 Aug 30 17:25:46.327618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 22/35] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:46.332543 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3dbf8af-f21d-48cd-8e0a-2add053e0b82 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/692909528/action" status: 200 len: 96 microversion: 2.1 time: 0.432612 Aug 30 17:25:46.333971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 14/36] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:45 2022] POST /compute/v2.1/flavors/692909528/action => generated 96 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:46.342267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0b61b8df-423e-4493-bca4-64f18b235acb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.347165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-691d839e-1fd3-4a12-825f-387ec645cf7f tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-691d839e-1fd3-4a12-825f-387ec645cf7f tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Request method failure captured: Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 49 Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgU21T6ZH7EnG9olCLAwBAOblKc-EFVVsKpEkWhcK9f9jDE5RLrlYPJ-4h69E6IN7Kgqqg8QXD1mj19G-NckvoLXOuZeo20S-3oobFjkLQevi8o5kct4Xn2D1F2VQS1BSZO4jP-bZJTk20K5b7rWKcBmAGd8PhDSORhPjISCF8TmrA Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:46.361572 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96aa4fa576664e4caf9ff6e910195d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96aa4fa576664e4caf9ff6e910195d7c"}]}] Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 96aa4fa576664e4caf9ff6e910195d7c Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: ca8ae8240d4540b9964b0f2fc9181e26 Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 30 17:25:46.362820 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'flavor_id': '1226238462', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance: Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 30 17:25:46.363438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.365574 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-691d839e-1fd3-4a12-825f-387ec645cf7f tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-691d839e-1fd3-4a12-825f-387ec645cf7f tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.028908 Aug 30 17:25:46.368789 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 15/37] 10.222.0.50 () {60 vars in 1265 bytes} [Tue Aug 30 17:25:46 2022] PUT /compute/v2.1/flavors/1226238462/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:25:46.376712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0b61b8df-423e-4493-bca4-64f18b235acb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.047582 Aug 30 17:25:46.377301 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 23/38] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:46 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:46.382857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e781af6e-c81f-46cc-8ffa-668d9e3166a4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-157223870", "name": "tempest-test_aggregate-1380612530"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.429874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-e781af6e-c81f-46cc-8ffa-668d9e3166a4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 77aa0b21-649d-4bc4-ada8-e9b4473e551d for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:46.464459 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e781af6e-c81f-46cc-8ffa-668d9e3166a4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.096711 Aug 30 17:25:46.465595 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 16/39] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:46.701581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c88393d7-3ed3-4a1d-a66b-46597616700f tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.704878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c88393d7-3ed3-4a1d-a66b-46597616700f tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c88393d7-3ed3-4a1d-a66b-46597616700f tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 40 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:46.706864 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: {"add_host": {"host": "n-h2-852771-11"}} Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:46.708027 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-852771-11'}}} Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:46.708705 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 17:25:46.709759 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.712411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c88393d7-3ed3-4a1d-a66b-46597616700f tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:46.713419 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c88393d7-3ed3-4a1d-a66b-46597616700f tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.328662 Aug 30 17:25:46.714429 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 24/40] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:46.719835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0ea6362-f57f-49ab-ac53-cb2b4bcd133c tempest-FlavorsAccessTestJSON-935409404 tempest-FlavorsAccessTestJSON-935409404-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.721109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d79a8d4-dc75-4a94-a4d1-3ccc81abe37a tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.748922 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d79a8d4-dc75-4a94-a4d1-3ccc81abe37a tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1226238462" status: 202 len: 0 microversion: 2.1 time: 0.033020 Aug 30 17:25:46.750180 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 25/41] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:46 2022] DELETE /compute/v2.1/flavors/1226238462 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:46.759077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f840e601-1ea5-4625-ba4f-f6f3d60173a3 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-335180658", "id": 1626950695, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.774248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0ea6362-f57f-49ab-ac53-cb2b4bcd133c tempest-FlavorsAccessTestJSON-935409404 tempest-FlavorsAccessTestJSON-935409404-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.307309 Aug 30 17:25:46.775255 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 17/42] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:46 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:46.791168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-432dba58-a879-4d43-b5ca-d3570b2c9521 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.798884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f840e601-1ea5-4625-ba4f-f6f3d60173a3 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.044053 Aug 30 17:25:46.799504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 26/43] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/flavors => generated 437 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:46.808707 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-432dba58-a879-4d43-b5ca-d3570b2c9521 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.032109 Aug 30 17:25:46.809552 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 18/44] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:25:46 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:46.826430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-568afa73-1a20-4750-8c57-da196425695a tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.829538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-739b7869-8372-488b-abd0-6ba3395e7238 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.863007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-568afa73-1a20-4750-8c57-da196425695a tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.054578 Aug 30 17:25:46.864001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 27/45] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:46 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:46.871209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a76873bc-e00a-49af-9edc-3835d8627fa6 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "fd134572bda04e9393e9a44062dc6aa6"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.873030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-739b7869-8372-488b-abd0-6ba3395e7238 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436 tempest-FlavorsExtraSpecsNegativeTestJSON-1199444436-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.062178 Aug 30 17:25:46.873712 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 19/46] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:46 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:46.893218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e36e7b9-87ce-4ad1-ac3a-a851624277cb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:46.902822 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8e36e7b9-87ce-4ad1-ac3a-a851624277cb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e36e7b9-87ce-4ad1-ac3a-a851624277cb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Request method failure captured: Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/flavors/1626950695/os-flavor-access HTTP/1.1 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVWDZnZSeZ0H6v159rG8F_0E4sh8wGPgdpOLbncEeFZ_ydEQiHb2Cv8RHlMcdTsrgiUu54gU-cV3Mwj0Jht-ABPSAeHSyPGCdJLsQUOYvaxKMLSEwL7N5NqrBL7fZmD_z-HD18kKVPFxMLBtor5POqOGW3IFfUrLRwJuKDwdXsvg8 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:46.906454 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c529c76123b94e45b20fdbb790cf1ea6"}]}] Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8f5c4236050342c5818c7d4dea59f82a Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: exception: Access list not available for public flavors. Aug 30 17:25:46.907653 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'flavor_id': '1626950695'} Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 30 17:25:46.908317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:46.910772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e36e7b9-87ce-4ad1-ac3a-a851624277cb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:46.912560 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e36e7b9-87ce-4ad1-ac3a-a851624277cb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1626950695/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.023360 Aug 30 17:25:46.913648 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 20/47] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 30 17:25:46 2022] GET /compute/v2.1/flavors/1626950695/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:25:46.918691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f50d0a0-83f1-4db3-b3e6-48135929e800 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:46.931001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f50d0a0-83f1-4db3-b3e6-48135929e800 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:46.931880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f50d0a0-83f1-4db3-b3e6-48135929e800 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:46.932528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f50d0a0-83f1-4db3-b3e6-48135929e800 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:47.102239 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f50d0a0-83f1-4db3-b3e6-48135929e800 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 314 microversion: 2.1 time: 0.187228 Aug 30 17:25:47.103145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 21/48] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:47.107521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bfdd929-1238-405c-b905-cd47f368a43a tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-843331935"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:47.111081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-9bfdd929-1238-405c-b905-cd47f368a43a tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 55421c5e-e4ec-4cbc-9e98-93363625e465 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:47.142398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9bfdd929-1238-405c-b905-cd47f368a43a tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038126 Aug 30 17:25:47.143165 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 22/49] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:47.149115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b426f402-e73e-424a-91de-a4b4e37b51a0 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:47.200093 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b426f402-e73e-424a-91de-a4b4e37b51a0 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1626950695" status: 202 len: 0 microversion: 2.1 time: 0.055736 Aug 30 17:25:47.204819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 23/50] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:47 2022] DELETE /compute/v2.1/flavors/1626950695 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:47.210654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1525235098"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:47.220546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=11,nova_api:DELETE=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:47.233403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122124) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 17:25:47.234110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:47.234841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:47.235446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:47.250809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:47.255539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:47.258158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:47.271540 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1525235098 could not be found. Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 58 Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:47.273902 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: {"add_host": {"host": "tempest-nonexist_host-1525235098"}} Aug 30 17:25:47.275747 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: exception: Compute host tempest-nonexist_host-1525235098 could not be found. Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1525235098'}}} Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1525235098' is not mapped to any cell Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:47.276532 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 30 17:25:47.277750 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1525235098 could not be found. Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1525235098 could not be found. Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:47.278959 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1525235098 could not be found. Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:47.280292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1525235098 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:47.280928 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2eec66f-a215-421b-a9db-21cef145a2f4 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.074975 Aug 30 17:25:47.282065 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 24/51] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:25:47 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:47.920536 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a76873bc-e00a-49af-9edc-3835d8627fa6 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/692909528/action" status: 200 len: 21 microversion: 2.1 time: 1.055379 Aug 30 17:25:47.926914 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 28/52] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:46 2022] POST /compute/v2.1/flavors/692909528/action => generated 21 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:47.932214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:47.933101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:47.950767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:47.951709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:47.952374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:47.953310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:47.953963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:47.954601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:48.029798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50011e23-999a-4e30-89e7-219747d66ee5 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2023368491", "id": 1788606297, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:48.077961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50011e23-999a-4e30-89e7-219747d66ee5 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.793160 Aug 30 17:25:48.078628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 25/53] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:47 2022] POST /compute/v2.1/flavors => generated 430 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:48.092317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8453cef-85dd-44fc-959a-cb214c164f86 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.144319 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a8453cef-85dd-44fc-959a-cb214c164f86 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.064513 Aug 30 17:25:48.144907 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 26/54] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:48 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:48.176426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a70b56a-7206-41d3-8b0a-e3200a6a8943 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.213983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a70b56a-7206-41d3-8b0a-e3200a6a8943 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.067351 Aug 30 17:25:48.214900 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 27/55] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:48 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:48.294785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:48.303806 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b76ffad7-0c42-42c1-bbfe-f43458f2a830 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.375326 Aug 30 17:25:48.304389 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 29/56] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:47 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:48.332273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2ac01c4-3ff6-4142-a08f-6245caf86fba tempest-FlavorsAccessTestJSON-935409404 tempest-FlavorsAccessTestJSON-935409404-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.391132 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2ac01c4-3ff6-4142-a08f-6245caf86fba tempest-FlavorsAccessTestJSON-935409404 tempest-FlavorsAccessTestJSON-935409404-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.068584 Aug 30 17:25:48.399031 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 30/57] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:48 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:48.407630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53036e6b-a067-4df1-8506-df31b6690b1b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.445272 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53036e6b-a067-4df1-8506-df31b6690b1b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1788606297" status: 202 len: 0 microversion: 2.1 time: 0.043995 Aug 30 17:25:48.447848 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 31/58] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:48 2022] DELETE /compute/v2.1/flavors/1788606297 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:48.456134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-88ffd923-11b3-446f-9342-4c76cb1e23b7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1789452537", "id": 624587558, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:48.497676 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-88ffd923-11b3-446f-9342-4c76cb1e23b7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.048607 Aug 30 17:25:48.507932 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 32/59] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:48.543114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f1f5dd7-b670-448f-a548-16d82f17f0b6 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f1f5dd7-b670-448f-a548-16d82f17f0b6 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 283 Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:48.553048 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:48.554235 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:25:48.554772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:48.555567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:48.556743 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:48.557631 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:25:48.557631 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:25:48.557631 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:25:48.557631 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:48.558996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f1f5dd7-b670-448f-a548-16d82f17f0b6 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:48.559890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f1f5dd7-b670-448f-a548-16d82f17f0b6 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.049404 Aug 30 17:25:48.561178 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 33/60] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 30 17:25:48 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:25:48.589718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9981cc32-f259-4779-b680-eded7ccbae2e tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.599428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1114221474", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "availability_zone": "tempest-test_az-157223870"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:48.638914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:48.639880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:48.640500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:48.641436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:48.651972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:48.652739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:48.662078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9981cc32-f259-4779-b680-eded7ccbae2e tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/692909528" status: 202 len: 0 microversion: 2.1 time: 0.099127 Aug 30 17:25:48.662941 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 34/61] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:48 2022] DELETE /compute/v2.1/flavors/692909528 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:48.668133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-88ba11ee-4a01-4f3d-895a-b93815c91141 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:48.710789 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-88ba11ee-4a01-4f3d-895a-b93815c91141 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044942 Aug 30 17:25:48.712625 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 35/62] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:48.874586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:25:49.093787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6742f5e-49b6-4e47-8046-9f06d5a139b2 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.097411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6742f5e-49b6-4e47-8046-9f06d5a139b2 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'a99d1fe46744441d9d20683c8628ee47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283706e58b8144b9ba17ce7df08155c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6742f5e-49b6-4e47-8046-9f06d5a139b2 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Request method failure captured: Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/flavors/624587558/action HTTP/1.1 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 67 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgTMR_bnl4E5PAtbOMqMMPK-EkF3m3DyMGgIxC9T9PGB1eiR5LuJge2ogoXaNM_6MdsvlpN70weK4KzqtoSqbtdpTq96JIN7Rj89KRFkXdgtHanNj-VozX10JZGiub7KcIj8oFYTwcb70CWNRuPSl-NFmAnYBg2pt0PlHka5oFNIts Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 283706e58b8144b9ba17ce7df08155c9 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:49.104803 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_283706e58b8144b9ba17ce7df08155c9"}]}] Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 283706e58b8144b9ba17ce7df08155c9 Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FlavorsAccessNegativeTestJSON-1928138594-project Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a99d1fe46744441d9d20683c8628ee47 Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594-project Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} Aug 30 17:25:49.106792 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '624587558', 'body': {'addTenantAccess': {'tenant': '283706e58b8144b9ba17ce7df08155c9'}}} Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:49.108176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 17:25:49.109766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.111373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6742f5e-49b6-4e47-8046-9f06d5a139b2 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:49.111373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6742f5e-49b6-4e47-8046-9f06d5a139b2 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] 10.222.0.50 "POST /compute/v2.1/flavors/624587558/action" status: 403 len: 130 microversion: 2.1 time: 0.392653 Aug 30 17:25:49.112681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 36/63] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:48 2022] POST /compute/v2.1/flavors/624587558/action => generated 130 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:49.125777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1431b2a-ad99-4cc7-be4a-e6127fb1cf14 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1431b2a-ad99-4cc7-be4a-e6127fb1cf14 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 27 Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:49.135114 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: {"aggregate": {"name": ""}} Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:49.136326 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '' Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:49.136969 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:25:49.138543 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.140152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1431b2a-ad99-4cc7-be4a-e6127fb1cf14 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:49.140152 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1431b2a-ad99-4cc7-be4a-e6127fb1cf14 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022887 Aug 30 17:25:49.140152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 37/64] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:25:49.156942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9a2d542-5b2a-41a8-8f4f-1e9a41a0d538 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:49.222273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9a2d542-5b2a-41a8-8f4f-1e9a41a0d538 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080917 Aug 30 17:25:49.232454 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 38/65] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:49.255355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-41e00b5a-e097-404e-a4e4-e0e837138872 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2073118704", "id": 812583271, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.305188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-41e00b5a-e097-404e-a4e4-e0e837138872 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.069129 Aug 30 17:25:49.316820 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 39/66] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:49.323327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe9afd1e-6fdb-4e2a-874a-351b213d6166 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:49.383794 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe9afd1e-6fdb-4e2a-874a-351b213d6166 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/624587558" status: 202 len: 0 microversion: 2.1 time: 0.064248 Aug 30 17:25:49.384617 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 40/67] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:49 2022] DELETE /compute/v2.1/flavors/624587558 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:49.392322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f510051-d611-4289-9ad0-898992123167 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-304918872"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.407196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f510051-d611-4289-9ad0-898992123167 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f510051-d611-4289-9ad0-898992123167 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 59 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:49.419415 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: {"aggregate": {"name": "tempest-test_aggregate-304918872"}} Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:49.421631 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-304918872'}}} Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:49.422314 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:49.423264 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 17:25:49.424329 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:49.424329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f510051-d611-4289-9ad0-898992123167 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:49.424329 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f510051-d611-4289-9ad0-898992123167 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.035436 Aug 30 17:25:49.431107 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 41/68] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:49.445646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-955cdfed-ced6-4e93-8952-0c1089592d1d tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1140596043", "id": 155238186, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.504825 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-955cdfed-ced6-4e93-8952-0c1089592d1d tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.072248 Aug 30 17:25:49.505631 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 42/69] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/flavors => generated 428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:49.527112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:49.527794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:49.539650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:49.540505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:49.541451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:49.542607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:49.544041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:49.544703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:49.806101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:49.823602 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6223e3f0-8399-4982-add5-f812bb2bd058 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.316685 Aug 30 17:25:49.824856 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 43/70] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:49 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:49.832626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26bd2175-0a6f-4776-b8d2-5cbc17858e42 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:49.904612 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26bd2175-0a6f-4776-b8d2-5cbc17858e42 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.076494 Aug 30 17:25:49.907428 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 44/71] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:49 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:49.915384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-134cbd8c-9809-4b12-b9d3-61c0ce112c92 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:49.973982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-134cbd8c-9809-4b12-b9d3-61c0ce112c92 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.064289 Aug 30 17:25:49.975044 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 45/72] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:49 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:49.980158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-80ebfcfc-5913-4b8c-b840-80c64ccf2580 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2167983"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.984306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-80ebfcfc-5913-4b8c-b840-80c64ccf2580 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 866cea11-e3bf-4cd2-9729-759a4f573ce6 for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:50.029578 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-80ebfcfc-5913-4b8c-b840-80c64ccf2580 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.053155 Aug 30 17:25:50.031387 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 46/73] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:50.037890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db097f88-fdb6-4ac3-841e-99c28a156b34 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.047300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=20,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:50.060304 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db097f88-fdb6-4ac3-841e-99c28a156b34 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/155238186/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.026639 Aug 30 17:25:50.061866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 47/74] 10.222.0.50 () {58 vars in 1206 bytes} [Tue Aug 30 17:25:50 2022] GET /compute/v2.1/flavors/155238186/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:50.068442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-541ef487-d3d9-4f67-9489-80bb9823273f tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.094109 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-541ef487-d3d9-4f67-9489-80bb9823273f tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/812583271" status: 202 len: 0 microversion: 2.1 time: 0.030688 Aug 30 17:25:50.095809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 48/75] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:50 2022] DELETE /compute/v2.1/flavors/812583271 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:50.111134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7820cb0c-ff1a-4477-92ae-a46c6694416b tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1917501584", "id": 793520669, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:50.131772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7820cb0c-ff1a-4477-92ae-a46c6694416b tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.030091 Aug 30 17:25:50.136034 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 49/76] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:50 2022] POST /compute/v2.1/flavors => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:50.175909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2167983"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:50.181616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 224bc3b7-100e-4089-92eb-694c3c05b6ef for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:50.213971 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2167983 already exists. Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 57 Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:50.226235 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: {"aggregate": {"name": "tempest-test_aggregate-2167983"}} Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:50.227410 n-d-852771-11 devstack@n-api.service[122123]: exception: Aggregate tempest-test_aggregate-2167983 already exists. Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2167983'}}} Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 30 17:25:50.228338 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2167983 already exists. Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:50.229598 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2167983 already exists. Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2167983 already exists. Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2167983 already exists. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:50.232008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c3bc34e-6493-40f2-8ca3-eecfef2974fc tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 108 microversion: 2.1 time: 0.089414 Aug 30 17:25:50.233970 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 50/77] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:25:50.236639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-127f2272-1fde-4509-81e9-f41af80b2ca8 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.274748 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-127f2272-1fde-4509-81e9-f41af80b2ca8 tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/155238186" status: 202 len: 0 microversion: 2.1 time: 0.040768 Aug 30 17:25:50.279032 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 51/78] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:50 2022] DELETE /compute/v2.1/flavors/155238186 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:50.291236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37846924-822e-48a8-a5cc-efaa959a3391 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.349855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37846924-822e-48a8-a5cc-efaa959a3391 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072303 Aug 30 17:25:50.359943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 52/79] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:50.368060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:25:50.368662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:25:50.368968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:25:50.369360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:25:50.369778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:25:50.374616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-910747de-23aa-4cf9-89f2-822b4ea47dc1 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:50.390530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:50.390988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:50.399910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:50.401028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:50.401714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:50.402437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:50.485036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Getting quotas for project 05ea2e7a96c7400c8855914c665c6cea. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:25:50.498363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Getting quotas for user 05cd2cdb96774fdebb778c45138d4032 and project 05ea2e7a96c7400c8855914c665c6cea. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:25:50.537470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:25:50.541149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:25:50.623677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c694467e-08c1-49b5-ab1b-ddaa50a2a07e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407491 Aug 30 17:25:50.625759 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 28/80] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:25:50.637550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aca43efe-96d8-4f45-a845-88161919e426 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.680002 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aca43efe-96d8-4f45-a845-88161919e426 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.051567 Aug 30 17:25:50.685102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 29/81] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:50.723299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bda5f098-9608-443d-a9be-5eebd7cb51eb tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.797878 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bda5f098-9608-443d-a9be-5eebd7cb51eb tempest-FlavorsAccessTestJSON-2082502636 tempest-FlavorsAccessTestJSON-2082502636-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108523 Aug 30 17:25:50.799008 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 30/82] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:50.813000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a91e5cb9-5221-4750-8d35-ac2311028ae3 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-121869973", "id": 828704879, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:50.862489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a91e5cb9-5221-4750-8d35-ac2311028ae3 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.061209 Aug 30 17:25:50.865629 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 31/83] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:50 2022] POST /compute/v2.1/flavors => generated 425 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:50.938001 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-910747de-23aa-4cf9-89f2-822b4ea47dc1 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/793520669/action" status: 200 len: 96 microversion: 2.1 time: 0.586456 Aug 30 17:25:50.941823 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 53/84] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:50 2022] POST /compute/v2.1/flavors/793520669/action => generated 96 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:50.956428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a49046c9-9b30-4129-95fb-3efa5f7d83fb tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.961422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a49046c9-9b30-4129-95fb-3efa5f7d83fb tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:51.350619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a49046c9-9b30-4129-95fb-3efa5f7d83fb tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:51.368610 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a49046c9-9b30-4129-95fb-3efa5f7d83fb tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1242 microversion: 2.1 time: 0.418723 Aug 30 17:25:51.369857 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 54/85] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:50 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1242 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:51.390978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7fafd670-5261-4033-823c-ed4b71422383 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-67834398"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:51.402743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-7fafd670-5261-4033-823c-ed4b71422383 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 5b7af376-06ef-481b-936d-531b04b667df for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:51.437906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4147b1bf-b7ac-4e17-8357-965c1c3fda74 tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-538747317", "id": 1754970485, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:51.462192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7fafd670-5261-4033-823c-ed4b71422383 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.090053 Aug 30 17:25:51.462965 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 55/86] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:51 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:51.475136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.476756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:51.487749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:51.492666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:51.497234 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4147b1bf-b7ac-4e17-8357-965c1c3fda74 tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.629092 Aug 30 17:25:51.497386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:51.506734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:51.506734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:51.506734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:51.507054 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 32/87] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:25:50 2022] POST /compute/v2.1/flavors => generated 470 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:51.513541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-edbd2377-e1b1-4886-bc27-d184ff68fb5d tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.534652 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-edbd2377-e1b1-4886-bc27-d184ff68fb5d tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/828704879" status: 202 len: 0 microversion: 2.1 time: 0.031047 Aug 30 17:25:51.536263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 33/88] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:51 2022] DELETE /compute/v2.1/flavors/828704879 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:51.543182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d9e90d8-1448-4df4-81ef-c157aa49b335 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:51.553243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d9e90d8-1448-4df4-81ef-c157aa49b335 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'a99d1fe46744441d9d20683c8628ee47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283706e58b8144b9ba17ce7df08155c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d9e90d8-1448-4df4-81ef-c157aa49b335 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Request method failure captured: Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/flavors/793520669/action HTTP/1.1 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 70 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgTMR_bnl4E5PAtbOMqMMPK-EkF3m3DyMGgIxC9T9PGB1eiR5LuJge2ogoXaNM_6MdsvlpN70weK4KzqtoSqbtdpTq96JIN7Rj89KRFkXdgtHanNj-VozX10JZGiub7KcIj8oFYTwcb70CWNRuPSl-NFmAnYBg2pt0PlHka5oFNIts Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 283706e58b8144b9ba17ce7df08155c9 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:51.554979 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/283706e58b8144b9ba17ce7df08155c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_283706e58b8144b9ba17ce7df08155c9"}]}] Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 283706e58b8144b9ba17ce7df08155c9 Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594 Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsAccessNegativeTestJSON-1928138594-project Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a99d1fe46744441d9d20683c8628ee47 Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1928138594-project Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: {"removeTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} Aug 30 17:25:51.556120 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '793520669', 'body': {'removeTenantAccess': {'tenant': '283706e58b8144b9ba17ce7df08155c9'}}} Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can( Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:51.556748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 17:25:51.557762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.558743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d9e90d8-1448-4df4-81ef-c157aa49b335 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:51.558743 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d9e90d8-1448-4df4-81ef-c157aa49b335 tempest-FlavorsAccessNegativeTestJSON-1928138594 tempest-FlavorsAccessNegativeTestJSON-1928138594-project] 10.222.0.50 "POST /compute/v2.1/flavors/793520669/action" status: 403 len: 133 microversion: 2.1 time: 0.018491 Aug 30 17:25:51.558743 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 34/89] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:51 2022] POST /compute/v2.1/flavors/793520669/action => generated 133 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:51.563317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed0f7fe2-f8e7-4fc2-9f11-0eb288160ccb tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.565073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed0f7fe2-f8e7-4fc2-9f11-0eb288160ccb tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed0f7fe2-f8e7-4fc2-9f11-0eb288160ccb tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:51.566796 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 17:25:51.568417 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '7'} Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:51.569028 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:51.569992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed0f7fe2-f8e7-4fc2-9f11-0eb288160ccb tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:51.570875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed0f7fe2-f8e7-4fc2-9f11-0eb288160ccb tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.010408 Aug 30 17:25:51.570875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 35/90] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:51 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:51.574829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd54f107-24e3-4a29-9772-5a0002e3b715 tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:51.857276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd54f107-24e3-4a29-9772-5a0002e3b715 tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1754970485/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.286850 Aug 30 17:25:51.858329 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 36/91] 10.222.0.50 () {62 vars in 1265 bytes} [Tue Aug 30 17:25:51 2022] POST /compute/v2.1/flavors/1754970485/os-extra_specs => generated 62 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:51.873088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e348c886-202b-4176-a7ad-91fe751b4d15 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.893007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:51.907621 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87fca453-cffb-4946-ba34-9139e63c6ac9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.442487 Aug 30 17:25:51.909849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 56/92] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:51 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:51.923188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e5359a7-eacb-4463-95a9-bd6bfa5d18e3 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "283706e58b8144b9ba17ce7df08155c9"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:51.939444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e348c886-202b-4176-a7ad-91fe751b4d15 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.077871 Aug 30 17:25:51.943036 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 37/93] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:51 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:51.949609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e078bb2b-92b3-4ac5-b460-96a9f4578bae tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.985117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e078bb2b-92b3-4ac5-b460-96a9f4578bae tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.040123 Aug 30 17:25:51.985808 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 38/94] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:51 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:52.281163 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e5359a7-eacb-4463-95a9-bd6bfa5d18e3 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/793520669/action" status: 200 len: 21 microversion: 2.1 time: 0.368735 Aug 30 17:25:52.287255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 57/95] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 30 17:25:51 2022] POST /compute/v2.1/flavors/793520669/action => generated 21 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:25:52.295416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7370cabb-25dc-4512-8a4a-946ca13c653d tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.360495 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7370cabb-25dc-4512-8a4a-946ca13c653d tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1754970485" status: 202 len: 0 microversion: 2.86 time: 0.076257 Aug 30 17:25:52.364260 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 58/96] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 30 17:25:52 2022] DELETE /compute/v2.1/flavors/1754970485 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:25:52.369168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2e6f014-8cf3-411f-b2cf-5a062b8706c9 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1225297847", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:52.415881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2e6f014-8cf3-411f-b2cf-5a062b8706c9 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.050217 Aug 30 17:25:52.420974 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 59/97] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:52 2022] POST /compute/v2.1/flavors => generated 507 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:52.438419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51f4541f-f0dc-411d-bc8e-7d1a99f7bc93 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.449413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2f5c13-81c0-4a2c-8cd0-89848289bcea", "tag": "62c5175e-098a-4da3-a54c-c717ca48c47e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:52.466583 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-51f4541f-f0dc-411d-bc8e-7d1a99f7bc93 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51f4541f-f0dc-411d-bc8e-7d1a99f7bc93 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:52.470010 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: exception: Aggregate -1 could not be found. Aug 30 17:25:52.471309 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '-1'} Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:25:52.472111 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.473511 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 17:25:52.475704 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.476362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51f4541f-f0dc-411d-bc8e-7d1a99f7bc93 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:52.478149 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-51f4541f-f0dc-411d-bc8e-7d1a99f7bc93 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.055101 Aug 30 17:25:52.481894 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 60/98] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:25:52 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:25:52.495666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.496891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.497717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.499763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f62a900-91ce-463a-9e8e-f54e3e6b24c7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.538179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Creating event network-changed:62c5175e-098a-4da3-a54c-c717ca48c47e for instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea on n-h2-852771-11 Aug 30 17:25:52.538718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:25:52.539113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-52554ec1-4eba-4f9e-99a5-96faa5d7e1c5 req-7a14a109-7b54-46d1-84c6-051ecc3b6181 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:25:52.540204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.540672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.541687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f62a900-91ce-463a-9e8e-f54e3e6b24c7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/793520669" status: 202 len: 0 microversion: 2.1 time: 0.058451 Aug 30 17:25:52.547646 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 61/99] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:52 2022] DELETE /compute/v2.1/flavors/793520669 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:52.555891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.556836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.557304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.557759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.560294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97879f73-bc03-410c-9d67-d62f84fa78fd tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.577828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.compute.rpcapi [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 17:25:52.578746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] Releasing lock "compute-rpcapi-router" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:25:52.612867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a8bbcfc3-83e0-4629-864b-0d2dcf016b39 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625043 Aug 30 17:25:52.613747 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 39/100] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:52.619394 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97879f73-bc03-410c-9d67-d62f84fa78fd tempest-FlavorMetadataValidation-2113584227 tempest-FlavorMetadataValidation-2113584227-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6313 microversion: 2.86 time: 0.068757 Aug 30 17:25:52.621943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 62/101] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/flavors/detail => generated 6313 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:25:52.631791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-694b9785-923a-4d0d-8a94-a277efc144d8 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.648375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.649281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:52.655784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.656478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.657081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.657943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.662323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.663091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.681730 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-694b9785-923a-4d0d-8a94-a277efc144d8 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/ad184b06-4424-42f3-b453-cf0a748db5c4" status: 202 len: 0 microversion: 2.1 time: 0.056879 Aug 30 17:25:52.686402 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 63/102] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:25:52 2022] DELETE /compute/v2.1/flavors/ad184b06-4424-42f3-b453-cf0a748db5c4 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:52.694214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cdc8705f-3dc6-437d-8a84-fcaa87d19d48 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-540052573"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:52.705921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-cdc8705f-3dc6-437d-8a84-fcaa87d19d48 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid e2fa75e4-8471-4f63-93fc-9dfc325526a9 for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:25:52.782155 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cdc8705f-3dc6-437d-8a84-fcaa87d19d48 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.094448 Aug 30 17:25:52.789950 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 64/103] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:25:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:52.799007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dce696d7-5839-4be8-8693-122e57085576 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.836146 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dce696d7-5839-4be8-8693-122e57085576 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050408 Aug 30 17:25:52.836712 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 65/104] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:52.845920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c732ea9f-96bd-436a-8042-00ac095ed421 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.874559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c732ea9f-96bd-436a-8042-00ac095ed421 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036600 Aug 30 17:25:52.875778 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 66/105] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:52.882056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-766aaf95-1b99-481e-829d-afc058b95603 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.883876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-766aaf95-1b99-481e-829d-afc058b95603 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-766aaf95-1b99-481e-829d-afc058b95603 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:52.886179 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 17:25:52.887350 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8'} Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:52.890452 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 17:25:52.891399 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:52.893413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-766aaf95-1b99-481e-829d-afc058b95603 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:52.894535 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-766aaf95-1b99-481e-829d-afc058b95603 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.017641 Aug 30 17:25:52.896043 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 67/106] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:52.913999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a01a17af-15c3-401b-a820-3c3721d56398 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1249470515", "id": 1668245462, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:52.960410 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a01a17af-15c3-401b-a820-3c3721d56398 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.062052 Aug 30 17:25:52.964539 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 68/107] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:52 2022] POST /compute/v2.1/flavors => generated 439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:52.972648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82b80766-a504-4fff-9e2c-6209fd1dc41e tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-349653536", "id": "3f7e4400-ebf5-4e6b-b78f-0c60f78fd59a", "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:53.011133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:53.029449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-edeef6de-f992-4c3b-b256-93dea0e0f76c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1234 microversion: 2.1 time: 0.413351 Aug 30 17:25:53.034024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 40/108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1234 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:53.041304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91a0c98a-94a6-4c98-852a-c2589dbbafaf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.042286 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82b80766-a504-4fff-9e2c-6209fd1dc41e tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.075440 Aug 30 17:25:53.048086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 69/109] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:53.055257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.056191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:53.084787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:53.087170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:53.094014 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91a0c98a-94a6-4c98-852a-c2589dbbafaf tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.056259 Aug 30 17:25:53.101712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:53.101712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:53.101712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:53.103791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 41/110] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:53 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:25:53.104427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:53.123199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50e06d54-5026-43eb-8b55-a554ecd781eb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1d2cd27819d46d5bf9f60bf6c4ae4b7"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:53.196016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=16,nova_api:INSERT=7 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:53.324048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:53.354910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:53.368460 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b6561e83-a0f5-46d1-b332-e84257a4f9c7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.317759 Aug 30 17:25:53.373296 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 70/111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:53.385998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-631f8332-ce2b-49a8-9484-ad8948ca86bd tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.417454 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-631f8332-ce2b-49a8-9484-ad8948ca86bd tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/3f7e4400-ebf5-4e6b-b78f-0c60f78fd59a" status: 202 len: 0 microversion: 2.1 time: 0.040924 Aug 30 17:25:53.418531 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 71/112] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:25:53 2022] DELETE /compute/v2.1/flavors/3f7e4400-ebf5-4e6b-b78f-0c60f78fd59a => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:53.423219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-685642e8-2528-4d6e-a65d-5baddaff2942 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.442720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-685642e8-2528-4d6e-a65d-5baddaff2942 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-685642e8-2528-4d6e-a65d-5baddaff2942 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:25:53.445174 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: exception: Aggregate -1 could not be found. Aug 30 17:25:53.446896 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '-1'} Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.447671 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 17:25:53.449074 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.451230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-685642e8-2528-4d6e-a65d-5baddaff2942 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:53.452316 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-685642e8-2528-4d6e-a65d-5baddaff2942 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032715 Aug 30 17:25:53.457324 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 72/113] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:25:53.467241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99bebe76-a046-4f78-99a6-623cf84a8a34 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.513256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99bebe76-a046-4f78-99a6-623cf84a8a34 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053881 Aug 30 17:25:53.514553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 73/114] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:53.520767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21741820-1b19-4baa-bb18-c288a3bc3734 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.523997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21741820-1b19-4baa-bb18-c288a3bc3734 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21741820-1b19-4baa-bb18-c288a3bc3734 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:25:53.528402 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 17:25:53.529873 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:25:53.530496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 17:25:53.531697 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.533792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21741820-1b19-4baa-bb18-c288a3bc3734 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:53.534919 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21741820-1b19-4baa-bb18-c288a3bc3734 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.019126 Aug 30 17:25:53.536919 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 74/115] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:53.544896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d975c82-dc8c-4fc8-864d-cd1616d4c341 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-421538902", "id": 1449104023, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:53.568822 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d975c82-dc8c-4fc8-864d-cd1616d4c341 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.029879 Aug 30 17:25:53.570075 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 75/116] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:53 2022] POST /compute/v2.1/flavors => generated 413 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:53.585668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6728e519-7267-435d-8027-912e7e419a4b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.611711 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6728e519-7267-435d-8027-912e7e419a4b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1449104023" status: 200 len: 413 microversion: 2.1 time: 0.032560 Aug 30 17:25:53.615625 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 76/117] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/flavors/1449104023 => generated 413 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:53.846269 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-50e06d54-5026-43eb-8b55-a554ecd781eb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] HTTP exception thrown: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50e06d54-5026-43eb-8b55-a554ecd781eb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Request method failure captured: Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/flavors/1668245462/action HTTP/1.1 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 70 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVWDZnZSeZ0H6v159rG8F_0E4sh8wGPgdpOLbncEeFZ_ydEQiHb2Cv8RHlMcdTsrgiUu54gU-cV3Mwj0Jht-ABPSAeHSyPGCdJLsQUOYvaxKMLSEwL7N5NqrBL7fZmD_z-HD18kKVPFxMLBtor5POqOGW3IFfUrLRwJuKDwdXsvg8 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:25:53.849033 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c529c76123b94e45b20fdbb790cf1ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c529c76123b94e45b20fdbb790cf1ea6"}]}] Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c529c76123b94e45b20fdbb790cf1ea6 Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-740871940 Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8f5c4236050342c5818c7d4dea59f82a Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: {"removeTenantAccess": {"tenant": "a1d2cd27819d46d5bf9f60bf6c4ae4b7"}} Aug 30 17:25:53.850706 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1668245462', 'body': {'removeTenantAccess': {'tenant': 'a1d2cd27819d46d5bf9f60bf6c4ae4b7'}}} Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 30 17:25:53.856147 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.857037 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. Aug 30 17:25:53.858099 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:53.862595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50e06d54-5026-43eb-8b55-a554ecd781eb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Returning 404 to user: Flavor access not found for 27 / a1d2cd27819d46d5bf9f60bf6c4ae4b7 combination. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:53.863961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50e06d54-5026-43eb-8b55-a554ecd781eb tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1668245462/action" status: 404 len: 124 microversion: 2.1 time: 0.758662 Aug 30 17:25:53.868973 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 42/118] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 30 17:25:53 2022] POST /compute/v2.1/flavors/1668245462/action => generated 124 bytes in 764 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:53.875644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98a03937-3ce9-4cb5-83b2-4501950cf591 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.912761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98a03937-3ce9-4cb5-83b2-4501950cf591 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1668245462" status: 202 len: 0 microversion: 2.1 time: 0.041620 Aug 30 17:25:53.916768 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 43/119] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:53 2022] DELETE /compute/v2.1/flavors/1668245462 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:53.930832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4f16acf5-b7ab-4a8e-9d28-aa159b91f2d7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:53.969055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4f16acf5-b7ab-4a8e-9d28-aa159b91f2d7 tempest-FlavorsAccessNegativeTestJSON-740871940 tempest-FlavorsAccessNegativeTestJSON-740871940-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.049487 Aug 30 17:25:53.970666 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 44/120] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.009908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc35ffcc-b015-4bf9-9e9e-67f96c9cc267 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.060805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.061444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:54.069780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.070261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.070693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.071404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.072798 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc35ffcc-b015-4bf9-9e9e-67f96c9cc267 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.420299 Aug 30 17:25:54.074332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 77/121] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:53 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.079434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.079940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.091613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c15be6b-9e20-4f75-9396-415557a5a996 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.144777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c15be6b-9e20-4f75-9396-415557a5a996 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1449104023" status: 202 len: 0 microversion: 2.1 time: 0.057367 Aug 30 17:25:54.147535 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 78/122] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:54 2022] DELETE /compute/v2.1/flavors/1449104023 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:54.162515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fcb13c76-b84d-4b11-9517-236dca291cf4 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.207429 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fcb13c76-b84d-4b11-9517-236dca291cf4 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054681 Aug 30 17:25:54.215694 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 79/123] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.240126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dd333a6-a364-4306-80e9-45af9d9e14d8 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1901723447", "id": 1002866812, "os-flavor-access:is_public": "False"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:54.290023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:54.299151 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-63fcf4b4-02f7-466b-9735-6d301b5e2c44 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1290 microversion: 2.1 time: 0.248928 Aug 30 17:25:54.299334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9dd333a6-a364-4306-80e9-45af9d9e14d8 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.067989 Aug 30 17:25:54.307948 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 45/124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1290 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.308256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 80/125] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:25:54.328087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2478b3e-d9a4-4991-bdd1-78297b69c831 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "1002866812"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:54.394231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.395093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:54.409277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8,nova_api:DELETE=15,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:54.412739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.421719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.425765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.428353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.428963 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b2478b3e-d9a4-4991-bdd1-78297b69c831 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] HTTP exception thrown: Flavor 1002866812 could not be found. Aug 30 17:25:54.430382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.433770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2478b3e-d9a4-4991-bdd1-78297b69c831 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Request method failure captured: Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 107 Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgZV2659BC4PAXyqlJBN-J2qfKJS7yGs3EV_LGs6o0piJJI6yPJv5AjtMzi0E3l80Mk9NaksxqF4hOeL3eE31nAkK9B1JNUwgpFMXKUvMHFMP-SjB-MoQpoCn3lC64UkdiADMUXiFhCQLUFsmxvb9gA4h_jg5Cuyk_hghnR24-HZyQ Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 109cf59f1d8d464a8349b06201b41e4f Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsAdminTestJSON-1410898656 Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:25:54.436423 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/109cf59f1d8d464a8349b06201b41e4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/109cf59f1d8d464a8349b06201b41e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/109cf59f1d8d464a8349b06201b41e4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_109cf59f1d8d464a8349b06201b41e4f"}]}] Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsAdminTestJSON-1410898656 Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 109cf59f1d8d464a8349b06201b41e4f Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1410898656 Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsAdminTestJSON-1410898656-project Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 00ef5bac24e142dfbf620a5313fa40a8 Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsAdminTestJSON-1410898656-project Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "test", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "1002866812"}} Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:25:54.437592 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor 1002866812 could not be found. Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '1002866812'}}} Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1002866812 could not be found. Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:54.438344 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1002866812 could not be found. Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:54.439357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:54.440555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:54.440555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:54.440555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:54.440555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1002866812 could not be found. Aug 30 17:25:54.440555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:25:54.445412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2478b3e-d9a4-4991-bdd1-78297b69c831 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Returning 400 to user: Flavor 1002866812 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:54.446492 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2478b3e-d9a4-4991-bdd1-78297b69c831 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.135034 Aug 30 17:25:54.448209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 46/126] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:54 2022] POST /compute/v2.1/servers => generated 81 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:25:54.470024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eee8da16-9563-4940-8526-f9bf50bad57f tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.558357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eee8da16-9563-4940-8526-f9bf50bad57f tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1002866812" status: 202 len: 0 microversion: 2.1 time: 0.105405 Aug 30 17:25:54.572083 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 47/127] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:54 2022] DELETE /compute/v2.1/flavors/1002866812 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:54.576653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42ffc066-bb30-4070-aedb-0eff991aa139 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.667095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42ffc066-bb30-4070-aedb-0eff991aa139 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091795 Aug 30 17:25:54.685553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 48/128] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.694455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18a47006-0dbe-4bd7-84e7-e69ae7eddeed tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-688370241", "id": 1426908633, "os-flavor-access:is_public": "False"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:54.725939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18a47006-0dbe-4bd7-84e7-e69ae7eddeed tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.037912 Aug 30 17:25:54.737192 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 49/129] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:54.743253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4426a682-697a-4e23-bbf5-5c077a303bbd tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1981302169", "id": 1086803152, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:54.775895 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4426a682-697a-4e23-bbf5-5c077a303bbd tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036651 Aug 30 17:25:54.789872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 50/130] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:54.795896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:54.796854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f5bdd4b-abac-481c-91bc-6e6e55508a12 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.824938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f5bdd4b-abac-481c-91bc-6e6e55508a12 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.033170 Aug 30 17:25:54.829882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d3ec529-cf23-47b5-9591-6bad0739cfc6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.437765 Aug 30 17:25:54.832164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 51/131] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:54.839935 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 81/132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:54.847257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe91d467-6f1c-497d-a799-0a88f340cdb2 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.894407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe91d467-6f1c-497d-a799-0a88f340cdb2 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.057306 Aug 30 17:25:54.896357 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 52/133] 10.222.0.50 () {58 vars in 1177 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:25:54.909575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c92de7f-91e1-4f7d-987c-1a1392911523 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.930551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c92de7f-91e1-4f7d-987c-1a1392911523 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.025443 Aug 30 17:25:54.940044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 53/134] 10.222.0.50 () {58 vars in 1171 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:25:54.992275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea24ebd2-8208-4880-bdbc-dcabd99e6ed3 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.018745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea24ebd2-8208-4880-bdbc-dcabd99e6ed3 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.067246 Aug 30 17:25:55.021321 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 54/135] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:55.045274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f84c9095-6d1b-475e-bc7d-e979f1223a50 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.095994 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f84c9095-6d1b-475e-bc7d-e979f1223a50 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.054297 Aug 30 17:25:55.116688 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 55/136] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.122747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c426e5d-5013-4839-a955-fe40d3c94680 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.150281 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c426e5d-5013-4839-a955-fe40d3c94680 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.031332 Aug 30 17:25:55.155716 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 56/137] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.175534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c2498cc-b2db-4141-9e0d-41abc1692675 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.206049 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c2498cc-b2db-4141-9e0d-41abc1692675 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.034752 Aug 30 17:25:55.220366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 57/138] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.231614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f663ff97-3291-4f85-b656-3038e6ab5009 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.269942 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f663ff97-3291-4f85-b656-3038e6ab5009 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.042086 Aug 30 17:25:55.270821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 58/139] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.297479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20365c6a-cff9-49e3-80cb-0e1bd4031fef tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.324376 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20365c6a-cff9-49e3-80cb-0e1bd4031fef tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1086803152" status: 202 len: 0 microversion: 2.1 time: 0.031566 Aug 30 17:25:55.329098 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 59/140] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:55 2022] DELETE /compute/v2.1/flavors/1086803152 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:55.335747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.336654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:55.343696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.344614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.345474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:55.346399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.347046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.347771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:55.385549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1938979617", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:55.437589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:55.447667 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ca898e6-8b92-4743-8ca1-022e96cfa71c tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1290 microversion: 2.1 time: 0.116701 Aug 30 17:25:55.448950 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 60/141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.453478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bea03cd-c558-4ddf-b78d-c3a017066ee2 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.486523 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bea03cd-c558-4ddf-b78d-c3a017066ee2 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036119 Aug 30 17:25:55.486845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:25:55.487339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 61/142] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.508568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0babdd1-90de-4635-9046-15d2d86eed06 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.537784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0babdd1-90de-4635-9046-15d2d86eed06 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1426908633" status: 202 len: 0 microversion: 2.1 time: 0.036157 Aug 30 17:25:55.543987 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 62/143] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:55 2022] DELETE /compute/v2.1/flavors/1426908633 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:55.549747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3db7f279-dc0e-4013-ad4b-540bb4c0b354 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.573899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3db7f279-dc0e-4013-ad4b-540bb4c0b354 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026592 Aug 30 17:25:55.592449 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 63/144] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.630768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-27d7d026-5b93-4acd-ac21-d122fd89693c tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1059417232", "id": 665339594, "os-flavor-access:is_public": "False"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:55.749526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-27d7d026-5b93-4acd-ac21-d122fd89693c tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.154340 Aug 30 17:25:55.758157 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 64/145] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:55 2022] POST /compute/v2.1/flavors => generated 412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:25:55.770063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3fc51806-f713-4a9d-a152-fdb221dfef3d tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.830856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3fc51806-f713-4a9d-a152-fdb221dfef3d tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070627 Aug 30 17:25:55.837147 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 65/146] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.854908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.856536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:55.872657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.873789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.875520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:55.877874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.880154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.882221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.167740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:25:56.168162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:25:56.169362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:25:56.170526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:25:56.171163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:25:56.198798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.199932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.201101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.202626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.203372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.205061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.250028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Getting quotas for project 64921ce5b0004ed284b672832f77e4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:25:56.261247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Getting quotas for user 369e029edcc0477b9c1e123e2a30b0fc and project 64921ce5b0004ed284b672832f77e4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:25:56.295653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:25:56.299058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:25:56.356220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:56.367656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc227ef2-7fcf-4b47-9607-863308fb51e2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.519358 Aug 30 17:25:56.372632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 66/147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:25:56.383456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b71a4ac-2910-410c-8c61-bb0a77af3a60 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.406610 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fac0eb8-8b79-4a06-b1be-76943e233fe3 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545628 Aug 30 17:25:56.416922 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 82/148] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:25:56.421991 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b71a4ac-2910-410c-8c61-bb0a77af3a60 tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051109 Aug 30 17:25:56.422632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 67/149] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.431683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19e8b442-b80a-48c5-8c12-08640a49ce09 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.432976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19e8b442-b80a-48c5-8c12-08640a49ce09 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:56.447405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46a0c6c7-b2ba-4baa-8998-09a2db45f182 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.481811 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46a0c6c7-b2ba-4baa-8998-09a2db45f182 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/665339594" status: 202 len: 0 microversion: 2.1 time: 0.043972 Aug 30 17:25:56.483211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 68/150] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:25:56 2022] DELETE /compute/v2.1/flavors/665339594 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:25:56.492037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.493896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:56.506563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.507348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.507601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.508225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.508679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.509202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.614443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19e8b442-b80a-48c5-8c12-08640a49ce09 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:56.629394 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19e8b442-b80a-48c5-8c12-08640a49ce09 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1219 microversion: 2.1 time: 0.209952 Aug 30 17:25:56.634143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 83/151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1219 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.646090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:56.659722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c285eaab-ef42-4e75-8557-1185a9277dde tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.668624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7316c5d-2470-4ebc-b6c8-513be4c424bd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1298 microversion: 2.1 time: 0.174824 Aug 30 17:25:56.669939 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 69/152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.773623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c285eaab-ef42-4e75-8557-1185a9277dde tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.138164 Aug 30 17:25:56.783996 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 84/153] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.797268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b1abb880-5dc1-4d63-9843-6845d84e010b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1465432317", "id": 1209993846, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:56.836762 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b1abb880-5dc1-4d63-9843-6845d84e010b tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.044829 Aug 30 17:25:56.838292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 70/154] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:56 2022] POST /compute/v2.1/flavors => generated 414 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:56.850762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c59fc09-e0cb-44f6-8967-caec22b7a8fe tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.885783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c59fc09-e0cb-44f6-8967-caec22b7a8fe tempest-FlavorsAdminTestJSON-1410898656 tempest-FlavorsAdminTestJSON-1410898656-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.039259 Aug 30 17:25:56.902920 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 85/155] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.905841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc48fa1b-0c71-4648-9c9c-352c593a4af4 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.967580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc48fa1b-0c71-4648-9c9c-352c593a4af4 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1209993846" status: 202 len: 0 microversion: 2.1 time: 0.066638 Aug 30 17:25:56.968164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 71/156] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:25:56 2022] DELETE /compute/v2.1/flavors/1209993846 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:56.977154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4fc58369-4f56-4fca-bfb6-188b084be657 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:57.053612 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4fc58369-4f56-4fca-bfb6-188b084be657 tempest-FlavorsAdminTestJSON-1000879541 tempest-FlavorsAdminTestJSON-1000879541-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081036 Aug 30 17:25:57.055539 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 86/157] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:57.390749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:57.392274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:57.406047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.406854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.408804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.413032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.413838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.414287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.653726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:57.654399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:57.665198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.666167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.668467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.669703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.672688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.673590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.710344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:57.724231 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a96fc950-e2cf-4409-8287-144899fa55ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.337183 Aug 30 17:25:57.726841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 72/158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:57 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:57.747283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:57.747999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:57.755057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.755577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.756270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.756979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.757592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.758905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.778154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:57.791319 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1849edf3-87f2-435e-86e4-6672e0aeacf7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1215 microversion: 2.1 time: 0.141187 Aug 30 17:25:57.793060 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 87/159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:57 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:58.003286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:58.014321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd14af17-5f63-4434-b1c1-65eb7c3a6865 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1296 microversion: 2.1 time: 0.277433 Aug 30 17:25:58.015670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 73/160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:57 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1296 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:58.768962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:58.771277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:58.790510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.796091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.798353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:58.805450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.806440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.818816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:58.819773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:58.823763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:58.844639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.852245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.853034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:58.854028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.857441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.858207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:59.014208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:59.033689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc3fd0c6-d4a2-4a02-85d9-1bc48fcd8d99 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1277 microversion: 2.1 time: 0.223132 Aug 30 17:25:59.036619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 74/161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:58 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:25:59.047028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:59.049667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:59.062114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:59.063255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:59.064202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:59.064932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:59.065551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:59.066267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:59.160618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:59.172984 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-284787d4-2fe2-415b-8c64-1a54e76e07d1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1296 microversion: 2.1 time: 0.130634 Aug 30 17:25:59.175361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 75/162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:59 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:59.370022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:59.394611 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-833c498f-e179-461f-b11f-8d7a5031bc87 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.647809 Aug 30 17:25:59.397886 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 88/163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:58 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:59.996953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50eee503-8b35-4449-9327-c7fe59924761 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1542402984", "id": 1608970689, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:00.036081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:00.041466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50eee503-8b35-4449-9327-c7fe59924761 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.719377 Aug 30 17:26:00.050514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 76/164] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:25:59 2022] POST /compute/v2.1/flavors => generated 449 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:00.063611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:00.068850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:00.088485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.089273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.089980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.091002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.091699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.092452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.374889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-10f5401e-de17-4f9d-89c1-72396562ef46 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:00.396476 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-10f5401e-de17-4f9d-89c1-72396562ef46 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] 10.222.0.50 "GET /compute/v2.1/flavors/1608970689" status: 200 len: 449 microversion: 2.55 time: 0.342903 Aug 30 17:26:00.398017 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 89/165] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/flavors/1608970689 => generated 449 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:00.412863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:00.414075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:00.427035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.427548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.427987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.430026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.430512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.430947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.493179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:00.505894 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72c0044d-615b-4c3d-aea0-ab7230f0edd9 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.446000 Aug 30 17:26:00.507837 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 77/166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:00.520804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58ed5809-c5b9-4a2f-ab09-8d73bc4f87d3 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9a859dc0>, body: {"flavor": {"description": "new"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:00.563031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:00.612618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58ed5809-c5b9-4a2f-ab09-8d73bc4f87d3 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1608970689" status: 200 len: 450 microversion: 2.55 time: 0.100982 Aug 30 17:26:00.617193 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 78/167] 10.222.0.50 () {62 vars in 1219 bytes} [Tue Aug 30 17:26:00 2022] PUT /compute/v2.1/flavors/1608970689 => generated 450 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:00.624350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:00.625292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:00.645756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.659612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.661883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.665862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.667513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.668067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.940143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:00.954830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcca09d5-b590-4d0f-aba5-0504926d1fc3 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.336224 Aug 30 17:26:00.956919 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 79/168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:00.997435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d209dec3-0f05-4435-b64e-e9aef8f41bf5 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.036522 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d209dec3-0f05-4435-b64e-e9aef8f41bf5 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.075989 Aug 30 17:26:01.038600 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 80/169] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:01.040837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:01.052832 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95900d2e-1841-4e07-9a38-07906f972157 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.653505 Aug 30 17:26:01.064435 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 90/170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:01.065089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b99492b-7a64-4197-8df1-cecabbf72a51 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.125329 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b99492b-7a64-4197-8df1-cecabbf72a51 tempest-FlavorsV255TestJSON-818675820 tempest-FlavorsV255TestJSON-818675820-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.069577 Aug 30 17:26:01.140224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 81/171] 10.222.0.50 () {60 vars in 1166 bytes} [Tue Aug 30 17:26:01 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:01.151497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c69168a1-414a-403e-82cd-23725b886a1c tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.204209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c69168a1-414a-403e-82cd-23725b886a1c tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1608970689" status: 202 len: 0 microversion: 2.55 time: 0.064354 Aug 30 17:26:01.205176 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 91/172] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 30 17:26:01 2022] DELETE /compute/v2.1/flavors/1608970689 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:01.216797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a11080ac-ec22-4971-8490-87f4d555f7b0 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.261532 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a11080ac-ec22-4971-8490-87f4d555f7b0 tempest-FlavorsV255TestJSON-1180117752 tempest-FlavorsV255TestJSON-1180117752-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.045574 Aug 30 17:26:01.262195 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 82/173] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:26:01 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:01.834671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273f80fe-bc1d-4d13-b4fd-46d07c7951d8", "tag": "52934096-f023-4397-bec9-7f2c83105596"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:01.853264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.854270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.854838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.882098 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Creating event network-changed:52934096-f023-4397-bec9-7f2c83105596 for instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 on n-h2-852771-11 Aug 30 17:26:01.882873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:26:01.883396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da27d686-70df-4032-929e-5ce15ea72759 req-be885c3a-b17a-4f9c-a4cb-451d45a62f1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:26:01.884636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.885240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.885845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.886742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.887339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.887933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.904341 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.rpcapi [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 17:26:01.905269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] Releasing lock "compute-rpcapi-router" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:26:01.932820 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71b74732-a546-4cd8-aae5-4703cc2e0afc None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.655615 Aug 30 17:26:01.933962 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 92/174] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:01.941966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.943144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:01.950103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.950630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.951081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.951983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.952605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.953196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.012294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-abc6bd0d-8019-4941-98b0-f503843d9ce5 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-828512753", "ram": 512, "vcpus": 1, "disk": 10, "id": 1620054642, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:02.051458 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-abc6bd0d-8019-4941-98b0-f503843d9ce5 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.645575 Aug 30 17:26:02.054736 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 83/175] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:26:01 2022] POST /compute/v2.1/flavors => generated 415 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:02.075514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.076836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:02.085911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.086924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.087592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.088533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.089231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.089889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.174258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:02.194856 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-130fbb78-f9fb-4b0c-a531-c563ed8ea829 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.258985 Aug 30 17:26:02.199232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 93/176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:01 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:02.208604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8324344b-d27b-4ba9-9927-29c005c79ee8 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:02.249118 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8324344b-d27b-4ba9-9927-29c005c79ee8 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047460 Aug 30 17:26:02.249745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 94/177] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:26:02 2022] POST /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.256933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.257552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:02.266867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.267705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.268756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.269607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.270395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.270753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.332169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:02.343994 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e76f678-d27d-4867-94a2-a446263c23a0 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.287409 Aug 30 17:26:02.352778 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 84/178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:02.496338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:02.505885 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0aff44eb-e168-49a3-849a-d1e98243b31a tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.255112 Aug 30 17:26:02.509329 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 95/179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:02.576144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:02.776045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0781d0b-283e-4736-b1e1-45b13f75a9ce tempest-FlavorsExtraSpecsTestJSON-1557141234 tempest-FlavorsExtraSpecsTestJSON-1557141234-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.794261 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0781d0b-283e-4736-b1e1-45b13f75a9ce tempest-FlavorsExtraSpecsTestJSON-1557141234 tempest-FlavorsExtraSpecsTestJSON-1557141234-project] 10.222.0.50 "GET /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.439767 Aug 30 17:26:02.795688 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 85/180] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.806823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b80d06e0-ed35-449a-a086-ef18870dac69 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:02.821768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=9,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:02.838322 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b80d06e0-ed35-449a-a086-ef18870dac69 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035224 Aug 30 17:26:02.840113 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 96/181] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:26:02 2022] POST /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.854600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4272ab6-6328-4c25-9f10-8696fbba220f tempest-FlavorsExtraSpecsTestJSON-1557141234 tempest-FlavorsExtraSpecsTestJSON-1557141234-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.869591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4272ab6-6328-4c25-9f10-8696fbba220f tempest-FlavorsExtraSpecsTestJSON-1557141234 tempest-FlavorsExtraSpecsTestJSON-1557141234-project] 10.222.0.50 "GET /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024123 Aug 30 17:26:02.875779 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 86/182] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.881003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b55ac4aa-63e4-4af9-a15a-ed53689b114c tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:02.915867 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b55ac4aa-63e4-4af9-a15a-ed53689b114c tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038515 Aug 30 17:26:02.916988 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 97/183] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 30 17:26:02 2022] POST /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.929393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a591597-fea2-4e88-8619-4e94abc63bcb tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.940624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a591597-fea2-4e88-8619-4e94abc63bcb tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015696 Aug 30 17:26:02.941403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 87/184] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:02.951582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8315d28f-2809-4c1b-ac87-b366a9eb89a9 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:02.999020 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8315d28f-2809-4c1b-ac87-b366a9eb89a9 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.050325 Aug 30 17:26:02.999722 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 98/185] 10.222.0.50 () {60 vars in 1265 bytes} [Tue Aug 30 17:26:02 2022] PUT /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:03.009565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a07a692-1d4d-4b7e-b918-633da6f9be71 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.026207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a07a692-1d4d-4b7e-b918-633da6f9be71 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017626 Aug 30 17:26:03.027637 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 88/186] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/flavors/1620054642/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:03.038908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3de89567-21cb-482c-8ac3-12b2618c5d45 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.079653 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3de89567-21cb-482c-8ac3-12b2618c5d45 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.044851 Aug 30 17:26:03.084935 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 99/187] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:26:03 2022] DELETE /compute/v2.1/flavors/1620054642/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:03.090250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84e5ef30-0cbd-4a34-880a-14adc87a6350 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.124926 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84e5ef30-0cbd-4a34-880a-14adc87a6350 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1620054642/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.039480 Aug 30 17:26:03.126325 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 89/188] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:26:03 2022] DELETE /compute/v2.1/flavors/1620054642/os-extra_specs/hw:cpu_policy => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:03.133775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea4f065a-4316-4053-9a1e-f381e3625c17 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.143418 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea4f065a-4316-4053-9a1e-f381e3625c17 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1620054642/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013135 Aug 30 17:26:03.144036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 100/189] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/flavors/1620054642/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:26:03.156306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1082e43a-5810-4723-b28e-6d506f9fa530 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.197066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1082e43a-5810-4723-b28e-6d506f9fa530 tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1620054642" status: 202 len: 0 microversion: 2.1 time: 0.045802 Aug 30 17:26:03.197686 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 90/190] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:26:03 2022] DELETE /compute/v2.1/flavors/1620054642 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:26:03.205888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e70a5b8-ed45-469d-be95-e628c0a0bfce tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.225227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.226173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:03.239121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.239904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.240980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.242954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.243417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.244214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e70a5b8-ed45-469d-be95-e628c0a0bfce tempest-FlavorsExtraSpecsTestJSON-1471899847 tempest-FlavorsExtraSpecsTestJSON-1471899847-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042331 Aug 30 17:26:03.248782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.255881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:03.257351 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 101/191] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:03.369312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.371944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:03.383820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.384680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.386044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.387033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.387754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.388884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.396544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:03.526129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:03.536453 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57ee09b0-fa7d-44b5-bc6d-7acac44f48ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.315086 Aug 30 17:26:03.550875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 91/192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:03.556707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:03.557559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:03.564198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.564958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.566285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.567207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:03.567901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:03.568540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:03.636225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:03.658807 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1890f260-a1a4-433a-9c71-7ea6e18a6b7c tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.289879 Aug 30 17:26:03.663522 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 102/193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:03.762449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:03.771538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4197b96b-caca-44e6-9faf-ae06b9054ce5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.219049 Aug 30 17:26:03.772403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 92/194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:03 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:04.332698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2f5c13-81c0-4a2c-8cd0-89848289bcea", "name": "network-vif-plugged", "status": "completed", "tag": "62c5175e-098a-4da3-a54c-c717ca48c47e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:04.353162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.353669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.354125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.383065 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] Creating event network-vif-plugged:62c5175e-098a-4da3-a54c-c717ca48c47e for instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea on n-h2-852771-11 Aug 30 17:26:04.391608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-337670e8-b0a4-4fd7-8905-7432085e6b4e req-f314a8d7-5e12-4f24-8797-ae12cfea4d03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422626 Aug 30 17:26:04.400728 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 103/195] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:04.565440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:04.567396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:04.580474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.581939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.584014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.584937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.585975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.587649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.693176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:04.693927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:04.715140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.716241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.716907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.719600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.721791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.723951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.899408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:04.919073 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ee8e2cc-6f79-4185-8f32-ef8ea7933d0e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.349982 Aug 30 17:26:04.921260 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 93/196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:04 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:04.929415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:04.930030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:04.973763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.976032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.978060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.980581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.981220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.982096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.161069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:05.173322 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b5c74c7-78e5-4c69-be3f-3230938f574f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.494496 Aug 30 17:26:05.174733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 104/197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:04 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:05.324171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:05.331975 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b89fea84-c746-44ce-8439-cd8654320ab5 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.409523 Aug 30 17:26:05.335727 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 94/198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:04 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:05.340523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6d18d0-d124-4dfe-8944-4c0e5c108233", "tag": "d112f095-dee2-4256-99fc-5ec3124c0a66"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:05.364669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.365430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.375561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.391094 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Creating event network-changed:d112f095-dee2-4256-99fc-5ec3124c0a66 for instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 on n-h1-852771-11 Aug 30 17:26:05.406871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068950 Aug 30 17:26:05.407800 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 95/199] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.409228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.413139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f60f4ae7-6dd1-42c7-915b-b61b459f8c9a req-0e6bf6cc-eb06-44a0-90b4-e7997c355572 service nova] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004328 Aug 30 17:26:05.413685 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 96/200] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 17:26:05.514724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d99624af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.520776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.524465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.526004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.556905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.558643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.559301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.576819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.577613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.578273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.590495 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00b83821-473f-489f-ae39-27312e83184f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.413729 Aug 30 17:26:05.591288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 105/201] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.605198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d994990d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.607529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.607529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.608281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.653221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.658598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.659290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.690059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.691918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.694947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.706457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6f97790-6873-4140-ac92-3e565c0c5fe0 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.106492 Aug 30 17:26:05.707743 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 97/202] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:05.725873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d99624550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.729007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.729747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.730859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.756603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.757337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.762578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.780577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.781347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.783717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.791970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44b71d8c-f850-4816-862c-6446c8078032 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.070626 Aug 30 17:26:05.794549 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 106/203] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.805494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d99499ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.807956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.808667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.809597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.836469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.837607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.838313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.846884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4284fbbc-9bb2-4ae9-8f1a-ed4b5162167f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.045787 Aug 30 17:26:05.849086 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 98/204] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.864289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5428c55b-6121-4d4d-9560-47b475084516 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d996561f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.866275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5428c55b-6121-4d4d-9560-47b475084516 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.866961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5428c55b-6121-4d4d-9560-47b475084516 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.867893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5428c55b-6121-4d4d-9560-47b475084516 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.890929 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5428c55b-6121-4d4d-9560-47b475084516 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.031579 Aug 30 17:26:05.891747 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 107/205] 10.222.0.50 () {58 vars in 1179 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.907237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d994993a0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.909113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.909795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.910671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.924764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.925478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.925930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.937834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.938318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.939120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.941592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.942470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:05.947864 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10d57ae9-c212-4dc3-aa1b-9a141b228f3f tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.047090 Aug 30 17:26:05.950021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.951529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.951920 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 99/206] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:05.952400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.953168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.953814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.954305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.959782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d9970e700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:05.961763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.962275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.962715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.981947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:05.982488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:05.982926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:05.991756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfe539bf-fd1d-40ff-8b4b-eade9ffcca26 tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036163 Aug 30 17:26:05.995775 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 100/207] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:06.011304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d99499c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:06.020152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.020870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.021317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.034805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.035384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.036084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.046465 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc996474-dd1d-4aa9-a9b6-62f5410cf5cc tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.042655 Aug 30 17:26:06.047212 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 101/208] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:06 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:06.073694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Calling method '.version_select at 0x7f2d99499af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:06.075446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.075973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.076455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.096041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.103832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.104509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.117072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.117834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.118446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.153931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50b5a649-a5a0-4a2a-af9d-939ae545b6cf tempest-HypervisorAdminTestJSON-160389817 tempest-HypervisorAdminTestJSON-160389817-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.083577 Aug 30 17:26:06.154676 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 102/209] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:26:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:06.172594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:06.180623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c109d6f0-2ca2-4734-9cd7-910c08ef752a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.243139 Aug 30 17:26:06.181201 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 108/210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:05 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:06.200945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:06.202227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:06.211677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.212288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.212734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.213622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.214037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.214465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.356902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:06.357795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:06.367304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.367897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.368430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.369218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:06.369740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:06.370408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:06.420090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:06.430370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5600ba25-2197-45f9-a89d-9de5107accc9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1340 microversion: 2.1 time: 0.239586 Aug 30 17:26:06.431988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 103/211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:06 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1340 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:06.558059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:06.565761 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-200e8a85-1cec-4693-87ba-2992cf59ddc9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.215250 Aug 30 17:26:06.568619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 109/212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:06 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:07.202232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:07.202836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:07.211570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.213717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.215965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.218928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.219943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.220745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.232437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273f80fe-bc1d-4d13-b4fd-46d07c7951d8", "name": "network-vif-plugged", "status": "completed", "tag": "52934096-f023-4397-bec9-7f2c83105596"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:07.238178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:07.264029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.264904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.265566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.289706 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] Creating event network-vif-plugged:52934096-f023-4397-bec9-7f2c83105596 for instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 on n-h2-852771-11 Aug 30 17:26:07.310450 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f2a2cd73-28b8-46d8-99e4-1a2a970dba29 req-06365b49-6913-4ff9-bac5-47eec5395703 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080891 Aug 30 17:26:07.313224 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 110/213] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:07.454967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:07.456163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:07.465499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.466967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.473005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.474381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.479874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.481683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.719038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:07.728608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1ca6b77-70c2-4e4b-81dc-add6b9dffade tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1489 microversion: 2.1 time: 0.278635 Aug 30 17:26:07.729956 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 111/214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:07 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1489 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:07.735294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:07.736203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:07.743527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.744313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.744863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.746036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:07.746949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:07.747687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:07.822316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:07.840408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-475d171b-33c9-4bcc-a3f1-607720447ce4 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.641611 Aug 30 17:26:07.841542 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 104/215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:07 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:07.921631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:07.931344 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8437390e-ded2-42d5-b499-890f032d4cd9 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1338 microversion: 2.1 time: 0.200019 Aug 30 17:26:07.940772 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 112/216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:07 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1338 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:08.118515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f6b9ec9-b5d2-4cfc-bb8d-0acb41af41c1 tempest-InstanceUsageAuditLogTestJSON-1935507174 tempest-InstanceUsageAuditLogTestJSON-1935507174-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.188484 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f6b9ec9-b5d2-4cfc-bb8d-0acb41af41c1 tempest-InstanceUsageAuditLogTestJSON-1935507174 tempest-InstanceUsageAuditLogTestJSON-1935507174-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 17:26:07" status: 200 len: 318 microversion: 2.1 time: 0.345639 Aug 30 17:26:08.189305 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 105/217] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:26:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2017%3A26%3A07 => generated 318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:08.206857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de63ada0-ed9a-4e55-abca-64e52326e7bf tempest-InstanceUsageAuditLogTestJSON-1935507174 tempest-InstanceUsageAuditLogTestJSON-1935507174-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.234489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de63ada0-ed9a-4e55-abca-64e52326e7bf tempest-InstanceUsageAuditLogTestJSON-1935507174 tempest-InstanceUsageAuditLogTestJSON-1935507174-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.031074 Aug 30 17:26:08.235301 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 106/218] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:26:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:08.373148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.373651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:08.393621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.395111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.396630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.398315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.399624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.400129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.556237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:26:08.711078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1081dcc4-4ace-4bd5-9ca5-2e3d97970278 tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 204 len: 0 microversion: 2.1 time: 0.761743 Aug 30 17:26:08.715367 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 113/219] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:07 2022] DELETE /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:08.720975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.721589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:08.731764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.733716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.734943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.735750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.736191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.736619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.863925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.865799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:08.873127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.873915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.874972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.876179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.876787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.877400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.898034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:08.908800 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db12c6c9-0c86-4175-bfd6-89f8fbe0e5c9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1495 microversion: 2.1 time: 0.190970 Aug 30 17:26:08.909534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 107/220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:08 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1495 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:08.959114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:08.960139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:08.969928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.970797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.971572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:08.972514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:08.977894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:08.979217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.039355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:09.051588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe2b9fc3-b471-40e4-a986-c81fc21fdf1a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.190382 Aug 30 17:26:09.052786 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 114/221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:08 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:09.143442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:09.151698 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c1d3987-8b71-4ec5-9e83-4eae46428247 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1487 microversion: 2.1 time: 0.200434 Aug 30 17:26:09.152282 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 108/222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:08 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1487 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:09.173328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:09.173930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:09.181994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.182981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.183660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.184919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.185571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.186351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.500481 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-deb9ec53-f641-4a38-9ff1-a3b5df53cba4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1640 microversion: 2.1 time: 0.329545 Aug 30 17:26:09.501156 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 115/223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:09 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1640 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:09.525216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:09.526493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:09.536866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.537524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.538024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.538893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.539697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.543610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.576992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:26:09.711548 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4793bd4-075f-4fc1-9ab4-4487f0788f63 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "DELETE /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 204 len: 0 microversion: 2.1 time: 0.190852 Aug 30 17:26:09.712370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 109/224] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:09 2022] DELETE /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:09.720766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:09.721747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:09.728009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.728548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.729202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.730368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.731186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.731815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.913916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:09.917698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:09.924040 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3cda96e-3e0c-4839-a4eb-bac753e2a783 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1493 microversion: 2.1 time: 0.206882 Aug 30 17:26:09.924629 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 110/225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:09 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1493 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:09.929865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:09.930713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:09.940556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:09.944689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.945177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.945602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.946294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:09.946737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:09.947336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:09.996525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-da82f6dc-8cbb-4526-9abe-185426c38463 tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1692500018", "id": 1600370175, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:10.028447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-da82f6dc-8cbb-4526-9abe-185426c38463 tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.346618 Aug 30 17:26:10.029544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 116/226] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:26:09 2022] POST /compute/v2.1/flavors => generated 468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:26:10.143398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:10.158995 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-301ecf0b-9fb2-4205-9460-74e4748ddb83 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1495 microversion: 2.1 time: 0.230856 Aug 30 17:26:10.162267 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 111/227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:09 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1495 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:10.169946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.176515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:10.189456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:10.190221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:10.191732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:10.193282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:10.194442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:10.194960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:10.307017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1c24a8c-b8ea-417e-83dc-55b50bcc852e tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.319079 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1c24a8c-b8ea-417e-83dc-55b50bcc852e tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] 10.222.0.50 "GET /compute/v2.1/flavors/1600370175" status: 200 len: 468 microversion: 2.61 time: 0.280672 Aug 30 17:26:10.320397 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 117/228] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/flavors/1600370175 => generated 468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:10.338283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b29db6e-29ba-4ff0-b36f-190075e8409f tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9a85ea60>, body: {"flavor": {"description": "new"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:10.600450 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b29db6e-29ba-4ff0-b36f-190075e8409f tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1600370175" status: 200 len: 469 microversion: 2.61 time: 0.270384 Aug 30 17:26:10.600890 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 118/229] 10.222.0.50 () {62 vars in 1219 bytes} [Tue Aug 30 17:26:10 2022] PUT /compute/v2.1/flavors/1600370175 => generated 469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:10.619573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a3c92d7-b3af-447b-a72f-843497403611 tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.656777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a3c92d7-b3af-447b-a72f-843497403611 tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.046266 Aug 30 17:26:10.658091 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 119/230] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:26:10.669730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:10.683338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3a00c646-4094-41e8-afa0-51a3c0f7184c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.518681 Aug 30 17:26:10.684515 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 112/231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:10.686734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f233dff-a3a0-4143-bb01-35728b4cfee0 tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.707133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:10.715853 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f233dff-a3a0-4143-bb01-35728b4cfee0 tempest-FlavorsV261TestJSON-8724867 tempest-FlavorsV261TestJSON-8724867-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.038944 Aug 30 17:26:10.716474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 120/232] 10.222.0.50 () {60 vars in 1166 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:10.734051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eef6d67d-2961-4de1-ae45-f8be80aacddc tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.756856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eef6d67d-2961-4de1-ae45-f8be80aacddc tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1600370175" status: 202 len: 0 microversion: 2.61 time: 0.026555 Aug 30 17:26:10.758823 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 113/233] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 30 17:26:10 2022] DELETE /compute/v2.1/flavors/1600370175 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:10.767289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9681636e-d7d4-48b1-b0cd-dce22f31f126 tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.794360 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9681636e-d7d4-48b1-b0cd-dce22f31f126 tempest-FlavorsV261TestJSON-2087899466 tempest-FlavorsV261TestJSON-2087899466-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.031467 Aug 30 17:26:10.810605 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 121/234] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:10.946437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:10.947039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:10.952816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:10.953523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:10.954300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:10.954985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:10.955431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:10.955896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.150787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:11.162342 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da549d8d-d36f-43d6-8881-8a5b296788cd tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1493 microversion: 2.1 time: 0.219697 Aug 30 17:26:11.163529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 114/235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:10 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:11.184513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:11.185126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:11.203902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:11.204387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:11.204819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.205521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:11.207576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:11.210940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.525030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:11.534328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-59a3cf76-b6a7-4eca-afff-47d3eff4ab3f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1495 microversion: 2.1 time: 0.355254 Aug 30 17:26:11.548319 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 122/236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:11 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1495 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:11.707140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:11.708370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:11.719114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:11.721057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:11.721718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.722656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:11.723289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:11.724940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.843022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2f5c13-81c0-4a2c-8cd0-89848289bcea", "name": "network-vif-deleted", "tag": "62c5175e-098a-4da3-a54c-c717ca48c47e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:11.862030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:11.862814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:11.863860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:11.890338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] Creating event network-vif-deleted:62c5175e-098a-4da3-a54c-c717ca48c47e for instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea on n-h2-852771-11 Aug 30 17:26:11.921222 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-605b0fe9-5ff2-4e6a-81fa-b7a6e241d437 req-90472936-ff88-4a15-85cd-6bff8e2ff961 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079998 Aug 30 17:26:11.936607 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 123/237] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:12.070388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.082517 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93458445-c4d1-4671-a8cc-28eb6d9b4040 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.380000 Aug 30 17:26:12.089381 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 115/238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:11 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:12.188350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:12.194076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.194920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:12.207302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.207870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.208504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.209415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.210451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.211189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.401877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05cd2cdb96774fdebb778c45138d4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea2e7a96c7400c8855914c665c6cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.416203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-580947b1-7f3d-4345-91e3-a4524f6f6b3e tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 200 len: 1451 microversion: 2.1 time: 0.228445 Aug 30 17:26:12.419195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 124/239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:12.435995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273f80fe-bc1d-4d13-b4fd-46d07c7951d8", "name": "network-vif-deleted", "tag": "52934096-f023-4397-bec9-7f2c83105596"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:12.451881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.455371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.457115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.488184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] Creating event network-vif-deleted:52934096-f023-4397-bec9-7f2c83105596 for instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 on n-h2-852771-11 Aug 30 17:26:12.502116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ddb1fd82-6228-48d7-988a-6e4f411666d2 req-6a8438db-ff03-4865-a49a-9e29f45b11a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079856 Aug 30 17:26:12.508827 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 125/240] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:12.562640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7fb4995f-452f-4873-8c98-d5ea005c8dd1 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Calling method '.version_select at 0x7f2d9939f310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.567593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7fb4995f-452f-4873-8c98-d5ea005c8dd1 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b83f9c5429e64141a37c632a6e349158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802a72cbbdd4f939078302ef0be4131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7fb4995f-452f-4873-8c98-d5ea005c8dd1 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Request method failure captured: Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgyewEa8DSjYh-I1002-SOZsYljx5inh5N2WTqtWqf6jOZrQ0I9uny6-c_GGtoAn2aN1UBlukzY5bFqNKVD-CiKdIVTt0dkEJ8uu76fZfVwQCMSRvM38FmC8sEK4bvwuGbK78h1pDLf-1NDCNL44muH_hHtzmlXGgbK3_qJOjipq6U Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:12.574161 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f802a72cbbdd4f939078302ef0be4131"}]}] Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b83f9c5429e64141a37c632a6e349158 Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:26:12.575696 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:12.576449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 17:26:12.578941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.580388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7fb4995f-452f-4873-8c98-d5ea005c8dd1 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:12.587020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7fb4995f-452f-4873-8c98-d5ea005c8dd1 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.392539 Aug 30 17:26:12.602214 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 116/241] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 415 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:12.610490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.611407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:12.625413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.625891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.626497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.627346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.627991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.629123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.655943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Calling method '.version_select at 0x7f2d995d7ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.659197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.662885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.664714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.697632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.698119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.698553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.699020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lazy-loading 'fault' on Instance uuid 2f2f5c13-81c0-4a2c-8cd0-89848289bcea {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:12.700151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.705583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.706037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.725582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:12.754710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.756077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.763186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.776613 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4c598ee-4e2b-44d6-bd0b-d5a8a90ea05a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.262500 Aug 30 17:26:12.778492 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 126/242] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:12.793350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.795357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35d56f17-82bd-4c45-b4e5-11331245d158 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Calling method '.version_select at 0x7f2d9a359790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.804627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-35d56f17-82bd-4c45-b4e5-11331245d158 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b83f9c5429e64141a37c632a6e349158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802a72cbbdd4f939078302ef0be4131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35d56f17-82bd-4c45-b4e5-11331245d158 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Request method failure captured: Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgyewEa8DSjYh-I1002-SOZsYljx5inh5N2WTqtWqf6jOZrQ0I9uny6-c_GGtoAn2aN1UBlukzY5bFqNKVD-CiKdIVTt0dkEJ8uu76fZfVwQCMSRvM38FmC8sEK4bvwuGbK78h1pDLf-1NDCNL44muH_hHtzmlXGgbK3_qJOjipq6U Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:12.807366 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f802a72cbbdd4f939078302ef0be4131"}]}] Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b83f9c5429e64141a37c632a6e349158 Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:26:12.808643 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:12.809443 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 17:26:12.810520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.812220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35d56f17-82bd-4c45-b4e5-11331245d158 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:12.812965 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-120661ea-32c6-4ea7-bb5d-308de6ca00fd tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 200 len: 1330 microversion: 2.1 time: 0.204384 Aug 30 17:26:12.814564 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 117/243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 1330 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:12.816785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35d56f17-82bd-4c45-b4e5-11331245d158 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.037091 Aug 30 17:26:12.823314 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 127/244] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:12.833456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Calling method '.version_select at 0x7f2d99656940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.834503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6d18d0-d124-4dfe-8944-4c0e5c108233", "name": "network-vif-plugged", "status": "completed", "tag": "d112f095-dee2-4256-99fc-5ec3124c0a66"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:12.835813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.836510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.837267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.855300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.855872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.856304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.861904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.863424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.864064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.871108 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] Creating event network-vif-plugged:d112f095-dee2-4256-99fc-5ec3124c0a66 for instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 on n-h1-852771-11 Aug 30 17:26:12.878916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0c2811b9-6a24-41cb-be3a-d898e7bfe681 req-e01464b6-98f0-433f-9e0e-680741bbb433 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059990 Aug 30 17:26:12.879850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 118/245] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:12.885285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ede64ad8-a129-4db0-b270-3dcdbb0631a0 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Calling method '.version_select at 0x7f2d9939f310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.887057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ede64ad8-a129-4db0-b270-3dcdbb0631a0 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b83f9c5429e64141a37c632a6e349158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802a72cbbdd4f939078302ef0be4131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ede64ad8-a129-4db0-b270-3dcdbb0631a0 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Request method failure captured: Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgyewEa8DSjYh-I1002-SOZsYljx5inh5N2WTqtWqf6jOZrQ0I9uny6-c_GGtoAn2aN1UBlukzY5bFqNKVD-CiKdIVTt0dkEJ8uu76fZfVwQCMSRvM38FmC8sEK4bvwuGbK78h1pDLf-1NDCNL44muH_hHtzmlXGgbK3_qJOjipq6U Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:12.889114 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f802a72cbbdd4f939078302ef0be4131"}]}] Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b83f9c5429e64141a37c632a6e349158 Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:26:12.890561 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:12.891263 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 17:26:12.892416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:12.893311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ede64ad8-a129-4db0-b270-3dcdbb0631a0 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:12.893311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ede64ad8-a129-4db0-b270-3dcdbb0631a0 tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009564 Aug 30 17:26:12.897583 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 119/246] 10.222.0.50 () {58 vars in 1179 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:12.922678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.923175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.923713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.934501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab4684fa-7877-422f-99da-f9fb4ece610a tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852771-11/servers" status: 200 len: 197 microversion: 2.1 time: 0.109638 Aug 30 17:26:12.935568 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 128/247] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-11/servers => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:12.949228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Calling method '.version_select at 0x7f2d996564c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:12.951028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.952036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.952891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:12.979978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:12.980694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:12.981195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.012216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.015525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.016108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.026253 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89435219-81ce-4cd3-b3fd-51040ba78371 tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.080973 Aug 30 17:26:13.027439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 129/248] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:13.037848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Calling method '.version_select at 0x7f2d998318b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.039577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.040513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.041138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.057757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.058086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.058655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.065637 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5663f325-d253-4a05-9d8c-44a8210a5a9b tempest-HypervisorAdminUnderV252Test-1755713040 tempest-HypervisorAdminUnderV252Test-1755713040-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852771-11/search" status: 200 len: 105 microversion: 2.1 time: 0.031713 Aug 30 17:26:13.067504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 130/249] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-11/search => generated 105 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:13.107796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.108539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:13.115506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.116292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.116902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.117805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.118257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.118674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.197190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Calling method '.version_select at 0x7f2d99499700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.199127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.199980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.200423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.225660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.226476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.226964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.241522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.242691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.243775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.252824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-918684f3-977c-4ab4-9031-cd3bbaa62825 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.354137 Aug 30 17:26:13.261788 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 120/250] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:13.272753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec8117dd-3b03-4c18-944e-a39d8343897a tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Calling method '.version_select at 0x7f2d9944fc10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.275906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec8117dd-3b03-4c18-944e-a39d8343897a tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b83f9c5429e64141a37c632a6e349158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802a72cbbdd4f939078302ef0be4131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec8117dd-3b03-4c18-944e-a39d8343897a tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Request method failure captured: Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgyewEa8DSjYh-I1002-SOZsYljx5inh5N2WTqtWqf6jOZrQ0I9uny6-c_GGtoAn2aN1UBlukzY5bFqNKVD-CiKdIVTt0dkEJ8uu76fZfVwQCMSRvM38FmC8sEK4bvwuGbK78h1pDLf-1NDCNL44muH_hHtzmlXGgbK3_qJOjipq6U Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:13.278047 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f802a72cbbdd4f939078302ef0be4131"}]}] Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b83f9c5429e64141a37c632a6e349158 Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1'} Aug 30 17:26:13.279177 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:13.279902 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 17:26:13.280926 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.283549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec8117dd-3b03-4c18-944e-a39d8343897a tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.284649 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec8117dd-3b03-4c18-944e-a39d8343897a tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.020853 Aug 30 17:26:13.285526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 121/251] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.296492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ccb5382a-2ce1-438b-960e-7903fe917c54 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Calling method '.version_select at 0x7f2d99302ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.298966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ccb5382a-2ce1-438b-960e-7903fe917c54 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] HTTP exception thrown: Hypervisor with ID '894710e4-a799-4ca8-a752-44fc7bd63b88' could not be found. Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ccb5382a-2ce1-438b-960e-7903fe917c54 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Request method failure captured: Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/894710e4-a799-4ca8-a752-44fc7bd63b88/uptime HTTP/1.1 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkg0xhfzbfxXut9CRg6ZQjrhZDFN4U-piklQc7-A9pDbc1aJHGsD9BhPVrTZs-hIL0Eb92bIlpwZeBDZIIs90yA3-h6DtesESFopE9I0oXgvzmUXo2wGiWT322edbw9RYWy2H6MuCB_V0jaO_jqw7QnD_EfKYHLK2Ws25Jtw956ktBU Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2010bcd996af4dff9aee754c44ee49f8 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:13.309309 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2010bcd996af4dff9aee754c44ee49f8"}]}] Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2010bcd996af4dff9aee754c44ee49f8 Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4d27113cd8ee4f099f67fb048391a32b Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: exception: Hypervisor with ID '894710e4-a799-4ca8-a752-44fc7bd63b88' could not be found. Aug 30 17:26:13.310796 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '894710e4-a799-4ca8-a752-44fc7bd63b88'} Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '894710e4-a799-4ca8-a752-44fc7bd63b88' Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 17:26:13.311739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '894710e4-a799-4ca8-a752-44fc7bd63b88' could not be found. Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.313207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '894710e4-a799-4ca8-a752-44fc7bd63b88' could not be found. Aug 30 17:26:13.314561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.315285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ccb5382a-2ce1-438b-960e-7903fe917c54 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Returning 404 to user: Hypervisor with ID '894710e4-a799-4ca8-a752-44fc7bd63b88' could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.317109 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ccb5382a-2ce1-438b-960e-7903fe917c54 tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/894710e4-a799-4ca8-a752-44fc7bd63b88/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025032 Aug 30 17:26:13.324137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 122/252] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors/894710e4-a799-4ca8-a752-44fc7bd63b88/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.333148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Calling method '.version_select at 0x7f2d99302f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.336011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.336497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.336963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.366901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.367839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.368298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.397312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.397835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.398372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.418101 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2c085f5-ec10-473f-981b-3662ed91babb tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.089966 Aug 30 17:26:13.427892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:13.428665 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 123/253] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:13.437893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02782550-bee2-4f54-8c22-5de8185099fc tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Calling method '.version_select at 0x7f2d993725e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.439860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02782550-bee2-4f54-8c22-5de8185099fc tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b83f9c5429e64141a37c632a6e349158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802a72cbbdd4f939078302ef0be4131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:13.441514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ce50409-7c1b-4e7e-a67e-c0c059a6e850 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.340446 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02782550-bee2-4f54-8c22-5de8185099fc tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Request method failure captured: Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgyewEa8DSjYh-I1002-SOZsYljx5inh5N2WTqtWqf6jOZrQ0I9uny6-c_GGtoAn2aN1UBlukzY5bFqNKVD-CiKdIVTt0dkEJ8uu76fZfVwQCMSRvM38FmC8sEK4bvwuGbK78h1pDLf-1NDCNL44muH_hHtzmlXGgbK3_qJOjipq6U Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:13.441855 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f802a72cbbdd4f939078302ef0be4131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f802a72cbbdd4f939078302ef0be4131"}]}] Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f802a72cbbdd4f939078302ef0be4131 Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215 Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b83f9c5429e64141a37c632a6e349158 Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141388215-project Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1'} Aug 30 17:26:13.443198 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:13.443971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 17:26:13.444972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.446009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02782550-bee2-4f54-8c22-5de8185099fc tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.446009 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02782550-bee2-4f54-8c22-5de8185099fc tempest-HypervisorAdminNegativeTestJSON-2141388215 tempest-HypervisorAdminNegativeTestJSON-2141388215-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014278 Aug 30 17:26:13.459647 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 124/254] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.460762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 131/255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:13.464118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.464867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:13.469088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c45d446f-dbee-40d4-8f6c-b066980bddca tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Calling method '.version_select at 0x7f2d99624b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.471393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c45d446f-dbee-40d4-8f6c-b066980bddca tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] HTTP exception thrown: Hypervisor with ID '9747ca1d-3838-42fa-ad61-7e4205a1e273' could not be found. Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c45d446f-dbee-40d4-8f6c-b066980bddca tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Request method failure captured: Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hypervisors/9747ca1d-3838-42fa-ad61-7e4205a1e273 HTTP/1.1 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkg0xhfzbfxXut9CRg6ZQjrhZDFN4U-piklQc7-A9pDbc1aJHGsD9BhPVrTZs-hIL0Eb92bIlpwZeBDZIIs90yA3-h6DtesESFopE9I0oXgvzmUXo2wGiWT322edbw9RYWy2H6MuCB_V0jaO_jqw7QnD_EfKYHLK2Ws25Jtw956ktBU Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2010bcd996af4dff9aee754c44ee49f8 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:13.474589 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2010bcd996af4dff9aee754c44ee49f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2010bcd996af4dff9aee754c44ee49f8"}]}] Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2010bcd996af4dff9aee754c44ee49f8 Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855 Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4d27113cd8ee4f099f67fb048391a32b Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: exception: Hypervisor with ID '9747ca1d-3838-42fa-ad61-7e4205a1e273' could not be found. Aug 30 17:26:13.476058 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9747ca1d-3838-42fa-ad61-7e4205a1e273'} Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9747ca1d-3838-42fa-ad61-7e4205a1e273' Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 17:26:13.476714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:26:13.477914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9747ca1d-3838-42fa-ad61-7e4205a1e273' could not be found. Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9747ca1d-3838-42fa-ad61-7e4205a1e273' could not be found. Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.479816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c45d446f-dbee-40d4-8f6c-b066980bddca tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] Returning 404 to user: Hypervisor with ID '9747ca1d-3838-42fa-ad61-7e4205a1e273' could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.486376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.486462 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c45d446f-dbee-40d4-8f6c-b066980bddca tempest-HypervisorAdminNegativeTestJSON-1896341855 tempest-HypervisorAdminNegativeTestJSON-1896341855-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/9747ca1d-3838-42fa-ad61-7e4205a1e273" status: 404 len: 123 microversion: 2.1 time: 0.016493 Aug 30 17:26:13.486535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.486535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.486535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.486860 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 132/256] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/os-hypervisors/9747ca1d-3838-42fa-ad61-7e4205a1e273 => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.487021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.487021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.514324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] HTTP exception thrown: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Request method failure captured: Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 HTTP/1.1 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSohkzwjrqnwkMbcLoze9Eath5PvVjDhZcAhYJKIpnlMKoxcupOaV4eLoCHecSUpf4YdOwO226-sI7zssMKOM75ZVvJJhgb4IfYaPdPxKZb0bd3dTd26FEnwdxcWyC09kIn3Vw2cJTCvsQoqd5J1Ac-C-ODMNJSe3OFObQjST_HW4 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:13.516153 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_05ea2e7a96c7400c8855914c665c6cea"}]}] Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 05cd2cdb96774fdebb778c45138d4032 Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:13.517575 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '273f80fe-bc1d-4d13-b4fd-46d07c7951d8'} Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.518314 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:13.520122 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.522956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Returning 404 to user: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.522956 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1969c231-79e1-4778-8f0f-091441b62ee1 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 404 len: 111 microversion: 2.1 time: 0.065102 Aug 30 17:26:13.522956 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 125/257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.530924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7907b53-2398-4276-a0f3-187fcc58cd1d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:13.550188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7907b53-2398-4276-a0f3-187fcc58cd1d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.550791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7907b53-2398-4276-a0f3-187fcc58cd1d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.552955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7907b53-2398-4276-a0f3-187fcc58cd1d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.730561 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7907b53-2398-4276-a0f3-187fcc58cd1d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 298 microversion: 2.1 time: 0.205890 Aug 30 17:26:13.731859 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 133/258] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:26:13 2022] POST /compute/v2.1/os-aggregates/4/action => generated 298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:13.744067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-881f9796-0a46-4856-9a1a-fb2c4b7a2fa8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.788327 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-881f9796-0a46-4856-9a1a-fb2c4b7a2fa8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.048706 Aug 30 17:26:13.789890 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 126/259] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:13 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:13.825413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ce26bc9-1ec1-4afb-9b65-98ff781e2c6a tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-14666889"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:13.837808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-2ce26bc9-1ec1-4afb-9b65-98ff781e2c6a tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid fba5ac1d-ed02-4b73-a7c0-0b29d1c7be4b for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:13.837939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:13.838554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:13.854451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.854951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.855385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.856468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.859706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.862011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:13.884889 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ce26bc9-1ec1-4afb-9b65-98ff781e2c6a tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.083861 Aug 30 17:26:13.885508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 134/260] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:13 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:13.891615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea HTTP/1.1 Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:13.895866 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:13.897066 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2f2f5c13-81c0-4a2c-8cd0-89848289bcea'} Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:13.897748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:13.898800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:13.900976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ca52f467-12c9-488d-9af4-47073a5aef39 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:13.903845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:13.905310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ba63b65-d984-452e-b33c-db4967737838 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 404 len: 111 microversion: 2.1 time: 0.072180 Aug 30 17:26:13.906376 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 127/261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:13 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:13.922191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca52f467-12c9-488d-9af4-47073a5aef39 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:13.922848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca52f467-12c9-488d-9af4-47073a5aef39 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:13.923971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca52f467-12c9-488d-9af4-47073a5aef39 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.080178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ca52f467-12c9-488d-9af4-47073a5aef39 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.187266 Aug 30 17:26:14.080949 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 135/262] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:26:13 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:14.093199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0aeb1c8-9f95-4a0c-832e-2ecfc1024cac tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:14.110416 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0aeb1c8-9f95-4a0c-832e-2ecfc1024cac tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.021460 Aug 30 17:26:14.113657 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 128/263] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:26:14 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:14.124930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54577e72-5330-42c1-b59a-3102b02f6d93 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:14.137303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54577e72-5330-42c1-b59a-3102b02f6d93 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.137937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54577e72-5330-42c1-b59a-3102b02f6d93 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.138368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54577e72-5330-42c1-b59a-3102b02f6d93 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.212729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1116460387", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:14.324098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:26:14.330492 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54577e72-5330-42c1-b59a-3102b02f6d93 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 225 microversion: 2.1 time: 0.209678 Aug 30 17:26:14.331099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 136/264] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 30 17:26:14 2022] POST /compute/v2.1/os-aggregates/9/action => generated 225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:14.346185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-360961a1-6778-464e-874d-b496d1c491ea tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:14.375870 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-360961a1-6778-464e-874d-b496d1c491ea tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.036679 Aug 30 17:26:14.376456 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 137/265] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:14 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 17:26:14.390081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70ff73ca-66d5-4faf-831e-8baadd772348 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1947152874"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:14.393852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.aggregate [None req-70ff73ca-66d5-4faf-831e-8baadd772348 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid f2213577-cdfb-426e-b4a6-901463d69034 for aggregate {{(pid=122123) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:14.426239 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70ff73ca-66d5-4faf-831e-8baadd772348 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039711 Aug 30 17:26:14.433830 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 138/266] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:14.442127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-587de39a-3e6f-4361-9374-be72ea2279db tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:14.455400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-587de39a-3e6f-4361-9374-be72ea2279db tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.457523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-587de39a-3e6f-4361-9374-be72ea2279db tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.458196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-587de39a-3e6f-4361-9374-be72ea2279db tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.603102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:26:14.603771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:26:14.605162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:26:14.605787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:26:14.606816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:26:14.619239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.619996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.620500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.621723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.622388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.622909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.625126 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-587de39a-3e6f-4361-9374-be72ea2279db tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.188248 Aug 30 17:26:14.625872 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 139/267] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:14 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:14.635192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:14.635823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:14.643409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Getting quotas for project c57f407e4b684ddf89dd95b5b61d2acd. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:26:14.648519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.649007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.649320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Getting quotas for user e4d2bbe9b4cd437492ae4bae3a4e335c and project c57f407e4b684ddf89dd95b5b61d2acd. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:26:14.649424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.651499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.651954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.652380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:14.675850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:26:14.678703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:26:14.754727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bdab6ea7-5022-466d-ac11-1818c0ae8377 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540388 Aug 30 17:26:14.755750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 129/268] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:26:14.761736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9cfd279-9693-4e4d-8783-6a630fe6b9fc tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:14.773128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9cfd279-9693-4e4d-8783-6a630fe6b9fc tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.1 time: 0.016093 Aug 30 17:26:14.773990 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 130/269] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:26:14 2022] GET /compute/v2.1/os-aggregates => generated 247 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:14.787427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-333c01d1-6859-4030-8fe2-5824b97501aa tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:14.788225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-333c01d1-6859-4030-8fe2-5824b97501aa tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:14.872735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-333c01d1-6859-4030-8fe2-5824b97501aa tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:14.885078 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-333c01d1-6859-4030-8fe2-5824b97501aa tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1220 microversion: 2.1 time: 0.109882 Aug 30 17:26:14.899889 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 131/270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:14 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:14.899889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af2d0c8f-0244-4e7c-b7aa-2893dc35413f tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:14.931996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af2d0c8f-0244-4e7c-b7aa-2893dc35413f tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:14.933001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af2d0c8f-0244-4e7c-b7aa-2893dc35413f tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:14.933778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af2d0c8f-0244-4e7c-b7aa-2893dc35413f tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:15.156456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af2d0c8f-0244-4e7c-b7aa-2893dc35413f tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.266108 Aug 30 17:26:15.157057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 132/271] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:14 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:15.189643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33cdfd17-0b15-4644-8df0-cdf9d2c32fd3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:15.229562 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-33cdfd17-0b15-4644-8df0-cdf9d2c32fd3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.055106 Aug 30 17:26:15.231750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 133/272] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:15 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:15.244649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29dc0284-355b-4ef7-85d3-507a9da08a40 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-96056612"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:15.254473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-29dc0284-355b-4ef7-85d3-507a9da08a40 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid b624cf9a-3534-4a59-8046-0fd494593527 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:15.258378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:15.270408 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5192f516-4ff3-4cad-93e5-55bb1d57568c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1319 microversion: 2.1 time: 0.639924 Aug 30 17:26:15.286246 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 140/273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:14 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1319 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:15.317846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29dc0284-355b-4ef7-85d3-507a9da08a40 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076830 Aug 30 17:26:15.318875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 134/274] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:15.330441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efa46901-ba8e-4d90-ad7c-4b7f7d5752b4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:15.356368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efa46901-ba8e-4d90-ad7c-4b7f7d5752b4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:15.356853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efa46901-ba8e-4d90-ad7c-4b7f7d5752b4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:15.357285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efa46901-ba8e-4d90-ad7c-4b7f7d5752b4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:15.591275 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-efa46901-ba8e-4d90-ad7c-4b7f7d5752b4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.264841 Aug 30 17:26:15.592898 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 141/275] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:15 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:15.604751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-caf3b3fe-925a-4f7d-bf69-09603d222f2e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:15.617785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-caf3b3fe-925a-4f7d-bf69-09603d222f2e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:15.618353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-caf3b3fe-925a-4f7d-bf69-09603d222f2e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:15.619203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-caf3b3fe-925a-4f7d-bf69-09603d222f2e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:15.786976 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-caf3b3fe-925a-4f7d-bf69-09603d222f2e tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 226 microversion: 2.1 time: 0.185728 Aug 30 17:26:15.788474 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 135/276] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:15 2022] POST /compute/v2.1/os-aggregates/11/action => generated 226 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:15.799576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-429aaa67-4f93-4a4e-8619-f39c12253677 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:15.849313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-429aaa67-4f93-4a4e-8619-f39c12253677 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.053472 Aug 30 17:26:15.850201 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 142/277] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:15 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 17:26:15.873098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2fa52152-a5f4-4dd9-a9d3-1919cae3b31b tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-700153779"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:15.882997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-2fa52152-a5f4-4dd9-a9d3-1919cae3b31b tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 3cffdee4-5c4a-4b3d-9b89-e7301bf7cd34 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:15.910364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:15.910977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:15.923376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:15.923890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:15.928834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:15.929840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:15.930248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2fa52152-a5f4-4dd9-a9d3-1919cae3b31b tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072468 Aug 30 17:26:15.937136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:15.937136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:15.939214 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 136/278] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:15.949961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd94000e-fe36-4d85-a683-8b9dff4ec6fa tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:15.996692 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd94000e-fe36-4d85-a683-8b9dff4ec6fa tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.054932 Aug 30 17:26:15.997859 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 137/279] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:16.013420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da202280-9137-4bbb-9841-e1dcb14bb9ea tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-781709653"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:16.024665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-da202280-9137-4bbb-9841-e1dcb14bb9ea tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 9d8a12fe-f1b2-4f24-aa9d-bb22e80f1125 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:16.048871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:16.076214 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da202280-9137-4bbb-9841-e1dcb14bb9ea tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068735 Aug 30 17:26:16.078696 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 138/280] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:16.086145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d243bb7-2d6b-437b-9328-2658e9482ec5 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.105146 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8d243bb7-2d6b-437b-9328-2658e9482ec5 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d243bb7-2d6b-437b-9328-2658e9482ec5 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Request method failure captured: Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgU1OrYua10z2LC3_ogGLTHazTY8eSsECTgNRUEr__de0300fn6pETt_nloRKGFjBa-aGKu7skn4FnK0oHGWQ1f9bRG3ael6SrMbHqHdGLA4QUnxJvSkGjC4TksfthFek1ob1i6qjKq3OYVmcS1BeBkbA0NNDyPq-CDlBvrU2GZ52w Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:16.110467 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bbceea051e9f4682bbbb6b150461ebc6"}]}] Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8fe38b9cced541b3ada76b82e426b614 Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: exception: Aggregate 12 could not be found. Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '12'} Aug 30 17:26:16.111913 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.112922 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 30 17:26:16.114058 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.115114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d243bb7-2d6b-437b-9328-2658e9482ec5 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:16.115114 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d243bb7-2d6b-437b-9328-2658e9482ec5 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.033008 Aug 30 17:26:16.134241 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 139/281] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:16 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:16.146330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2f9fb5d-40de-4a45-85cf-62ec8b313a59 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:16.164002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2f9fb5d-40de-4a45-85cf-62ec8b313a59 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:16.165750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2f9fb5d-40de-4a45-85cf-62ec8b313a59 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:16.167085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2f9fb5d-40de-4a45-85cf-62ec8b313a59 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:16.233520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:16.251687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-47606dd1-9542-4386-b90c-b12033307d38 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1272 microversion: 2.1 time: 0.339521 Aug 30 17:26:16.252923 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 143/282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:15 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:16.261212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d20b797b-7076-48b2-b045-f34da69da3c4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.307858 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d20b797b-7076-48b2-b045-f34da69da3c4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d20b797b-7076-48b2-b045-f34da69da3c4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Request method failure captured: Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgU1OrYua10z2LC3_ogGLTHazTY8eSsECTgNRUEr__de0300fn6pETt_nloRKGFjBa-aGKu7skn4FnK0oHGWQ1f9bRG3ael6SrMbHqHdGLA4QUnxJvSkGjC4TksfthFek1ob1i6qjKq3OYVmcS1BeBkbA0NNDyPq-CDlBvrU2GZ52w Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:16.311503 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bbceea051e9f4682bbbb6b150461ebc6"}]}] Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8fe38b9cced541b3ada76b82e426b614 Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: exception: Aggregate 12 could not be found. Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '12'} Aug 30 17:26:16.312975 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:16.313795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.314806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.316542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d20b797b-7076-48b2-b045-f34da69da3c4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:16.322794 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d20b797b-7076-48b2-b045-f34da69da3c4 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.067013 Aug 30 17:26:16.330233 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 144/283] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:16 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:16.338480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.339258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:16.347448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:16.348369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:16.348961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:16.349823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:16.350445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:16.351014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:16.423116 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2f9fb5d-40de-4a45-85cf-62ec8b313a59 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.286790 Aug 30 17:26:16.424801 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 140/284] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:16.435418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f5d98ba-4258-4d9a-9d01-45a26bc5fb73 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-455980417", "name": "tempest-test_aggregate-1139709962"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:16.483435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-8f5d98ba-4258-4d9a-9d01-45a26bc5fb73 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 24501c7e-219e-4d86-806e-7ae05a2ac95a for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:16.565358 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f5d98ba-4258-4d9a-9d01-45a26bc5fb73 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.138523 Aug 30 17:26:16.573971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 141/285] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:16.579365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-774a91a8-59d8-4cac-a80d-e71afd5fbd01 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:16.584750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-774a91a8-59d8-4cac-a80d-e71afd5fbd01 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a6187a0cf87444d68e4ce76f079e516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb6cc83b4214873a8f814a42d811e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-774a91a8-59d8-4cac-a80d-e71afd5fbd01 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Request method failure captured: Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 43 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgTij86AO7-BllWnWWAWK1DXLaG3YvJG4rtzbi5eDz5Z5iPK4cz1ooI7e8dQf-vnvBuVDo9JUMEr3QjsEyFRr1y4AWPjqr21qw1q9clgTAKpjKIF2SxzHXbfYbJvcj6ybf5Gso3cnBd7zxc1SW4TB05MvxMQlpIEZaUfm4l1CAo5I4 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:16.588562 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aeb6cc83b4214873a8f814a42d811e18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aeb6cc83b4214873a8f814a42d811e18"}]}] Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aeb6cc83b4214873a8f814a42d811e18 Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571 Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a6187a0cf87444d68e4ce76f079e516c Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1616926571-project Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: {"remove_host": {"host": "n-h2-852771-11"}} Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:16.590010 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-852771-11'}}} Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:16.590925 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 17:26:16.595778 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.597184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-774a91a8-59d8-4cac-a80d-e71afd5fbd01 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:16.597184 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-774a91a8-59d8-4cac-a80d-e71afd5fbd01 tempest-AggregatesAdminNegativeTestJSON-1616926571 tempest-AggregatesAdminNegativeTestJSON-1616926571-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.019827 Aug 30 17:26:16.597184 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 142/286] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:16.601028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8026a4c6-3392-4458-8c1e-0eec29f7f589 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.654148 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8026a4c6-3392-4458-8c1e-0eec29f7f589 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.061593 Aug 30 17:26:16.654741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 143/287] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:16.667173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48639988-463b-4724-95e5-ed1ebdb46800 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:16.695028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48639988-463b-4724-95e5-ed1ebdb46800 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:16.695835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48639988-463b-4724-95e5-ed1ebdb46800 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:16.696752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48639988-463b-4724-95e5-ed1ebdb46800 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:16.751556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:16.769939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f75563a3-2472-41f9-9ed4-f3d3a84307dc tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1467 microversion: 2.1 time: 0.438384 Aug 30 17:26:16.770540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 145/288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:16 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1467 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:16.782254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97ce214e-f9a8-4c55-a8fb-6218d486f2c8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.808034 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-97ce214e-f9a8-4c55-a8fb-6218d486f2c8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97ce214e-f9a8-4c55-a8fb-6218d486f2c8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Request method failure captured: Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgU1OrYua10z2LC3_ogGLTHazTY8eSsECTgNRUEr__de0300fn6pETt_nloRKGFjBa-aGKu7skn4FnK0oHGWQ1f9bRG3ael6SrMbHqHdGLA4QUnxJvSkGjC4TksfthFek1ob1i6qjKq3OYVmcS1BeBkbA0NNDyPq-CDlBvrU2GZ52w Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:16.810082 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bbceea051e9f4682bbbb6b150461ebc6"}]}] Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8fe38b9cced541b3ada76b82e426b614 Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: exception: Aggregate 14 could not be found. Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '14'} Aug 30 17:26:16.811576 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.812453 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 30 17:26:16.814079 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.815267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97ce214e-f9a8-4c55-a8fb-6218d486f2c8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:16.815267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97ce214e-f9a8-4c55-a8fb-6218d486f2c8 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.040038 Aug 30 17:26:16.815267 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 146/289] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:16 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:16.884901 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48639988-463b-4724-95e5-ed1ebdb46800 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.223290 Aug 30 17:26:16.889395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 144/290] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:16.904878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cea85769-5f59-42b6-9552-76496c7ec66c tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:16.934897 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-cea85769-5f59-42b6-9552-76496c7ec66c tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cea85769-5f59-42b6-9552-76496c7ec66c tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Request method failure captured: Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgU1OrYua10z2LC3_ogGLTHazTY8eSsECTgNRUEr__de0300fn6pETt_nloRKGFjBa-aGKu7skn4FnK0oHGWQ1f9bRG3ael6SrMbHqHdGLA4QUnxJvSkGjC4TksfthFek1ob1i6qjKq3OYVmcS1BeBkbA0NNDyPq-CDlBvrU2GZ52w Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:16.940113 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bbceea051e9f4682bbbb6b150461ebc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bbceea051e9f4682bbbb6b150461ebc6"}]}] Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: bbceea051e9f4682bbbb6b150461ebc6 Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1864538745 Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8fe38b9cced541b3ada76b82e426b614 Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminTestJSON-1864538745-project-admin Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: exception: Aggregate 14 could not be found. Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '14'} Aug 30 17:26:16.942304 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:16.943015 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:16.944858 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:16.947520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:16.947520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:16.947520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:16.947520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 30 17:26:16.947520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:16.949023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cea85769-5f59-42b6-9552-76496c7ec66c tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:16.950110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cea85769-5f59-42b6-9552-76496c7ec66c tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.059731 Aug 30 17:26:16.954999 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 145/291] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:16.961096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c40c607-362c-41a6-ba17-2891a13445d0 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.005117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c40c607-362c-41a6-ba17-2891a13445d0 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.045732 Aug 30 17:26:17.005749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 146/292] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:17.018996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f15cf73-a783-49ce-88d3-e2766dddae33 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-147168510"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.030050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-6f15cf73-a783-49ce-88d3-e2766dddae33 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 752deea4-f8e2-470b-b975-a25771c08415 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:17.060814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f15cf73-a783-49ce-88d3-e2766dddae33 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053256 Aug 30 17:26:17.061732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 147/293] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.074262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78c6f32d-3e11-4e8d-98ba-73fac420e5d7 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1114482178"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.082090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-78c6f32d-3e11-4e8d-98ba-73fac420e5d7 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Generated uuid 0d20ff14-c4fe-4fe7-918d-f333db9ab7ac for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:17.123960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78c6f32d-3e11-4e8d-98ba-73fac420e5d7 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058448 Aug 30 17:26:17.125340 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 148/294] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.131145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f495d69-326b-478f-ae0a-b8564c9e0ec7 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.141077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f495d69-326b-478f-ae0a-b8564c9e0ec7 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.014537 Aug 30 17:26:17.144957 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 149/295] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.150565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.166049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.166536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.166970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.173477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.174563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.175881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.184679 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.compute.aggregates [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 17:26:17.186535 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Request method failure captured: Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 42 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgVVm8BnPPNnhyeRAvmiVyOxKS4UPUIniAeq8z72QdjwZbJBixCcfDDFdEY1yEFhPzNOCTIxq3B89ZP3mDM3UMujCo_JAggZgPSlnou_fQ7h5sCTV-0p09lwVBYV7bBTT76tfiOWZk87d1URcb-E97cUX5GCPTPf_1qlJNoS_3sLkE Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:17.189036 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/227c6b9b4e8a4ea58f2d66a18d9844ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_227c6b9b4e8a4ea58f2d66a18d9844ca"}]}] Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 227c6b9b4e8a4ea58f2d66a18d9844ca Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119 Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bb4a9365773540369231b6307e5c87c7 Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: {"remove_host": {"host": "nonexist_host"}} Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:17.190230 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot remove host nonexist_host in aggregate 16 Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 17:26:17.191668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 30 17:26:17.192864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.193917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Aug 30 17:26:17.195062 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:17.197351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:17.198784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2483946e-7ede-4d29-8349-032397305a25 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.052676 Aug 30 17:26:17.199906 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 150/296] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:17 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:17.205153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9796eaf-6ea3-4f18-ac12-d84dc789c155 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.244619 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9796eaf-6ea3-4f18-ac12-d84dc789c155 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.043405 Aug 30 17:26:17.247290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 151/297] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:26:17 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.257720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-027f84f5-3a9c-4293-b5b1-54135354a282 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.307107 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-027f84f5-3a9c-4293-b5b1-54135354a282 tempest-AggregatesAdminNegativeTestJSON-1912122119 tempest-AggregatesAdminNegativeTestJSON-1912122119-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.057449 Aug 30 17:26:17.311507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 152/298] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:17 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:17.314297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-935300c9-887a-40a2-912d-0fec3d2faeaa tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.327967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-935300c9-887a-40a2-912d-0fec3d2faeaa tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.018717 Aug 30 17:26:17.334735 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 153/299] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:26:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.334735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.334735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:17.341354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.341834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.342261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.342955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.343404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.344148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.358368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1774934711", "block_migration": true, "disk_over_commit": false}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.361497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:17.379090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.379668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.383109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.384366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:17.385016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:17.385624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:17.589919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:17.630979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d48386b9-7cff-4879-b3d4-0d78e4edcd33 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1278 microversion: 2.1 time: 0.301330 Aug 30 17:26:17.638367 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 154/300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:17 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1278 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:17.662696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9a98bba-cacd-4aee-8f0d-c425f70fda2b tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:17.718098 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9a98bba-cacd-4aee-8f0d-c425f70fda2b tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.073683 Aug 30 17:26:17.721967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 155/301] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:17.736067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c04ec5b-68df-40b2-b2c3-591fb3552a27 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-481537592", "availability_zone": "tempest-test_az-1381118513"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:17.745799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-5c04ec5b-68df-40b2-b2c3-591fb3552a27 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 43a738df-482c-46d8-a6ae-1a779663a4e9 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:17.836764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c04ec5b-68df-40b2-b2c3-591fb3552a27 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.108851 Aug 30 17:26:17.839030 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 156/302] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 30 17:26:17 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:17.853334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4bd22a7c-9980-4818-a649-99553effc0b3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-481537592_new", "availability_zone": "tempest-test_az-1381118513_new"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:18.090959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lazy-loading 'flavor' on Instance uuid 9b6d18d0-d124-4dfe-8944-4c0e5c108233 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:18.111336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd22a7c-9980-4818-a649-99553effc0b3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.111940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd22a7c-9980-4818-a649-99553effc0b3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.114384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd22a7c-9980-4818-a649-99553effc0b3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.194939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4bd22a7c-9980-4818-a649-99553effc0b3 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.349266 Aug 30 17:26:18.195991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 157/303] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:26:17 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:18.207840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16469d5e-70ea-42d8-8c9c-2db53254516d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.209587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Going to try to live migrate instance to tempest-host-1774934711 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:26:18.218124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16469d5e-70ea-42d8-8c9c-2db53254516d tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.015035 Aug 30 17:26:18.218627 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] HTTP exception thrown: Compute host tempest-host-1774934711 could not be found. Aug 30 17:26:18.219461 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 158/304] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:26:18 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Request method failure captured: Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233/action HTTP/1.1 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 107 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgi15IN0kciQ0IK6Dpm476eUOofhQUu27U5HYsHMCFi9RAO9-ifYxm8KxGY5mMqH5UJGuvPAjfmFu5kGjEdvw9pOO87GYtLOJs9p28hhfZh6dF9bGgz_EIR-nScKN6G7NCtZqLoZrwf-LW9KXHBklsFQD8OHmDkmtpLB-v1vV07TIo Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4759d139d67e4c89981be07dad372398 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:18.223960 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4759d139d67e4c89981be07dad372398"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4759d139d67e4c89981be07dad372398"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4759d139d67e4c89981be07dad372398"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4759d139d67e4c89981be07dad372398"}]}] Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4759d139d67e4c89981be07dad372398 Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationNegativeTest-1802303891-project-admin Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 1a310b7f56604b358127ab6aa1402ac1 Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationNegativeTest-1802303891-project-admin Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: {"os-migrateLive": {"host": "tempest-host-1774934711", "block_migration": true, "disk_over_commit": false}} Aug 30 17:26:18.225425 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: exception: Compute host tempest-host-1774934711 could not be found. Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9b6d18d0-d124-4dfe-8944-4c0e5c108233', 'body': {'os-migrateLive': {'host': 'tempest-host-1774934711', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:18.226195 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1774934711 could not be found. Aug 30 17:26:18.227449 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1774934711 could not be found. Aug 30 17:26:18.228683 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1774934711 could not be found. Aug 30 17:26:18.230115 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.231781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f87a3eb-4ffa-4107-b720-97422bdd1de1 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.236656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Returning 400 to user: Compute host tempest-host-1774934711 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:18.238954 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99317471-af23-4044-83ff-e8aba5df2d42 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233/action" status: 400 len: 100 microversion: 2.1 time: 1.424768 Aug 30 17:26:18.240050 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 147/305] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 30 17:26:16 2022] POST /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233/action => generated 100 bytes in 1427 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:26:18.254170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.254875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:18.263969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:18.275164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.277569 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f87a3eb-4ffa-4107-b720-97422bdd1de1 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.050005 Aug 30 17:26:18.278298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.278897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.279808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.280813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.282034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.285705 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 159/306] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:18 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:18.291325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60bbcfa7-a4ef-4323-98f1-ea2741985572 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1926122397"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:18.298280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-60bbcfa7-a4ef-4323-98f1-ea2741985572 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Generated uuid 5a796b54-294a-4ada-96f2-b604ae268e62 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:26:18.309256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=78,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:18.354601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60bbcfa7-a4ef-4323-98f1-ea2741985572 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059669 Aug 30 17:26:18.358852 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 160/307] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:26:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:18.369319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-beb4728b-a375-47de-97a1-d5948704ae0a tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.388441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-beb4728b-a375-47de-97a1-d5948704ae0a tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.028314 Aug 30 17:26:18.390003 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 161/308] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:26:18 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:18.410054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ef7d0fa-45d3-4b08-98f3-61464adeebb0 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.464785 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ef7d0fa-45d3-4b08-98f3-61464adeebb0 tempest-AggregatesAdminTestJSON-1864538745 tempest-AggregatesAdminTestJSON-1864538745-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.062367 Aug 30 17:26:18.466100 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 162/309] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:26:18 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:26:18.485825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.486383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:18.509889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.510381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.510905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.512615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.513077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.513733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.543689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] HTTP exception thrown: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Request method failure captured: Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 HTTP/1.1 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSohkzwjrqnwkMbcLoze9Eath5PvVjDhZcAhYJKIpnlMKoxcupOaV4eLoCHecSUpf4YdOwO226-sI7zssMKOM75ZVvJJhgb4IfYaPdPxKZb0bd3dTd26FEnwdxcWyC09kIn3Vw2cJTCvsQoqd5J1Ac-C-ODMNJSe3OFObQjST_HW4 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:18.545326 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_05ea2e7a96c7400c8855914c665c6cea"}]}] Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 05cd2cdb96774fdebb778c45138d4032 Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.546524 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '273f80fe-bc1d-4d13-b4fd-46d07c7951d8'} Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:18.547298 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.548402 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.549438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Returning 404 to user: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:18.549438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b8091da-7879-4315-9395-70a267aa76b0 tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "DELETE /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 404 len: 111 microversion: 2.1 time: 0.071214 Aug 30 17:26:18.557154 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 163/310] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:18 2022] DELETE /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:18.561893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.563936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] [instance: 273f80fe-bc1d-4d13-b4fd-46d07c7951d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:18.581047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.582598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.584667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.587880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.590988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.591715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.598695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:18.609701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56ed0caa-5947-4a71-a8f8-f6e80bfd7162 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1467 microversion: 2.1 time: 0.362162 Aug 30 17:26:18.626091 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 148/311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:18 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1467 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:18.626295 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] HTTP exception thrown: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Request method failure captured: Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 HTTP/1.1 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSohkzwjrqnwkMbcLoze9Eath5PvVjDhZcAhYJKIpnlMKoxcupOaV4eLoCHecSUpf4YdOwO226-sI7zssMKOM75ZVvJJhgb4IfYaPdPxKZb0bd3dTd26FEnwdxcWyC09kIn3Vw2cJTCvsQoqd5J1Ac-C-ODMNJSe3OFObQjST_HW4 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:18.629599 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/05ea2e7a96c7400c8855914c665c6cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_05ea2e7a96c7400c8855914c665c6cea"}]}] Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 05ea2e7a96c7400c8855914c665c6cea Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-876224989 Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 05cd2cdb96774fdebb778c45138d4032 Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AggregatesAdminTestJSON-876224989-project Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.631253 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '273f80fe-bc1d-4d13-b4fd-46d07c7951d8'} Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:18.632075 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. Aug 30 17:26:18.633377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:18.641111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] Returning 404 to user: Instance 273f80fe-bc1d-4d13-b4fd-46d07c7951d8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:18.641111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44e7e432-f282-49a4-afec-d0e595f25d8b tempest-AggregatesAdminTestJSON-876224989 tempest-AggregatesAdminTestJSON-876224989-project] 10.222.0.50 "GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8" status: 404 len: 111 microversion: 2.1 time: 0.078736 Aug 30 17:26:18.641111 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 164/312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:18 2022] GET /compute/v2.1/servers/273f80fe-bc1d-4d13-b4fd-46d07c7951d8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:18.654086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:18.654702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:18.672279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.673293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.673759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.678242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:18.680680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:18.681236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:18.815190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:18.830876 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cbe8452c-9b44-482e-aa5f-aaaec8834820 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1278 microversion: 2.1 time: 0.180935 Aug 30 17:26:18.834775 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 149/313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:18 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:18.854519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-453906934", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:18.937863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:26:19.741935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:26:19.742618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:26:19.742931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:26:19.743550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:26:19.744193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:26:19.764019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:19.766185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:19.766806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:19.767772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:19.772643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:19.773276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:19.811542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Getting quotas for project 64921ce5b0004ed284b672832f77e4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:26:19.824572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Getting quotas for user 369e029edcc0477b9c1e123e2a30b0fc and project 64921ce5b0004ed284b672832f77e4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:26:19.858597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:26:19.859412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:19.860628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:19.865979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:26:19.880237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:19.880757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:19.889321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:19.893246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:19.895006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:19.896824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:19.988380 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2b05c3a-3bbc-4bcf-b5a7-f3bda5cbe2be tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137584 Aug 30 17:26:19.998502 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 165/314] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:26:20.011050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3628a215-ddf9-483e-80b1-fd848fca4679 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:20.012864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3628a215-ddf9-483e-80b1-fd848fca4679 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:20.384082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3628a215-ddf9-483e-80b1-fd848fca4679 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:20.401745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3628a215-ddf9-483e-80b1-fd848fca4679 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1218 microversion: 2.1 time: 0.399986 Aug 30 17:26:20.406054 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 166/315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:19 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1218 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:20.691557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:20.720151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04afa067-3147-425d-b9c7-7147041302f9 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.861025 Aug 30 17:26:20.759677 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 150/316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:19 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:21.210741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Calling method '.version_select at 0x7f2d992b0c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:21.216772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.220788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.222425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.257320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.258482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.259144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.363683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.364190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.367931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.431390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:21.432060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:21.443064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.449208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.453610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.459473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.460651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.463875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.466069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.466243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.467881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.485622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.486114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.486558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.494794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e847bd75-a527-44a0-af78-4a3521f498b4 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.515704 Aug 30 17:26:21.515937 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 167/317] 10.222.0.50 () {60 vars in 1243 bytes} [Tue Aug 30 17:26:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:26:21.530079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Calling method '.version_select at 0x7f2d9929e550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:21.555239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.555799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.558610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.567309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:21.584675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.585271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.585995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.641890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.643513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.644647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.658895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.659435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.661014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.703172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.703965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.704669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.734862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-833c7602-48b5-4f5b-bc3a-afdfda24c942 tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.211635 Aug 30 17:26:21.746829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 168/318] 10.222.0.50 () {60 vars in 1222 bytes} [Tue Aug 30 17:26:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:21.759069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Calling method '.version_select at 0x7f2d992b04c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:21.764056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.765518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.771505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.814833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.816788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.819628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.832721 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb1b6282-3cdf-4b26-a1d6-e95f8cb26ffb tempest-HypervisorAdminV253TestBase-587737177 tempest-HypervisorAdminV253TestBase-587737177-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/6bb65284-1baf-4f56-ba0e-ee1e22b92fdf" status: 200 len: 794 microversion: 2.53 time: 0.082750 Aug 30 17:26:21.840666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:21.847972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 169/319] 10.222.0.50 () {60 vars in 1298 bytes} [Tue Aug 30 17:26:21 2022] GET /compute/v2.1/os-hypervisors/6bb65284-1baf-4f56-ba0e-ee1e22b92fdf => generated 794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:26:21.851732 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eff96280-f72c-4265-be1d-e13ef980f8ee tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1214 microversion: 2.1 time: 0.426150 Aug 30 17:26:21.856963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:21.857861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:21.868329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.869222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.869830 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 151/320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:21 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:21.870145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:21.871448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:21.874706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:21.875863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:22.755100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:22.773063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ecff019-96d9-4cbc-bde8-6286d77ebe94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.923598 Aug 30 17:26:22.790443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 170/321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:21 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:22.812093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a5fa820-3803-4617-9e8e-04b9c08a8b90 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] Calling method '.version_select at 0x7f2d99468820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:22.819326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148b8c07-241a-428b-95a6-93344b3ce4a4", "tag": "076737d2-5e6d-4c79-a1b2-957a04fc3ebd"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:22.870176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:22.872778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:22.873473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:22.874985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a5fa820-3803-4617-9e8e-04b9c08a8b90 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.003984 Aug 30 17:26:22.885700 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 152/322] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:26:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:22.891512 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] Creating event network-changed:076737d2-5e6d-4c79-a1b2-957a04fc3ebd for instance 148b8c07-241a-428b-95a6-93344b3ce4a4 on n-h2-852771-11 Aug 30 17:26:22.900537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:22.901143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:22.904524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bfd089ca-45a3-4b67-a2c6-36ee4088a393 req-c5072b56-4dd4-4967-8784-a082e7972771 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108738 Aug 30 17:26:22.906748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 171/323] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:22.920264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:22.920758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:22.921192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:22.922138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:22.924283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a87f504b-fa29-496b-8687-b263096f4385 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9921f700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:22.926658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:22.927456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:22.978825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:23.438022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=77,nova_api:DELETE=2,nova_api:UPDATE=9 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:23.593426 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a87f504b-fa29-496b-8687-b263096f4385 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.684143 Aug 30 17:26:23.594931 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 172/324] 10.222.0.50 () {60 vars in 1206 bytes} [Tue Aug 30 17:26:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:23.607750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0fb1dea-4d28-4be2-baa4-3ed24d948bad tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] Calling method '.version_select at 0x7f2d99218ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:23.645832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0fb1dea-4d28-4be2-baa4-3ed24d948bad tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041344 Aug 30 17:26:23.649619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 173/325] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:26:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:23.658858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af15a782-23c1-4e1d-bf23-30950899f585 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99246940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:23.789591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:23.800247 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c899e56-7d74-4790-baca-daf607e31400 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1276 microversion: 2.1 time: 0.906738 Aug 30 17:26:23.804462 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 153/326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:22 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1276 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:23.809455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:23.832693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:23.875261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:23.877823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:23.878808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:23.883361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:23.886427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:23.888835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:23.953957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af15a782-23c1-4e1d-bf23-30950899f585 tempest-QuotaClassesAdminTestJSON-886517628 tempest-QuotaClassesAdminTestJSON-886517628-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.297658 Aug 30 17:26:23.957211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 174/327] 10.222.0.50 () {60 vars in 1206 bytes} [Tue Aug 30 17:26:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:24.648613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:24.657736 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5528c46-6c28-478f-aac8-820076dd208f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.851987 Aug 30 17:26:24.663808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 154/328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:23 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:24.832328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:24.833378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:24.850614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:24.851710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:24.854670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:24.858288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:24.859440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:24.862825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:25.070005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:25.086082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d552381-791a-4557-b181-edd44d921131 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1276 microversion: 2.1 time: 0.261584 Aug 30 17:26:25.086599 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 175/329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:24 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:25.687140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:25.689145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:25.697830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:25.698334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:25.698754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:25.699765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:25.701230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:25.702089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:26.110648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:26.112827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:26.140942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:26.142129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:26.144425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:26.145622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:26.146464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:26.147078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:26.420330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:26.439113 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe0569b7-85ff-4000-aeef-df09ce002adb tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.335860 Aug 30 17:26:26.452499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 176/330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:26 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:26.648433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:26.663965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-321d7a67-2f9a-4de6-9492-b4784f8e4404 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.981337 Aug 30 17:26:26.679007 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 155/331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:25 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:27.048093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7d55014-995b-48e9-a64d-4dd98576c947 tempest-AZAdminNegativeTestJSON-1685444766 tempest-AZAdminNegativeTestJSON-1685444766-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:27.061464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7d55014-995b-48e9-a64d-4dd98576c947 tempest-AZAdminNegativeTestJSON-1685444766 tempest-AZAdminNegativeTestJSON-1685444766-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '7592dbe534ab403f9a7d9f8dcaad4bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eee7e4156f4e8eba5de2f4377841c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7d55014-995b-48e9-a64d-4dd98576c947 tempest-AZAdminNegativeTestJSON-1685444766 tempest-AZAdminNegativeTestJSON-1685444766-project] Request method failure captured: Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhBbdLtBT_TxGbQz-2JVKEo8dRnYxmj4ASGNj7NR2ed4R--HxscfN4cMYwMz0-RpnI6Qh-e0OJWfElX4A0jCzG5g8_8VxzMROE3_IiTaWI9_pKCIxdoEnuxzWQCPbDZOQDZirJs1y_D7OFZE2CxwIh_mx1vrXT9MS4s145PUJzyK3g Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 32eee7e4156f4e8eba5de2f4377841c0 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1685444766 Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:27.064114 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32eee7e4156f4e8eba5de2f4377841c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32eee7e4156f4e8eba5de2f4377841c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32eee7e4156f4e8eba5de2f4377841c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32eee7e4156f4e8eba5de2f4377841c0"}]}] Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AZAdminNegativeTestJSON-1685444766 Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 32eee7e4156f4e8eba5de2f4377841c0 Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1685444766 Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AZAdminNegativeTestJSON-1685444766-project Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7592dbe534ab403f9a7d9f8dcaad4bc8 Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AZAdminNegativeTestJSON-1685444766-project Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 17:26:27.066460 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:27.067376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 17:26:27.068545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:27.072360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7d55014-995b-48e9-a64d-4dd98576c947 tempest-AZAdminNegativeTestJSON-1685444766 tempest-AZAdminNegativeTestJSON-1685444766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:27.073448 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7d55014-995b-48e9-a64d-4dd98576c947 tempest-AZAdminNegativeTestJSON-1685444766 tempest-AZAdminNegativeTestJSON-1685444766-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.312927 Aug 30 17:26:27.074166 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 177/332] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:26:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:27.463657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:27.464247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:27.477400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:27.478578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:27.481011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:27.483934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:27.485729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:27.486409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:27.686585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:27.687767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:27.704644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:27.705375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:27.707549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:27.708532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:27.720208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:27.721516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:28.092159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:28.108507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efe01fe0-ac61-4913-b01f-c8883ca311ed tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.424791 Aug 30 17:26:28.123540 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 178/333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:27 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:28.131714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:28.151623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00115647-180c-4c6e-b5a7-f21ce89debab tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.692018 Aug 30 17:26:28.152859 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 156/334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:27 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:29.137007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:29.137800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:29.157084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:29.157608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:29.158050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:29.159310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:29.162530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:29.165960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:29.176561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:29.178503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:29.197831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:29.198700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:29.200586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:29.202076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:29.208216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:29.210863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:29.787837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:29.799062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:29.812205 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a7afe13-dc4e-46cb-a475-5ce00d4f702b tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.678857 Aug 30 17:26:29.813350 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 179/335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:29 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:29.827135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a", "tag": "cc8b89da-ab1b-4549-a4a8-0a173829d9f8"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:29.870290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:29.873525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:29.874510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:29.929293 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] Creating event network-changed:cc8b89da-ab1b-4549-a4a8-0a173829d9f8 for instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a on n-h2-852771-11 Aug 30 17:26:29.964573 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2d90c86c-93a2-4b52-aff2-68e4d7af685d req-f02877d9-0e0b-400d-a7a2-5b025d861cec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141203 Aug 30 17:26:29.966913 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 180/336] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:30.247149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:30.280102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b56cb6f4-a275-4d29-8690-0be3d4d485db tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 1.108374 Aug 30 17:26:30.286263 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 157/337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:29 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:30.838104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:30.839311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:30.857270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:30.860168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:30.860802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:30.864229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:30.865724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:30.867066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:30.982931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f72c06b7-f225-4b1e-9a05-dc81c957f067 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d991d9700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:31.642946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:31.691295 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f72c06b7-f225-4b1e-9a05-dc81c957f067 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977" status: 200 len: 371 microversion: 2.1 time: 1.108369 Aug 30 17:26:31.711185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 181/338] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:26:30 2022] GET /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977 => generated 371 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:31.716871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:31.717604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:31.738882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:31.739377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:31.739843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:31.740546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:31.740996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:31.741413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:32.030031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:32.056677 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff1f1835-0a71-4a65-a355-14cf33068d75 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 1.224751 Aug 30 17:26:32.060956 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 158/339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:30 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:32.075046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99468550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:32.758316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:32.758798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:32.759231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:32.760026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:32.760581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:32.761008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:32.932498 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61b9726e-a05d-4121-9faf-f19fa4e6fe4a tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977" status: 200 len: 328 microversion: 2.1 time: 0.869680 Aug 30 17:26:32.937541 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 159/340] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:26:32 2022] PUT /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977 => generated 328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:32.947455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148b8c07-241a-428b-95a6-93344b3ce4a4", "name": "network-vif-plugged", "status": "completed", "tag": "076737d2-5e6d-4c79-a1b2-957a04fc3ebd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:32.965180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:32.969485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:32.970095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:32.996850 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] Creating event network-vif-plugged:076737d2-5e6d-4c79-a1b2-957a04fc3ebd for instance 148b8c07-241a-428b-95a6-93344b3ce4a4 on n-h2-852771-11 Aug 30 17:26:33.010264 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4359ea64-36f7-4278-bb5c-62faf4be9087 req-7261f320-6987-4fa9-9f40-b808e678b8dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071059 Aug 30 17:26:33.014054 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 160/341] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:33.034682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d4f15b70-fa4f-4eff-acdd-aa9224628e87 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:33.076936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d4f15b70-fa4f-4eff-acdd-aa9224628e87 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977" status: 202 len: 0 microversion: 2.1 time: 0.059954 Aug 30 17:26:33.078313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 161/342] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:26:33 2022] DELETE /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:26:33.097512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:33.098957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:33.124026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:33.127182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:33.127718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:33.132017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:33.136802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:33.137341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:33.258700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:33.275124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c191a0ce-6b10-413d-88fe-592530c4071e tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 1.560026 Aug 30 17:26:33.276115 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 182/343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:31 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:33.287230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f1cbf7e-bbb7-46db-a98e-2529bbf015ea tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d991d9c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:33.561710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:33.576567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1e0ebfbf-1f76-40dc-b630-21195d1618a6 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 0.493681 Aug 30 17:26:33.579312 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 162/344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:33 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:34.047743 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f1cbf7e-bbb7-46db-a98e-2529bbf015ea tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977" status: 200 len: 371 microversion: 2.1 time: 0.767811 Aug 30 17:26:34.048408 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 183/345] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:26:33 2022] GET /compute/v2.1/os-quota-sets/b032d54dd79e40cea5fe1bff22cd7977 => generated 371 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:34.298376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:34.299687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:34.316004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:34.317604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:34.318366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:34.320794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:34.322125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:34.323616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:34.474112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1086271933", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:34.599470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:26:34.840892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:34.853181 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-855a2267-44fd-481f-a522-4a1ae2ddf352 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.559138 Aug 30 17:26:34.874598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 184/346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:34 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:34.886444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3fe36fed-c858-4396-8061-397f3592ae22 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d9921f160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:35.513707 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3fe36fed-c858-4396-8061-397f3592ae22 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec/defaults" status: 200 len: 371 microversion: 2.1 time: 0.633544 Aug 30 17:26:35.522534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 185/347] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:26:34 2022] GET /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec/defaults => generated 371 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:35.530183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:35.531114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:35.539744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:35.540512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:35.541148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:35.546175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:35.547522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:35.550651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:35.576600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:26:35.577732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:26:35.578353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:26:35.578909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:26:35.579464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:26:35.607304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:35.610537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:35.612810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:35.615027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:35.620971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:35.624032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:35.701987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Getting quotas for project 795f1f154dc446c09aba61d0cc914cec. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:26:35.729638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Getting quotas for user e7b320e59c4044e6b125be2a72a24df3 and project 795f1f154dc446c09aba61d0cc914cec. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:26:35.773082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:26:35.781741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:26:35.924550 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-353f7e0e-9204-4125-b81d-bf82da92bc3e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.343230 Aug 30 17:26:35.932485 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 163/348] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:26:36.701010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Calling method '.version_select at 0x7f2d994680d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:36.704284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:36.705681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:36.706303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:36.740013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:36.744808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:36.747238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:36.772933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:36.773762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:36.774409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:36.797754 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-360ccfb6-16c1-46e4-be18-29c5fb84915f tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.859837 Aug 30 17:26:36.800170 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 164/349] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:36.816303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:36.818515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:36.834979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:36.836011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:36.840425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:36.844018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:36.852417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:36.854119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:36.948736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:36.957781 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fedc2a7-6419-4b57-ba5e-6026ccf5e56f tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1320 microversion: 2.1 time: 1.433483 Aug 30 17:26:36.975309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 186/350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:35 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1320 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:36.995589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:36.996468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:37.016942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:37.021651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:37.022213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:37.022968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:37.023751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:37.023908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:37.232055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:37.253880 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9379889d-0b15-46c9-a746-ee25956fb1d1 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.448907 Aug 30 17:26:37.255097 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 165/351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:36 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:37.259979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Action: 'update', calling method: .version_select at 0x7f2d995338b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:37.423401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:37.438574 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a410031e-6471-4edc-aaff-e44c41305cd3 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1227 microversion: 2.1 time: 0.461951 Aug 30 17:26:37.442714 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 187/352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:36 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1227 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:37.666610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:37.667085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:37.667943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:37.668945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:37.669561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:37.670118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:37.910555 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22dc1602-2c1a-4252-a970-634fbda14acf tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90" status: 200 len: 328 microversion: 2.1 time: 0.654053 Aug 30 17:26:37.913432 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 166/353] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:26:37 2022] PUT /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90 => generated 328 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:37.926104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d993bab80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:37.931106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db75c4b3-919f-4cc7-9002-2cb186bb787f tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Calling method '.version_select at 0x7f2d994bdd30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:37.943868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db75c4b3-919f-4cc7-9002-2cb186bb787f tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '844014ceabed450ca5c92c8830391c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f422bb5666e4e4b930e9e39b6be1bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db75c4b3-919f-4cc7-9002-2cb186bb787f tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Request method failure captured: Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/n-h2-852771-11/search HTTP/1.1 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhJ5iesxxJqIE3VgMcRsQHlmtYF7dwYbdxQoh5QQToPoA5z5_EAnjF5CP5YC-jPuNjOq5LKmeL7gaPXhiWwOMco_VWj2eax9a-ejJ2a7jBqdHOLyqFW2sDpTgQgYn_8nJ8EBi6gRjqaBRJanVRblkq1IrvbWnlWD_0w9JxA61aV4MA Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 1f422bb5666e4e4b930e9e39b6be1bb8 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:37.952260 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1f422bb5666e4e4b930e9e39b6be1bb8"}]}] Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 1f422bb5666e4e4b930e9e39b6be1bb8 Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 844014ceabed450ca5c92c8830391c51 Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 17:26:37.953938 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-h2-852771-11'} Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:37.954938 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 17:26:37.956575 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:37.957621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db75c4b3-919f-4cc7-9002-2cb186bb787f tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:37.957621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db75c4b3-919f-4cc7-9002-2cb186bb787f tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852771-11/search" status: 403 len: 117 microversion: 2.1 time: 0.509659 Aug 30 17:26:37.974662 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 188/354] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 30 17:26:37 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-11/search => generated 117 bytes in 531 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:37.996444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Calling method '.version_select at 0x7f2d991e2e50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:38.013575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.014073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.031674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.072011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.072849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.074424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.077523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.078082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.078810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.107386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Request method failure captured: Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhLduJoUPsrB6SZX3eYLwexcRd5E2DKsrJYS3k-iPkHRCF0U1HQygnkwpJ-E89urrD0xw6I5LSJDicDErujXoBuTANwZvyVlWwD1n0gLA6nltHJNkHFqkpbqPsQkcpR1y6ADQEfWOylL2B9b_iG43imOXxdAg1yHwnKgs_5lQUM6Ec Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c81d311dd5e047739b8e10bccfeca958 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:38.147283 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c81d311dd5e047739b8e10bccfeca958"}]}] Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c81d311dd5e047739b8e10bccfeca958 Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7590190ef6424a4e94b800ce543630af Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 17:26:38.149220 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:38.150649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:38.152132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:38.152132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:38.152132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:38.152132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 17:26:38.152132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:38.156437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:38.158218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a8c3900-7782-41c8-b8da-7e6cefce7179 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90/detail" status: 200 len: 916 microversion: 2.1 time: 0.237062 Aug 30 17:26:38.160963 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-28998ae8-f08a-419d-92f2-e6820ac6b6db tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.185089 Aug 30 17:26:38.161875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 167/355] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:26:37 2022] GET /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90/detail => generated 916 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:38.167386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 189/356] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:26:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:38.175492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:38.186297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Calling method '.version_select at 0x7f2d991e2040>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:38.197789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.198290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.208337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:38.210058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.233723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.249249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.252490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.265185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.273870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.274446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.352520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.353236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.353691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.404500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.420458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.421056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.459606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a5f01c3-b37b-4723-8fd6-d875a2a834aa tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.277023 Aug 30 17:26:38.466750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 190/357] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:26:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:38.488591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:38.489241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:38.520833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.521328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.529626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.532429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.539247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.542062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.801987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:38.815448 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-868b8839-ec0f-4c83-bc1c-dbb0c278b6ce tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1470 microversion: 2.1 time: 0.649975 Aug 30 17:26:38.816561 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 168/358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:38 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:38.825048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:38.827172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:38.844280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.845509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.846327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.848590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.849817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.850546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.990251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:38.998398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5264302-c684-4c0e-8e98-370d4f73cbb2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1281 microversion: 2.1 time: 0.180549 Aug 30 17:26:39.000233 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 169/359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:38 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:39.011302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d830b59-351b-4f3b-95ef-ff3d75a1ce48 tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Calling method '.version_select at 0x7f2d9938dd30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:39.015468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d830b59-351b-4f3b-95ef-ff3d75a1ce48 tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '844014ceabed450ca5c92c8830391c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f422bb5666e4e4b930e9e39b6be1bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d830b59-351b-4f3b-95ef-ff3d75a1ce48 tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Request method failure captured: Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhJ5iesxxJqIE3VgMcRsQHlmtYF7dwYbdxQoh5QQToPoA5z5_EAnjF5CP5YC-jPuNjOq5LKmeL7gaPXhiWwOMco_VWj2eax9a-ejJ2a7jBqdHOLyqFW2sDpTgQgYn_8nJ8EBi6gRjqaBRJanVRblkq1IrvbWnlWD_0w9JxA61aV4MA Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 1f422bb5666e4e4b930e9e39b6be1bb8 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:39.018049 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1f422bb5666e4e4b930e9e39b6be1bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1f422bb5666e4e4b930e9e39b6be1bb8"}]}] Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 1f422bb5666e4e4b930e9e39b6be1bb8 Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070 Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 844014ceabed450ca5c92c8830391c51 Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 17:26:39.019470 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '1'} Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:39.020187 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 17:26:39.021226 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.025780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d830b59-351b-4f3b-95ef-ff3d75a1ce48 tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:39.027152 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d830b59-351b-4f3b-95ef-ff3d75a1ce48 tempest-HypervisorAdminNegativeUnderV252Test-1844714070 tempest-HypervisorAdminNegativeUnderV252Test-1844714070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025778 Aug 30 17:26:39.028270 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 170/360] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:26:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:39.039853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99357700>, body: {"quota_set": {"ram": "2048"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:39.171171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.171708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.172416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.173321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.175344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.175990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.236421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.236910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.237559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.238356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.245279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.246231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.310180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:39.415422 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-671f39c8-9a37-4186-b88f-89ec00079204 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90?user_id=6040add2fb68442495caf68bbce8af43" status: 200 len: 328 microversion: 2.1 time: 0.377653 Aug 30 17:26:39.417460 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 171/361] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:26:39 2022] PUT /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90?user_id=6040add2fb68442495caf68bbce8af43 => generated 328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:39.435563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:39.437921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:39.441857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:39.462552 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7195762b-160d-4ae6-b008-bc9995d1ead7 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.994392 Aug 30 17:26:39.463861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 191/362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:38 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:39.468572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Calling method '.version_select at 0x7f2d9924ef70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:39.470648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.475158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.475893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.477640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.478174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.478619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.479441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.479967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.480489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.495905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] HTTP exception thrown: No hypervisor matching '8fb021a7-4ac3-4e27-b49f-5e47515d3c09' could be found. Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Request method failure captured: Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hypervisors/8fb021a7-4ac3-4e27-b49f-5e47515d3c09/servers HTTP/1.1 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhLduJoUPsrB6SZX3eYLwexcRd5E2DKsrJYS3k-iPkHRCF0U1HQygnkwpJ-E89urrD0xw6I5LSJDicDErujXoBuTANwZvyVlWwD1n0gLA6nltHJNkHFqkpbqPsQkcpR1y6ADQEfWOylL2B9b_iG43imOXxdAg1yHwnKgs_5lQUM6Ec Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c81d311dd5e047739b8e10bccfeca958 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:39.497517 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c81d311dd5e047739b8e10bccfeca958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c81d311dd5e047739b8e10bccfeca958"}]}] Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c81d311dd5e047739b8e10bccfeca958 Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599 Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7590190ef6424a4e94b800ce543630af Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: exception: No hypervisor matching '8fb021a7-4ac3-4e27-b49f-5e47515d3c09' could be found. Aug 30 17:26:39.498736 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8fb021a7-4ac3-4e27-b49f-5e47515d3c09'} Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8fb021a7-4ac3-4e27-b49f-5e47515d3c09' could be found. Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.499405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8fb021a7-4ac3-4e27-b49f-5e47515d3c09' could be found. Aug 30 17:26:39.500442 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:39.504101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] Returning 404 to user: No hypervisor matching '8fb021a7-4ac3-4e27-b49f-5e47515d3c09' could be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:39.505217 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a17051ec-eb3f-495c-b1d7-f1154f71b079 tempest-HypervisorAdminNegativeUnderV252Test-1785535599 tempest-HypervisorAdminNegativeUnderV252Test-1785535599-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/8fb021a7-4ac3-4e27-b49f-5e47515d3c09/servers" status: 404 len: 123 microversion: 2.1 time: 0.040181 Aug 30 17:26:39.506018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 192/363] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 30 17:26:39 2022] GET /compute/v2.1/os-hypervisors/8fb021a7-4ac3-4e27-b49f-5e47515d3c09/servers => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:39.522965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2684e0a-75bd-4e39-9d90-7403d60570cc tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d991e20d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:39.690540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56843266-8a44-4323-a939-685598c2dcdc tempest-DeleteServersAdminTestJSON-483663146 tempest-DeleteServersAdminTestJSON-483663146-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4/action" status: 202 len: 0 microversion: 2.1 time: 0.261258 Aug 30 17:26:39.696230 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 172/364] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:26:39 2022] POST /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:26:39.699227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2684e0a-75bd-4e39-9d90-7403d60570cc tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90?user_id=6040add2fb68442495caf68bbce8af43" status: 200 len: 370 microversion: 2.1 time: 0.187993 Aug 30 17:26:39.701300 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 193/365] 10.222.0.50 () {58 vars in 1323 bytes} [Tue Aug 30 17:26:39 2022] GET /compute/v2.1/os-quota-sets/8c0f01970b194cdeab28d958ee2d6e90?user_id=6040add2fb68442495caf68bbce8af43 => generated 370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:39.707866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:39.708672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:39.767062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.768500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.769105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.770422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.771925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.772558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.868494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:39.868989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:39.869431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:39.872617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lazy-loading 'fault' on Instance uuid 148b8c07-241a-428b-95a6-93344b3ce4a4 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:40.029715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:40.030819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:40.045234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:40.048581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:40.050636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:40.052559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:40.053984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:40.055399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:40.276670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:40.292376 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8950e09b-e235-4763-b4f9-beeac028a098 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1281 microversion: 2.1 time: 0.270418 Aug 30 17:26:40.295195 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 194/366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:40 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:40.487984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:40.489782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:40.498598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:40.503683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:40.504332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:40.505304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:40.505907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:40.506479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:40.576076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:40.817491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:40.827575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:40.831872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91873f56-125a-476e-be5e-f47863c8fd4e tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1453 microversion: 2.1 time: 1.130518 Aug 30 17:26:40.833017 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 173/367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:39 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1453 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:40.838752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bca5792-9ca5-4e4a-88a1-31fb9258c60f tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Calling method '.version_select at 0x7f2d995338b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:41.351930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6bca5792-9ca5-4e4a-88a1-31fb9258c60f tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec/defaults" status: 200 len: 371 microversion: 2.1 time: 0.517531 Aug 30 17:26:41.359997 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 174/368] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:26:40 2022] GET /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec/defaults => generated 371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:41.376524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:41.377706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:41.398743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:41.399380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:41.399957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:41.402838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:41.403898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:41.405933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:41.476836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:26:41.497837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:41.509207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b78c77d3-7cc8-48ec-8b59-f402fcdbaa25 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 1.026960 Aug 30 17:26:41.514002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 195/369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:40 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:41.527867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a", "name": "network-vif-plugged", "status": "completed", "tag": "cc8b89da-ab1b-4549-a4a8-0a173829d9f8"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:41.551274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:41.554601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:41.557439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:41.590850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] Creating event network-vif-plugged:cc8b89da-ab1b-4549-a4a8-0a173829d9f8 for instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a on n-h2-852771-11 Aug 30 17:26:41.601691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e869105c-30df-4ece-8831-3b92e55cfcda req-98d515aa-1250-4967-b634-e1472e919cfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084765 Aug 30 17:26:41.604565 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 196/370] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:41.616584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:41.619019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:41.650727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:41.651528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:41.653457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:41.655945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:41.657279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:41.659608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:41.907343 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-021f20d4-8de3-403c-a5c6-11f44ba69258 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "DELETE /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 204 len: 0 microversion: 2.1 time: 0.541970 Aug 30 17:26:41.914491 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 175/371] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:41 2022] DELETE /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:41.922289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99327d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:42.373976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.374703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.375383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.379333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.381520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.382186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.609781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:42.625183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7d37db7-25f3-4095-a8bc-eef10f4452b2 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1281 microversion: 2.1 time: 1.015018 Aug 30 17:26:42.627928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 197/372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:41 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1281 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:42.638356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:42.646946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:42.658945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.659965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.660582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.661470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.662271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.663142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.703973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.704801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.705416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.706453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lazy-loading 'fault' on Instance uuid 148b8c07-241a-428b-95a6-93344b3ce4a4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:42.740391 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1592232f-378a-4463-bcc8-6a85c1c1ee3e tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec" status: 200 len: 329 microversion: 2.1 time: 0.823354 Aug 30 17:26:42.741665 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 176/373] 10.222.0.50 () {60 vars in 1263 bytes} [Tue Aug 30 17:26:41 2022] PUT /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec => generated 329 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:42.748138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:42.749076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:42.758164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.758854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.759458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:42.761012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:42.761607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:42.762243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:43.086307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:43.097316 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5425505c-0995-406f-803b-7d0f9d86e793 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1318 microversion: 2.1 time: 0.353539 Aug 30 17:26:43.099640 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 177/374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:42 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:43.117071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99357f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:43.159074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:43.171600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8fc973c0-2aa2-4a37-8d08-240e33c27c94 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1459 microversion: 2.1 time: 0.537909 Aug 30 17:26:43.173631 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 198/375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:42 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1459 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:43.615755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:43.627866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:43.635673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:43.639047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:43.639767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:43.645482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:43.652042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:43.654448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:43.676949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=81,nova_api:UPDATE=15 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:43.686125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:43.695126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:43.697124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:43.699579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:43.703489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:43.705931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:44.015803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=21,nova_api:UPDATE=7 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:44.326157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:44.519832 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ccec0a3b-a854-4cf2-8835-0c7504385b08 tempest-QuotasAdminTestJSON-81791740 tempest-QuotasAdminTestJSON-81791740-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec" status: 200 len: 329 microversion: 2.1 time: 1.415973 Aug 30 17:26:44.520734 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 178/376] 10.222.0.50 () {60 vars in 1263 bytes} [Tue Aug 30 17:26:43 2022] PUT /compute/v2.1/os-quota-sets/c1544dd54022463584349a1472f53cec => generated 329 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:44.542000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:44.542635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:44.568905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:44.569412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:44.571288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:44.573365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:44.574789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:44.575296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:44.929218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:44.968156 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39932871-9499-46c1-98ce-964d15a3d5b1 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 1.319590 Aug 30 17:26:44.973022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 199/377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:43 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:44.987346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:44.993039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:45.014133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.018954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.021316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.022819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.025624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.026090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.117791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.118308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.118769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.119212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lazy-loading 'fault' on Instance uuid 148b8c07-241a-428b-95a6-93344b3ce4a4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:45.246399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:45.255979 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e371ccbf-3567-422c-9af2-3826b2245f13 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1468 microversion: 2.1 time: 0.733917 Aug 30 17:26:45.260508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 179/378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:44 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1468 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:45.279560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:45.280894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:45.293416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.294082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.294714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.295613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.308317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.309018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.348381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lazy-loading 'flavor' on Instance uuid fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:45.469900 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67b887db-d101-44bb-8940-3bc4582042e1 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a/action" status: 202 len: 0 microversion: 2.1 time: 0.193758 Aug 30 17:26:45.487232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 180/379] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:26:45 2022] POST /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:26:45.500790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:45.509224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:45.511058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:45.522310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-155c796b-61e2-4aae-9e96-45478e9e7d61 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1459 microversion: 2.1 time: 0.544961 Aug 30 17:26:45.525483 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 200/380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:44 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1459 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:45.533742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.536183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.537675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.539359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:45.541216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:45.541943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:45.996519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:45.997204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:46.010544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:46.011045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:46.011509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:46.012235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:46.012696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:46.013131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:46.445980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:46.459886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c547b003-6e64-4195-834f-6bd9ad086992 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1476 microversion: 2.1 time: 0.964620 Aug 30 17:26:46.460624 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 181/381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:45 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1476 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:46.563727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:46.565965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:46.582300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:46.585194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:46.586602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:46.589081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:46.596560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:46.597092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:46.710938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:46.711428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:46.715862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:46.716343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lazy-loading 'fault' on Instance uuid 148b8c07-241a-428b-95a6-93344b3ce4a4 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:46.803762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:46.819325 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9f9bc92-9d6a-48d2-bfb8-89e49a7ad35d tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.827531 Aug 30 17:26:46.822821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 201/382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:45 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:47.020722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d2bbe9b4cd437492ae4bae3a4e335c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57f407e4b684ddf89dd95b5b61d2acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:47.035553 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9fbf8b77-29a5-4cf1-aa76-e56a6c694162 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 200 len: 1417 microversion: 2.1 time: 0.478630 Aug 30 17:26:47.052147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 182/383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:46 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 1417 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:47.391818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148b8c07-241a-428b-95a6-93344b3ce4a4", "name": "network-vif-deleted", "tag": "076737d2-5e6d-4c79-a1b2-957a04fc3ebd"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:47.422404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.425698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.430151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:47.468423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] Creating event network-vif-deleted:076737d2-5e6d-4c79-a1b2-957a04fc3ebd for instance 148b8c07-241a-428b-95a6-93344b3ce4a4 on n-h2-852771-11 Aug 30 17:26:47.479746 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-15701fcd-0d33-438c-a55c-fe8e3449da99 req-d5df09fa-9534-4a60-96ca-1fae329bf884 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100295 Aug 30 17:26:47.487754 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 202/384] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:47.491768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:47.492766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:47.508170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.509154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.509846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:47.514703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.515193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.523314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:47.564910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a5c599-48f8-4b63-9df3-ec6cfb243ffa", "tag": "bb591b2d-4610-45fd-9701-fc99fdb603e5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:47.585835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.586792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.587607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:47.602952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] Creating event network-changed:bb591b2d-4610-45fd-9701-fc99fdb603e5 for instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa on n-h1-852771-11 Aug 30 17:26:47.609691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-996c7665-f62c-4756-b11d-be692dff44b4 req-fa14d56b-978a-4309-99d5-285f0676f893 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049733 Aug 30 17:26:47.610877 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 203/385] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:47.850977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:47.852373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:47.867015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.867999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.870016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:47.872067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:47.873955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:47.874597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:48.324241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:48.336861 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0cbc3895-8b2a-4aca-9cf4-bf6573f01fe5 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1459 microversion: 2.1 time: 0.849113 Aug 30 17:26:48.342516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 183/386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:47 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1459 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:48.633410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8aa453d-0812-4eff-bd8f-69df325a772e tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:48.639869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a8aa453d-0812-4eff-bd8f-69df325a772e tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8aa453d-0812-4eff-bd8f-69df325a772e tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin] Request method failure captured: Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhXs4bnhoVjy6pB9YkQ17w4TAK4uYOsAXadWhIOx_xbtsYemPfMK2OmxMHQXf0Z6FrGWc6zWsHIJPh4fUwszDpQb30qqtKkSdUAtHFcdvQb2V_my-gjZnSXO6F5_OscIe410f_uMCqD0CbvNoMa-XfYIKwNSm3nK4gyi-VdUgD8G58 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f8f6acf8993d40cca056c8d586dd6138 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:48.655023 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f8f6acf8993d40cca056c8d586dd6138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f8f6acf8993d40cca056c8d586dd6138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f8f6acf8993d40cca056c8d586dd6138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f8f6acf8993d40cca056c8d586dd6138"}]}] Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f8f6acf8993d40cca056c8d586dd6138 Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d2d4c7f8dd2f481e8f79478f70b3bc22 Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:48.656603 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid timestamp for date invalid_time Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'invalid_time'} Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:48.657368 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 30 17:26:48.658695 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.659841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8aa453d-0812-4eff-bd8f-69df325a772e tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:48.660836 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8aa453d-0812-4eff-bd8f-69df325a772e tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841 tempest-InstanceUsageAuditLogNegativeTestJSON-1775249841-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.317127 Aug 30 17:26:48.661523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 184/387] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 30 17:26:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:26:48.669800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:48.670625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:48.686438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:48.687067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:48.687713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:48.688805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:48.690151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:48.690688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:48.715883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 HTTP/1.1 Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:48.718667 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:48.719943 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '148b8c07-241a-428b-95a6-93344b3ce4a4'} Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:48.721347 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:48.722465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:48.740854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:48.741949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b24d2246-113b-413b-9cdb-ab0d84401f27 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 404 len: 111 microversion: 2.1 time: 0.079331 Aug 30 17:26:48.743085 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 185/388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:48 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:48.748593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:48.749483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:48.762542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:48.763263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:48.763835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:48.764794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:48.777197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:48.778006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:48.968333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:48.981864 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0de059a2-a696-4139-a582-cc37b4d1d78a tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 1.137341 Aug 30 17:26:48.993325 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 204/389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:47 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:49.256050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c731f59f-8f53-4b72-bca4-3c24ea96a8b2 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.257803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c731f59f-8f53-4b72-bca4-3c24ea96a8b2 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'db986b46b4bd4999bc9243b5b2c50622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeb1cf47bd444548f2219a9c97f9c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c731f59f-8f53-4b72-bca4-3c24ea96a8b2 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Request method failure captured: Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhWrTK9zGHm_81Dqqsy1Djo3OqgUguUN3qGdMCeJoS4KUbPjBeNRAKfKTuZ-mFl3zTh-xKD_REvvmI63yxa5TJk0s-7H01xRufbVkp2F_Bb_Q84trTBhhp0bc6gqSKv_2oVEHCv7naS5-x29_mNNL12-dGrVXS0j11Dvjg4B6NJQfQ Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: baeb1cf47bd444548f2219a9c97f9c44 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.260665 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_baeb1cf47bd444548f2219a9c97f9c44"}]}] Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: baeb1cf47bd444548f2219a9c97f9c44 Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: db986b46b4bd4999bc9243b5b2c50622 Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project Aug 30 17:26:49.261896 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:49.262489 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 17:26:49.263594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.273973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c731f59f-8f53-4b72-bca4-3c24ea96a8b2 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.276976 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c731f59f-8f53-4b72-bca4-3c24ea96a8b2 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.275695 Aug 30 17:26:49.278044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 205/390] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 17:26:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:49.286095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.291241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.310447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.312124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.315131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.316617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.317246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.317818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.346133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 HTTP/1.1 Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.374374 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.375842 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '148b8c07-241a-428b-95a6-93344b3ce4a4'} Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.377311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.378567 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.382584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.389179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-449c881a-0e63-49e9-9954-419fca4c77f2 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "DELETE /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 404 len: 111 microversion: 2.1 time: 0.109705 Aug 30 17:26:49.391145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 206/391] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:49 2022] DELETE /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:49.400656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b09895c-b69c-4fd8-8758-7b684ac40a60 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.407135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b09895c-b69c-4fd8-8758-7b684ac40a60 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'db986b46b4bd4999bc9243b5b2c50622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeb1cf47bd444548f2219a9c97f9c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b09895c-b69c-4fd8-8758-7b684ac40a60 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Request method failure captured: Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2017:26:49 HTTP/1.1 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhWrTK9zGHm_81Dqqsy1Djo3OqgUguUN3qGdMCeJoS4KUbPjBeNRAKfKTuZ-mFl3zTh-xKD_REvvmI63yxa5TJk0s-7H01xRufbVkp2F_Bb_Q84trTBhhp0bc6gqSKv_2oVEHCv7naS5-x29_mNNL12-dGrVXS0j11Dvjg4B6NJQfQ Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: baeb1cf47bd444548f2219a9c97f9c44 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.410773 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/baeb1cf47bd444548f2219a9c97f9c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_baeb1cf47bd444548f2219a9c97f9c44"}]}] Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: baeb1cf47bd444548f2219a9c97f9c44 Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: db986b46b4bd4999bc9243b5b2c50622 Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project Aug 30 17:26:49.412166 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2022-08-30 17:26:49'} Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:49.412841 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 17:26:49.414413 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.415586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b09895c-b69c-4fd8-8758-7b684ac40a60 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.415586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b09895c-b69c-4fd8-8758-7b684ac40a60 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467 tempest-InstanceUsageAuditLogNegativeTestJSON-1739679467-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 17:26:49" status: 403 len: 128 microversion: 2.1 time: 0.019607 Aug 30 17:26:49.418148 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 207/392] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:26:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2017%3A26%3A49 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:49.425486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.426105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 148b8c07-241a-428b-95a6-93344b3ce4a4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.452802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.453603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.458939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.460226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.461074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.462490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.501601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 HTTP/1.1 Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.506012 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.507258 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '148b8c07-241a-428b-95a6-93344b3ce4a4'} Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.507991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. Aug 30 17:26:49.509083 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.512210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 148b8c07-241a-428b-95a6-93344b3ce4a4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.518109 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-49e119c6-56bf-475d-aff7-159e4b5685ca tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4" status: 404 len: 111 microversion: 2.1 time: 0.096848 Aug 30 17:26:49.519020 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 208/393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:49 2022] GET /compute/v2.1/servers/148b8c07-241a-428b-95a6-93344b3ce4a4 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:49.527042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.530386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.547297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.547823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.548343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.551954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.552379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.556082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.584430 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-20b62a3e-8650-4ebb-9d63-feb1d13fa977 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1612 microversion: 2.1 time: 0.839967 Aug 30 17:26:49.585030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 186/394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:48 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1612 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:49.604594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.617175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.621134 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea HTTP/1.1 Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.622717 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.624223 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2f2f5c13-81c0-4a2c-8cd0-89848289bcea'} Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.624987 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.626786 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.628153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.628153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.628324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.630756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.630756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.630986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.640092 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3246f7f-ac6d-48b1-94d6-65b409eeb3e7 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 404 len: 111 microversion: 2.1 time: 0.108526 Aug 30 17:26:49.644321 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 209/395] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:49 2022] DELETE /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:26:49.658908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.660179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] [instance: 2f2f5c13-81c0-4a2c-8cd0-89848289bcea] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.680483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.685273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.688026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.692037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.694063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.694707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.696434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:49.720229 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94a5e5a0-1ed7-429e-bf93-156abc51da85 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.117145 Aug 30 17:26:49.727558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 187/396] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:26:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:49.733328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:49.737127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.750310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] HTTP exception thrown: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Request method failure captured: Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea HTTP/1.1 Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkgSD3vecMvMo4A5kV801MQ0dD2FjECzcMknyN-YqtCaa4O5koPclcHeQ6OtUnv2zR_hfJyQJycprK7AByVnss6LG6o4R0SNM6I1XZ2_J_HSYcUwBXxVDrcqZRRvNNUUURIMBOpYaxKQdigjk6yoSDWgFvdmXoEpGxotBU3_B4uhgjA Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:49.753605 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c57f407e4b684ddf89dd95b5b61d2acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c57f407e4b684ddf89dd95b5b61d2acd"}]}] Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c57f407e4b684ddf89dd95b5b61d2acd Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-7730587 Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e4d2bbe9b4cd437492ae4bae3a4e335c Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersAdminTestJSON-7730587-project Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.755061 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2f2f5c13-81c0-4a2c-8cd0-89848289bcea'} Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.755949 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. Aug 30 17:26:49.757196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.758724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.758724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.758724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.758724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.759294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.760006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.760983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] Returning 404 to user: Instance 2f2f5c13-81c0-4a2c-8cd0-89848289bcea could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.762072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb746ea3-465d-43d5-800d-5f597dbe5156 tempest-DeleteServersAdminTestJSON-7730587 tempest-DeleteServersAdminTestJSON-7730587-project] 10.222.0.50 "GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea" status: 404 len: 111 microversion: 2.1 time: 0.116757 Aug 30 17:26:49.762892 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 210/397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:49 2022] GET /compute/v2.1/servers/2f2f5c13-81c0-4a2c-8cd0-89848289bcea => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:49.811331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Lazy-loading 'flavor' on Instance uuid fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:49.835002 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a while it is in vm_state suspended Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Request method failure captured: Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a/action HTTP/1.1 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 98 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkgi15IN0kciQ0IK6Dpm476eUOofhQUu27U5HYsHMCFi9RAO9-ifYxm8KxGY5mMqH5UJGuvPAjfmFu5kGjEdvw9pOO87GYtLOJs9p28hhfZh6dF9bGgz_EIR-nScKN6G7NCtZqLoZrwf-LW9KXHBklsFQD8OHmDkmtpLB-v1vV07TIo Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4759d139d67e4c89981be07dad372398 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:26:49.841267 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4759d139d67e4c89981be07dad372398"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4759d139d67e4c89981be07dad372398"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4759d139d67e4c89981be07dad372398"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4759d139d67e4c89981be07dad372398"}]}] Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4759d139d67e4c89981be07dad372398 Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1802303891 Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationNegativeTest-1802303891-project-admin Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 1a310b7f56604b358127ab6aa1402ac1 Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationNegativeTest-1802303891-project-admin Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": true, "disk_over_commit": false}} Aug 30 17:26:49.842752 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'os-migrateLive' instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a while it is in vm_state suspended Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a', 'body': {'os-migrateLive': {'host': 'n-h1-852771-11', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 17:26:49.843596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:49.844663 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a while it is in vm_state suspended Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a while it is in vm_state suspended Aug 30 17:26:49.847130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:49.869270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a while it is in vm_state suspended {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:49.874585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-691857fb-c8bc-4ea3-ae45-e6eb29e37050 tempest-LiveMigrationNegativeTest-1802303891 tempest-LiveMigrationNegativeTest-1802303891-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a/action" status: 409 len: 155 microversion: 2.1 time: 0.145340 Aug 30 17:26:49.877089 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 188/398] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:26:49 2022] POST /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a/action => generated 155 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:26:49.890365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:49.890903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:49.907350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.910861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.913224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.919664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:49.922385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:49.923161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:49.993304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:26:50.014504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:50.015436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:50.023463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:50.034252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:50.036777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:50.038209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:50.040069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:50.040791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:50.185796 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48922e4a-1545-4c90-8c7f-fa6a6602322b tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 204 len: 0 microversion: 2.1 time: 0.300546 Aug 30 17:26:50.186593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 211/399] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:49 2022] DELETE /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:50.197027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:50.201682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:50.215531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:50.216486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:50.219556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:50.221693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:50.222422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:50.225431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:50.582390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:50.592236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-609376d9-6b85-4d6c-b3b2-1e68b295afc7 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.581866 Aug 30 17:26:50.600147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 189/400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:50 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:50.616004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:50.631552 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-711d8ce5-82b3-499c-a21a-b3c8eace294c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1465 microversion: 2.1 time: 0.438569 Aug 30 17:26:50.634724 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 212/401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:50 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1465 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:51.629235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:51.632893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:51.657699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:51.659028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:51.659150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:51.659834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:51.662475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:51.666617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:51.670083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:51.674039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:51.674890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:51.675074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:51.675762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:51.676644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:51.677306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:51.679936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:52.417659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:52.431589 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39738e11-a477-45d5-89db-8dc6d4a81495 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1465 microversion: 2.1 time: 0.776994 Aug 30 17:26:52.435725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 213/402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:51 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1465 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:52.836470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:52.858262 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-797e6735-bb3a-4beb-a6c3-c6627e535561 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 1.234617 Aug 30 17:26:52.867326 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 190/403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:51 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:53.465318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:53.466327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:53.482902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:53.485214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:53.487741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:53.488686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:53.492072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:53.492781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:53.919896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:53.920636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:53.939792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:53.941974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:53.942460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:53.944191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:53.944663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:53.946857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:53.980787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:54.156327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:54.175132 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-728627fe-5837-4787-a126-04d569f6801a tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1423 microversion: 2.1 time: 0.715937 Aug 30 17:26:54.176570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 214/404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:53 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1423 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:54.487923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:54.616889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a", "name": "network-vif-deleted", "tag": "cc8b89da-ab1b-4549-a4a8-0a173829d9f8"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:54.681265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:54.684743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:54.685498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:54.711085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] Creating event network-vif-deleted:cc8b89da-ab1b-4549-a4a8-0a173829d9f8 for instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a on n-h2-852771-11 Aug 30 17:26:54.737795 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-fb346752-cb5e-4a15-8dbd-2cb7620246e3 req-997fd328-ef48-47cc-b195-def344b20c1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117066 Aug 30 17:26:54.741191 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 215/405] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:55.197761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:55.198454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:55.211085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:55.211863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:55.212315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:55.213027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:55.213484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:55.213913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:55.348602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:55.349118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:55.349582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:55.350042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lazy-loading 'fault' on Instance uuid fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:26:55.500309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:55.504639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:55.516087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b1a179cf-18f4-4358-96f3-6ada47e43ec8 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 200 len: 1308 microversion: 2.1 time: 0.318080 Aug 30 17:26:55.517437 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 216/406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:55 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:55.918247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:55.930512 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f8fa1dd-5cb6-4899-b3c4-5109f92b14d6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 2.014774 Aug 30 17:26:55.941532 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 191/407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:53 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:56.537814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:56.538411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:56.551470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.552011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.552494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.565521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.566374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.567012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.607803 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] HTTP exception thrown: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Request method failure captured: Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a HTTP/1.1 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkggB6SuOav1V2_1X826iFox9RYdKSbesmOvBBDrDyuiiFm3cRqGndXT8ThjImvp7jTFqY9ZsXOhF8ZlSu_AWV2ZhBAXZ6mXU3Ee6CaDOioUCMoNxZS6jHKyS2X5tPUkx0wDNqcWitYJ_-9LDddrS-mFJl18Tpx3C2VQ2zhmleOw988 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 64921ce5b0004ed284b672832f77e4c9 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:56.609711 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_64921ce5b0004ed284b672832f77e4c9"}]}] Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 64921ce5b0004ed284b672832f77e4c9 Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-LiveMigrationNegativeTest-1320550896-project Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 369e029edcc0477b9c1e123e2a30b0fc Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-LiveMigrationNegativeTest-1320550896-project Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. Aug 30 17:26:56.612212 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a'} Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:56.612904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. Aug 30 17:26:56.613984 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:56.616638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Returning 404 to user: Instance fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:56.617723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-067620a3-dabf-4189-8d15-3d5609b63b60 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a" status: 404 len: 111 microversion: 2.1 time: 0.084210 Aug 30 17:26:56.618798 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 217/408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:56 2022] GET /compute/v2.1/servers/fee91f9c-c39a-4ac9-ba82-3bf02b27aa2a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:56.627659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:56.628439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:56.644977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.645874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.646626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.647637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.648281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.648875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.703753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:26:56.814587 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9bd03eb8-ecac-409b-b663-12ac4cefb5fa tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 204 len: 0 microversion: 2.1 time: 0.190927 Aug 30 17:26:56.816006 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 192/409] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:26:56 2022] DELETE /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:26:56.824363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:56.825016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:56.838457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.838969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.839411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.840164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.840640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.841065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.958267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:56.959850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:56.980169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.980864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.981464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:56.983041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:56.986194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:56.986808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:57.128842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:57.149254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc6aff76-2d50-460c-a13e-af1dfb5cd032 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1473 microversion: 2.1 time: 0.326579 Aug 30 17:26:57.150667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 218/410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:56 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:57.488880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-312798745", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:57.573845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:26:57.662688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:57.675927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e26daac-9f6c-489d-a82e-4fe5af636e27 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.723017 Aug 30 17:26:57.676899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 193/411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:56 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:57.922198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:26:57.922672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:26:57.923904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:26:57.924553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:26:57.925330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:26:57.936968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:57.937917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:57.938593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:57.939976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:57.940633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:57.941372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:57.967875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:26:57.984185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:26:58.005373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:26:58.009418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:26:58.161001 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-779b14ec-e1a9-4092-8b29-f81458b18be5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967142 Aug 30 17:26:58.163551 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 219/412] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:26:58.175219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74cba472-9dee-4aa4-9224-a18f2e67bb87 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:58.176005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-74cba472-9dee-4aa4-9224-a18f2e67bb87 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:58.196366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:58.196993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:58.213509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:58.214346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:58.215006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:58.217118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:58.217966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:58.220867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:58.828124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-74cba472-9dee-4aa4-9224-a18f2e67bb87 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:58.836908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74cba472-9dee-4aa4-9224-a18f2e67bb87 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1212 microversion: 2.1 time: 0.666816 Aug 30 17:26:58.837494 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 194/413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:58 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1212 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:59.057834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.074787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8be7d147-9c25-4ffe-8b21-ee5676f89625 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1473 microversion: 2.1 time: 0.888784 Aug 30 17:26:59.092018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 220/414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:58 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1473 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:59.098861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.100893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:59.111375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.111932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.112797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.113980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.114658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.115930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.149560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Calling method '.version_select at 0x7f2d991e5670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.171133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.174434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.175201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.177613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.178358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.178358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.273446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2183f1c2-2f68-4165-ab7a-6492ee5f61dc tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.431102 Aug 30 17:26:59.276075 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 195/415] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:26:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:59.539073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4db7f86f-def5-497c-a43a-cc35368f6e75 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Calling method '.version_select at 0x7f2d992ce8b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.543033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4db7f86f-def5-497c-a43a-cc35368f6e75 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4db7f86f-def5-497c-a43a-cc35368f6e75 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:59.549047 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:26:59.550574 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.551496 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 17:26:59.552639 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.553750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4db7f86f-def5-497c-a43a-cc35368f6e75 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.553750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4db7f86f-def5-497c-a43a-cc35368f6e75 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.266802 Aug 30 17:26:59.563434 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 196/416] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:59.577821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6d18d0-d124-4dfe-8944-4c0e5c108233", "name": "network-vif-deleted", "tag": "d112f095-dee2-4256-99fc-5ec3124c0a66"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:59.607699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.618960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39f5916e-ee82-4c14-aba1-ba3117512519 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.525479 Aug 30 17:26:59.638758 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 221/417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:59.640697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.642103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.645782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.654203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-137bd7f3-d8a6-42a6-98f4-52bd618f4852 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Calling method '.version_select at 0x7f2d991b9d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.664151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-137bd7f3-d8a6-42a6-98f4-52bd618f4852 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-137bd7f3-d8a6-42a6-98f4-52bd618f4852 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/n-d-852771-11/reboot HTTP/1.1 Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:59.671145 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11'} Aug 30 17:26:59.672477 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.673400 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 17:26:59.674473 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.676934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-137bd7f3-d8a6-42a6-98f4-52bd618f4852 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.678009 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-137bd7f3-d8a6-42a6-98f4-52bd618f4852 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852771-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.037793 Aug 30 17:26:59.678759 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 222/418] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/n-d-852771-11/reboot => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:59.693489 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] Creating event network-vif-deleted:d112f095-dee2-4256-99fc-5ec3124c0a66 for instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 on n-h1-852771-11 Aug 30 17:26:59.706985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa042bc5-7c51-4cf4-8128-21a457fa4417 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Calling method '.version_select at 0x7f2d99202ee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.710874 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-66fb3bc6-2093-479d-9786-0cebae454c3d req-4980e84f-6829-469e-b8b8-177b2d27b277 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144098 Aug 30 17:26:59.715985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 197/419] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:59.729657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-fa042bc5-7c51-4cf4-8128-21a457fa4417 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa042bc5-7c51-4cf4-8128-21a457fa4417 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:59.734766 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hostname'} Aug 30 17:26:59.736654 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:59.737484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 17:26:59.738615 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.739721 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.742237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa042bc5-7c51-4cf4-8128-21a457fa4417 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.743619 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa042bc5-7c51-4cf4-8128-21a457fa4417 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.055277 Aug 30 17:26:59.744753 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 223/420] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:59.755733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43b37187-d973-4c43-8609-d1610580d0db tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Calling method '.version_select at 0x7f2d99222820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.758266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43b37187-d973-4c43-8609-d1610580d0db tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43b37187-d973-4c43-8609-d1610580d0db tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hosts/n-d-852771-11 HTTP/1.1 Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:59.760225 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'n-d-852771-11'} Aug 30 17:26:59.761474 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.762245 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 17:26:59.763320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.766058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43b37187-d973-4c43-8609-d1610580d0db tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.768062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43b37187-d973-4c43-8609-d1610580d0db tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852771-11" status: 403 len: 109 microversion: 2.1 time: 0.017970 Aug 30 17:26:59.771038 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 198/421] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/n-d-852771-11 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:59.783215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ca5fc70-e565-4e38-96b6-7b5b73504b48 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Calling method '.version_select at 0x7f2d991b9c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.802535 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2ca5fc70-e565-4e38-96b6-7b5b73504b48 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ca5fc70-e565-4e38-96b6-7b5b73504b48 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:59.804653 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hostname'} Aug 30 17:26:59.805853 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.806678 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.807769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.810405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ca5fc70-e565-4e38-96b6-7b5b73504b48 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.814303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ca5fc70-e565-4e38-96b6-7b5b73504b48 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035461 Aug 30 17:26:59.818893 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 224/422] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:59.824183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73ddbe4d-fe9d-46c3-a3ab-cb40cdd3079a tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Calling method '.version_select at 0x7f2d991e5f70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.826082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73ddbe4d-fe9d-46c3-a3ab-cb40cdd3079a tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73ddbe4d-fe9d-46c3-a3ab-cb40cdd3079a tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-hosts/n-d-852771-11/shutdown HTTP/1.1 Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:26:59.827825 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'n-d-852771-11'} Aug 30 17:26:59.829817 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.830625 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 17:26:59.831698 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.834187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73ddbe4d-fe9d-46c3-a3ab-cb40cdd3079a tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.845358 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73ddbe4d-fe9d-46c3-a3ab-cb40cdd3079a tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852771-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024354 Aug 30 17:26:59.846511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 199/423] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/n-d-852771-11/shutdown => generated 113 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:26:59.855074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdb9fbfe-dcec-430f-907e-1fc4a599b3f3 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Calling method '.version_select at 0x7f2d99210a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.862339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.865007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:59.885609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.886577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.887934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-bdb9fbfe-dcec-430f-907e-1fc4a599b3f3 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.888865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.889620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:59.890088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:59.890606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdb9fbfe-dcec-430f-907e-1fc4a599b3f3 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:59.904876 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hostname'} Aug 30 17:26:59.906215 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:59.907796 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 17:26:59.908881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdb9fbfe-dcec-430f-907e-1fc4a599b3f3 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bdb9fbfe-dcec-430f-907e-1fc4a599b3f3 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.055066 Aug 30 17:26:59.909887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 225/424] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:26:59.917474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56005c85-a7e4-4251-b6dc-58d1249fbdf5 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Calling method '.version_select at 0x7f2d991b9d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.919305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-56005c85-a7e4-4251-b6dc-58d1249fbdf5 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56005c85-a7e4-4251-b6dc-58d1249fbdf5 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/n-d-852771-11/startup HTTP/1.1 Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:26:59.920898 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11'} Aug 30 17:26:59.922223 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.922994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 17:26:59.924136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.935276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56005c85-a7e4-4251-b6dc-58d1249fbdf5 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.936470 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56005c85-a7e4-4251-b6dc-58d1249fbdf5 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852771-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.023148 Aug 30 17:26:59.937209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 226/425] 10.222.0.50 () {58 vars in 1194 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/n-d-852771-11/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:26:59.946290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad119b59-e5e5-4069-bc33-1eaf47a1dc53 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Calling method '.version_select at 0x7f2d99238280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:59.967704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ad119b59-e5e5-4069-bc33-1eaf47a1dc53 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad119b59-e5e5-4069-bc33-1eaf47a1dc53 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:59.971334 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hostname'} Aug 30 17:26:59.972592 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:26:59.973331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 17:26:59.974422 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:26:59.975527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.977794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad119b59-e5e5-4069-bc33-1eaf47a1dc53 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:26:59.978900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad119b59-e5e5-4069-bc33-1eaf47a1dc53 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.036449 Aug 30 17:26:59.980068 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 227/426] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:26:59.991194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-273d9292-8cf0-4db8-9d98-0c4add72d00a tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Action: 'update', calling method: .version_select at 0x7f2d991b9dc0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-273d9292-8cf0-4db8-9d98-0c4add72d00a tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-hosts/n-d-852771-11 HTTP/1.1 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 51 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:26:59.996482 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: {"status": "enable", "maintenance_mode": "invalid"} Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:26:59.997759 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance: Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:26:59.998503 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.001924 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.004528 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.004528 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:27:00.004528 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:27:00.004528 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.004528 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.006278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-273d9292-8cf0-4db8-9d98-0c4add72d00a tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:00.007382 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-273d9292-8cf0-4db8-9d98-0c4add72d00a tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852771-11" status: 400 len: 199 microversion: 2.1 time: 0.022000 Aug 30 17:27:00.008678 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 228/427] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:26:59 2022] PUT /compute/v2.1/os-hosts/n-d-852771-11 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:27:00.018473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57135eda-31f7-4a0e-9849-d89493c48087 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99210c10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57135eda-31f7-4a0e-9849-d89493c48087 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-hosts/n-d-852771-11 HTTP/1.1 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 51 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:27:00.022735 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: {"status": "invalid", "maintenance_mode": "enable"} Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:27:00.023995 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance: Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.024739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.026715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.028513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.028513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:27:00.028513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:27:00.028513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 17:27:00.028513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.031142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57135eda-31f7-4a0e-9849-d89493c48087 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:00.032830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57135eda-31f7-4a0e-9849-d89493c48087 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852771-11" status: 400 len: 189 microversion: 2.1 time: 0.018306 Aug 30 17:27:00.033968 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 229/428] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:27:00 2022] PUT /compute/v2.1/os-hosts/n-d-852771-11 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:27:00.050711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52582114-bee6-4c68-80e0-5a46e3b369f1 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Action: 'update', calling method: .version_select at 0x7f2d992b04c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:00.065281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-52582114-bee6-4c68-80e0-5a46e3b369f1 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '6f5b95d4d0af42a598172ca1209e7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b62964314b4710b02b571b2f5a281b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52582114-bee6-4c68-80e0-5a46e3b369f1 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Request method failure captured: Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-hosts/n-d-852771-11 HTTP/1.1 Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 50 Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhhUNMEY3Fmbth7xM2ipADhEc9hf77tsrifk14X2di9r8isnhH_zTjs1sytUgjX4bDb2F5rwpf7C177G2N2QzBAP7HDLPhuIw7fwJiAggu_oPQqF0E2Mx9x2OAYLYlyzsyYGG6hhgcWDb_mEdLDW-ON85JakEm4dlaRbdgg_ZQDpQI Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:27:00.068968 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2b62964314b4710b02b571b2f5a281b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2b62964314b4710b02b571b2f5a281b"}]}] Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a2b62964314b4710b02b571b2f5a281b Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687041006 Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6f5b95d4d0af42a598172ca1209e7280 Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687041006-project Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 17:27:00.070229 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:27:00.075630 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 17:27:00.077085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.078343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52582114-bee6-4c68-80e0-5a46e3b369f1 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:00.078343 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52582114-bee6-4c68-80e0-5a46e3b369f1 tempest-HostsAdminNegativeTestJSON-687041006 tempest-HostsAdminNegativeTestJSON-687041006-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852771-11" status: 403 len: 111 microversion: 2.1 time: 0.029166 Aug 30 17:27:00.078343 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 230/429] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:27:00 2022] PUT /compute/v2.1/os-hosts/n-d-852771-11 => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:00.082295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42c40675-f6ce-4005-8a78-16ae39f88cbf tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Action: 'update', calling method: .version_select at 0x7f2d991b98b0>, body: {"status": null, "maintenance_mode": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42c40675-f6ce-4005-8a78-16ae39f88cbf tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-hosts/n-d-852771-11 HTTP/1.1 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 42 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:27:00.089501 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: {"status": null, "maintenance_mode": null} Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 17:27:00.090937 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'n-d-852771-11', 'body': {'status': None, 'maintenance_mode': None}} Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance: Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi None Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.091921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.093562 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.094994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:27:00.094994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:27:00.094994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 17:27:00.094994 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.098109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42c40675-f6ce-4005-8a78-16ae39f88cbf tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:00.100333 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42c40675-f6ce-4005-8a78-16ae39f88cbf tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852771-11" status: 400 len: 127 microversion: 2.1 time: 0.023848 Aug 30 17:27:00.106485 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 231/430] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 17:27:00 2022] PUT /compute/v2.1/os-hosts/n-d-852771-11 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:27:00.114338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:00.121061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:00.137815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:00.138522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:00.140924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:00.143108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:00.146178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:00.147023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:00.240617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:00.244182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:00.244824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:00.245725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lazy-loading 'fault' on Instance uuid 9b6d18d0-d124-4dfe-8944-4c0e5c108233 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:27:00.352112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369e029edcc0477b9c1e123e2a30b0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64921ce5b0004ed284b672832f77e4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:00.362173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:00.367172 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9bf0cd1-be1c-4e92-96a4-9f8fee541d07 tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 200 len: 1309 microversion: 2.1 time: 0.259243 Aug 30 17:27:00.368016 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 232/431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:00 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:00.374504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99202040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:00.383357 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e4c87232-ad12-48cf-8930-5e9adcb218cc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1264 microversion: 2.1 time: 0.525454 Aug 30 17:27:00.384183 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 200/432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:59 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1264 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:00.392691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.hosts [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Enabling host nonexistent_hostname. Aug 30 17:27:00.417203 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Request method failure captured: Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 50 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhi1wT8Do0hvu0SxJcEwz3hwXPc-81vfu3jbx4rPPbG364jMQ2KdmM1aEn07R15Qq_p_5tgR5NYhuyIhGH4wLS0Hre8cwkeFQykxc2X2l2RZccScRM9UdMFf_-ngPMCWJyjDXbmWLlRqueqh7towIxLdfPR0ZtnAKJQ5aDErzVZoW4 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:27:00.419445 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/079f527cf73643169c498ad0b7da954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/079f527cf73643169c498ad0b7da954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_079f527cf73643169c498ad0b7da954f"}]}] Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 079f527cf73643169c498ad0b7da954f Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1790415886 Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4c23b55384cf40e1b1ae569711bce71f Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1790415886-project-admin Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:27:00.420798 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 17:27:00.421581 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:27:00.423250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 17:27:00.424501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:00.429217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:00.432970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-77bd37f0-1fc3-4b47-8c84-d3ce50a81284 tempest-HostsAdminNegativeTestJSON-1790415886 tempest-HostsAdminNegativeTestJSON-1790415886-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.063870 Aug 30 17:27:00.434099 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 233/433] 10.222.0.50 () {60 vars in 1211 bytes} [Tue Aug 30 17:27:00 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:27:00.645775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:00.646385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:00.662484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:00.669099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:00.669763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:00.676472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:00.678316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:00.680067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:01.416543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2011013696", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "555ceb67-cbe8-440f-b69e-5ec755787dff"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:01.510972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] validate_networks() for [('555ceb67-cbe8-440f-b69e-5ec755787dff', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:01.627420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:01.653664 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6398d566-b6bc-4d04-9902-135206a9ba36 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 1.013093 Aug 30 17:27:01.659445 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 201/434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:00 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:01.664936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:01.672344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] [instance: 9b6d18d0-d124-4dfe-8944-4c0e5c108233] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:01.692873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:01.700383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:01.701813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:01.704448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:01.705417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:01.709372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:01.727384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] HTTP exception thrown: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Request method failure captured: Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 HTTP/1.1 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkggB6SuOav1V2_1X826iFox9RYdKSbesmOvBBDrDyuiiFm3cRqGndXT8ThjImvp7jTFqY9ZsXOhF8ZlSu_AWV2ZhBAXZ6mXU3Ee6CaDOioUCMoNxZS6jHKyS2X5tPUkx0wDNqcWitYJ_-9LDddrS-mFJl18Tpx3C2VQ2zhmleOw988 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 64921ce5b0004ed284b672832f77e4c9 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:27:01.729082 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/64921ce5b0004ed284b672832f77e4c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_64921ce5b0004ed284b672832f77e4c9"}]}] Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 64921ce5b0004ed284b672832f77e4c9 Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1320550896 Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationNegativeTest-1320550896-project Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 369e029edcc0477b9c1e123e2a30b0fc Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationNegativeTest-1320550896-project Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. Aug 30 17:27:01.730465 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9b6d18d0-d124-4dfe-8944-4c0e5c108233'} Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:01.731152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. Aug 30 17:27:01.732488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:01.733837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] Returning 404 to user: Instance 9b6d18d0-d124-4dfe-8944-4c0e5c108233 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:01.733837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac4d5e7b-4835-47cf-9527-b968f234d47c tempest-LiveMigrationNegativeTest-1320550896 tempest-LiveMigrationNegativeTest-1320550896-project] 10.222.0.50 "GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233" status: 404 len: 111 microversion: 2.1 time: 0.070129 Aug 30 17:27:01.733837 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 202/435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:01 2022] GET /compute/v2.1/servers/9b6d18d0-d124-4dfe-8944-4c0e5c108233 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:01.739941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:01.740641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:01.748363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:01.748926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:01.749433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:01.750236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:01.751280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:01.752136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:02.531419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:02.547345 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff517163-f086-46bb-8102-e3addc46b8c7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1270 microversion: 2.1 time: 0.807452 Aug 30 17:27:02.551016 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 203/436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:01 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1270 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:02.696246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:02.696923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:02.708971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:02.709470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:02.709913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:02.710858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:02.711229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:02.711978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:03.657581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:03.668614 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-594be90d-bdd4-4a5c-9ded-737ed0782da8 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.976966 Aug 30 17:27:03.670188 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 204/437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:02 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:03.685452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:03.687650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:03.705208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:03.708041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:03.710707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:03.711733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:03.711846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:03.712282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:03.712694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:03.713372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:03.713721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:03.714154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:03.714624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:03.731510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:03.733527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:03.737541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:03.738690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:03.740050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:03.742527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:03.800664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:03.814674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for user 5fa0c244b665489ab32553dd33c47518 and project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:03.852692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:03.861693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:03.971310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0064aae6-0293-4d3e-8b3a-3842d1d38981 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886861 Aug 30 17:27:03.978213 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 234/438] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:27:03.990816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3f52808-3ff9-437b-b1da-d1c78300b1a7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:03.994002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3f52808-3ff9-437b-b1da-d1c78300b1a7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:04.129708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3f52808-3ff9-437b-b1da-d1c78300b1a7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:04.139207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3f52808-3ff9-437b-b1da-d1c78300b1a7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1211 microversion: 2.1 time: 0.159118 Aug 30 17:27:04.139867 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 235/439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:03 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1211 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:04.356679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:04.369476 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c79112e1-0a82-48a3-afa6-fc04ba5fb029 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1270 microversion: 2.1 time: 0.695837 Aug 30 17:27:04.373068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 205/440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:03 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1270 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:04.403990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a5c599-48f8-4b63-9df3-ec6cfb243ffa", "name": "network-vif-plugged", "status": "completed", "tag": "bb591b2d-4610-45fd-9701-fc99fdb603e5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:04.425917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:04.440694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:04.454132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:04.456339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:04.519051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] Creating event network-vif-plugged:bb591b2d-4610-45fd-9701-fc99fdb603e5 for instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa on n-h1-852771-11 Aug 30 17:27:04.543775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3459dab2-bc21-4f59-bfb1-762f52c4d4b0 req-808f7978-fb5c-4acf-8de4-d365458ab2a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140669 Aug 30 17:27:04.545181 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 236/441] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:04.696246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:04.697053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:04.711985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:04.715164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:04.716015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:04.724539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:04.725513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:04.726150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:05.162076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:05.163334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:05.179363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:05.180254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:05.181456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:05.182689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:05.184108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:05.184778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:05.377364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:05.389010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c6986aec-3f4a-4006-bf0d-647479497855 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1215 microversion: 2.1 time: 0.230295 Aug 30 17:27:05.392144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 237/442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:05 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:05.404077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:05.405336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:05.420192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:05.421500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:05.423440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:05.424913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:05.426153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:05.427249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:05.485484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:05.501980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2287e099-1f4c-4a8c-9f63-aab11935d311 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.810509 Aug 30 17:27:05.502538 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 206/443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:04 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:05.649908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:05.669744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b4f201d-47a8-4996-bdc8-0efc8e0a3712 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1270 microversion: 2.1 time: 0.270042 Aug 30 17:27:05.674308 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 238/444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:05 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:06.416472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:06.417019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:06.440447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:UPDATE=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:06.444023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.446396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.446866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:06.447689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.448157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.455137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:06.522840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:06.523463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:06.536530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.542660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.543401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:06.549348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.550079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.550685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:06.722657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:06.736885 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d2772ff-efc4-43b6-9b81-37ec2cd6a98e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1269 microversion: 2.1 time: 0.324002 Aug 30 17:27:06.737505 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 207/445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:06 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1269 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:06.750810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:06.751987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:06.764472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.767028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.768864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:06.770894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:06.771555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:06.773688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:07.428544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:07.436603 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ad2de85-8c32-499c-8e21-0e9c5d187204 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1323 microversion: 2.1 time: 0.917685 Aug 30 17:27:07.439415 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 239/446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:06 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1323 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:07.722855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:07.746048 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1e28a24c-1457-411a-a609-b1298ea1ab78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 1.003122 Aug 30 17:27:07.748033 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 208/447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:06 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:07.768353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:07.769002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:07.779935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:07.780665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:07.781244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:07.782885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:07.783694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:07.784327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:08.399359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a9c0514-23b1-4988-82b8-90bd4572f8dc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:08.414363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a9c0514-23b1-4988-82b8-90bd4572f8dc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.550368 Aug 30 17:27:08.425943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 209/448] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:08.427564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:08.439011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2086f13a-2a60-463e-a8e0-89d326d7eb07 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1269 microversion: 2.1 time: 0.681762 Aug 30 17:27:08.453451 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 240/449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:07 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1269 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:08.461372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:08.461987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:08.491084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:08.493021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:08.497196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:08.499644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:08.505008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:08.508239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:08.837092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:08.959683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5dd70751-cda6-4257-ad25-903832ca7208 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-14236239", "id": 2030959982, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:09.010412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5dd70751-cda6-4257-ad25-903832ca7208 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.574581 Aug 30 17:27:09.019346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 210/450] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:08 2022] POST /compute/v2.1/flavors => generated 423 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:27:09.045969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.048222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:09.066575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.069575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.070423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.071563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.073038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.073538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.213409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=21 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:09.286337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:09.304974 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85fb4d74-dc35-475e-95f7-534de55b7b31 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1473 microversion: 2.1 time: 0.847443 Aug 30 17:27:09.327246 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 241/451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:08 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1473 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:09.338561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5527f39a-6fd4-4afa-93ea-21414611acdb tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.367168 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5527f39a-6fd4-4afa-93ea-21414611acdb tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037623 Aug 30 17:27:09.375651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 242/452] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 30 17:27:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:09.389329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:09.431436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.432419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.433073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.473702 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] Creating event network-changed:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h2-852771-11 Aug 30 17:27:09.493895 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cbf8fbdf-b14a-49b1-8321-96646ad7cbb5 req-230d698e-8468-4501-9def-50431438204f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116178 Aug 30 17:27:09.497911 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 243/453] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:09.510068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.513218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:09.528666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.532596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.533416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.536931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.537633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.539201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.588954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Request method failure captured: Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa/diagnostics HTTP/1.1 Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhGCwIiA8B3-16VdlWfYRxv0W3Uz8TLU-V5S4USY0Bt7PCJrt5h3292vgsHL_NKow-BpJ0oxpOd6laOqvs05JEM9V-c_655J4JQ4l2olmg8GcXqH7YLuntsagJWVdL7m2QPnMy7MKOrSOCPabizeoXba0mgg0LeeByTVGZ0SFaVazQ Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 795f1f154dc446c09aba61d0cc914cec Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:27:09.592197 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_795f1f154dc446c09aba61d0cc914cec"}]}] Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 795f1f154dc446c09aba61d0cc914cec Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiagnosticsNegativeTest-201621785-project Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e7b320e59c4044e6b125be2a72a24df3 Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-201621785-project Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:27:09.593490 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': 'e1a5c599-48f8-4b63-9df3-ec6cfb243ffa'} Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:27:09.594223 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 17:27:09.595349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:09.600790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:09.604850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b8e942e-575b-47e2-a443-75947f11502f tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.103396 Aug 30 17:27:09.607698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 244/454] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:27:09 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa/diagnostics => generated 117 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:09.618197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fb47359-4530-4845-83a5-91b75148a0da tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-708042681", "id": 226248007, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:09.658086 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fb47359-4530-4845-83a5-91b75148a0da tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.049008 Aug 30 17:27:09.659216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 245/455] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:09 2022] POST /compute/v2.1/flavors => generated 421 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:09.670679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.675176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:09.686019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.686245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:09.687289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.688942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.691310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.692139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.694664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.700882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-289e2a9b-40ec-4e3a-8998-6268d9c503ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 0.675345 Aug 30 17:27:09.702614 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 211/456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:09 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:09.732904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.733490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:09.751039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.757694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.759100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.761433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.763667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.767277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.873908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:27:10.039584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:10.109403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5a6efb0-2e9f-4652-9f1a-c39eb4ded5b6 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 204 len: 0 microversion: 2.1 time: 0.404080 Aug 30 17:27:10.111226 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 212/457] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:27:09 2022] DELETE /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:27:10.128501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:10.134141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9e6d6ab-7678-46a2-be30-8cf64f834613 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:10.140416 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9dde9e8c-802f-490e-bc79-dfe73614c23e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1269 microversion: 2.1 time: 0.476965 Aug 30 17:27:10.147559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9e6d6ab-7678-46a2-be30-8cf64f834613 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030875 Aug 30 17:27:10.156998 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 246/458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:09 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1269 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:10.159431 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 213/459] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 30 17:27:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:10.163206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:10.164823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ee16e15-f568-4d28-93a5-e086198202fa tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Action: 'create', calling method: .version_select at 0x7f2d99342160>, body: {"keypair": {"name": "tempest-keypair-913373108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtaG05sM4PJDB2O8UzrzoFo1vgtkjcZyO4pSbn/FOIHdiYxVEAR4X82E2NY32Tj89oAB0HXB/NU77dvOHbJGqZkUWDrS0wssnaDhrcaOSbcU5/n3SKkLL0LBbROPm0dUg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:10.175918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:10.182817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.183963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.184519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.195522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6ee16e15-f568-4d28-93a5-e086198202fa tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:10.196307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.196919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.197452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.205503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6ee16e15-f568-4d28-93a5-e086198202fa tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for user 0a51e58ea5a14f9bb24a9aa9145dd831 and project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:10.257135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ee16e15-f568-4d28-93a5-e086198202fa tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096195 Aug 30 17:27:10.267425 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 214/460] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:27:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:10.633775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:10.643559 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4d7e7df-9a1a-4155-8d6d-b3f1f11e2947 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1479 microversion: 2.1 time: 0.485508 Aug 30 17:27:10.647609 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 247/461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:10 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1479 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:10.723979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:10.725029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:10.737382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.742935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.743672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.744682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.745613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.748344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.889619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99342dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:11.053745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.054318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.054776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.065329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.065824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.074836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.280298 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40bda0c4-8586-4131-ad10-babc44221cb1 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb" status: 200 len: 240 microversion: 2.36 time: 0.833822 Aug 30 17:27:11.285658 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 215/462] 10.222.0.50 () {62 vars in 1303 bytes} [Tue Aug 30 17:27:10 2022] PUT /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb => generated 240 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:11.298587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:11.302077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:11.314334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.315204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.316130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.317071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.318038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.318683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.928596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:11.940333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03f4d3cb-1cbf-4f79-8e39-c82c25143e23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.653440 Aug 30 17:27:11.945106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 216/463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:11 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:11.958842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Calling method '.version_select at 0x7f2d99222dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:11.968339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:11.982277 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cf82092-0bc5-4eca-83e7-2b7581e637e5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 1.263700 Aug 30 17:27:11.991916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 248/464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:10 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:12.006244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:12.010935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:12.019758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.022282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.022821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.026533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.027127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.029626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.287971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.288755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.289397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.291336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.292107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.292833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.318902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3cdbe784-99e7-4154-a783-b8d534d03da7 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb/detail" status: 200 len: 672 microversion: 2.36 time: 0.371116 Aug 30 17:27:12.320772 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 217/465] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 30 17:27:11 2022] GET /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb/detail => generated 672 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:12.400597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:12.417460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-458677b1-4b84-42e9-87f7-80e92115040b tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1479 microversion: 2.1 time: 0.419899 Aug 30 17:27:12.418241 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 249/466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:11 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1479 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:12.434293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Calling method '.version_select at 0x7f2d99342f70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:12.437367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.438531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.438970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.476924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.477420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.479832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.506029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.506772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.507714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.515800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3951547e-f5c0-4af1-ae4b-ac0b72270754 tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.193670 Aug 30 17:27:12.523068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 218/467] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:27:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:12.537579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Calling method '.version_select at 0x7f2d99238550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:12.539681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.540175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.540617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.570702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.571655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.572339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.587374 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c92c377-feeb-4f5f-adfe-7be499dbb18a tempest-HypervisorAdminV228Test-162664256 tempest-HypervisorAdminV228Test-162664256-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.056700 Aug 30 17:27:12.588709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 250/468] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:27:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:27:12.658932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99200b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:12.825370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.825679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.826325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.827121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.827677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.829000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.918416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.922358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.922895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.923727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.924193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.924976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.968283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:12.968939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:12.981491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.983835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.985111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.996830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.997970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.999079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:13.028537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:13.068240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d15f189-25b6-4b64-a195-f7627b7035b5 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb?user_id=ee3a143f5abb485c9009069efbb2d8e9" status: 200 len: 240 microversion: 2.36 time: 0.415664 Aug 30 17:27:13.079318 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 219/469] 10.222.0.50 () {62 vars in 1384 bytes} [Tue Aug 30 17:27:12 2022] PUT /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb?user_id=ee3a143f5abb485c9009069efbb2d8e9 => generated 240 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:13.091515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:13.102494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:13.117891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:13.119296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:13.121056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:13.122047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:13.123195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:13.126163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:13.764189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:13.789330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:13.804516 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad5862e3-a86e-4e03-99d7-207f1670f8fa tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.842925 Aug 30 17:27:13.807114 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 251/470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:12 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:13.817895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ac77caa-bf05-4d42-a3e3-263bc3609561 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] Calling method '.version_select at 0x7f2d99210700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:13.826290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:13.837890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-412eaa30-44ed-40e7-a3df-a268bd2d3573 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 0.757003 Aug 30 17:27:13.854158 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 220/471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:13 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:13.867894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:13.868505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:13.886105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:13.886785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:13.887413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:13.888314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:13.888932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:13.889518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.062044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b320e59c4044e6b125be2a72a24df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795f1f154dc446c09aba61d0cc914cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:14.077348 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d72d7741-39d9-4423-9f32-92b0aab6967e tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 200 len: 1437 microversion: 2.1 time: 0.221973 Aug 30 17:27:14.083855 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 221/472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:13 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 1437 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:14.097552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a5c599-48f8-4b63-9df3-ec6cfb243ffa", "name": "network-vif-deleted", "tag": "bb591b2d-4610-45fd-9701-fc99fdb603e5"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:14.138568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:14.147782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.148231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.150697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.205653 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] Creating event network-vif-deleted:bb591b2d-4610-45fd-9701-fc99fdb603e5 for instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa on n-h1-852771-11 Aug 30 17:27:14.213952 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f8a35d50-4cda-43dc-8a49-4cb72539cfe3 req-a12e810b-f223-48f8-8a0c-0f67261bb384 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125041 Aug 30 17:27:14.221385 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ac77caa-bf05-4d42-a3e3-263bc3609561 tempest-QuotasAdminTestV236-1487172940 tempest-QuotasAdminTestV236-1487172940-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb?user_id=ee3a143f5abb485c9009069efbb2d8e9" status: 200 len: 282 microversion: 2.36 time: 0.412910 Aug 30 17:27:14.221971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 252/474] 10.222.0.50 () {60 vars in 1364 bytes} [Tue Aug 30 17:27:13 2022] GET /compute/v2.1/os-quota-sets/59639e97fc014a2cbb2b83d4b8e50afb?user_id=ee3a143f5abb485c9009069efbb2d8e9 => generated 282 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:14.222185 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 222/474] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:14.839386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:14.847163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:14.857703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.873208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:14.882267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:14.882679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.886474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.889603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.892506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.893301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.910864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.911726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.912539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.913448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.915397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.916004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.332488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:15.340889 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-958f9eae-833b-41f4-8a10-1ae40292f993 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.512988 Aug 30 17:27:15.341572 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 253/475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:14 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:15.351541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:15.352168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] [instance: e1a5c599-48f8-4b63-9df3-ec6cfb243ffa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:15.366449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.366946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.373300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.374296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.375522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.376123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.418527 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] HTTP exception thrown: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Request method failure captured: Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa HTTP/1.1 Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhGCwIiA8B3-16VdlWfYRxv0W3Uz8TLU-V5S4USY0Bt7PCJrt5h3292vgsHL_NKow-BpJ0oxpOd6laOqvs05JEM9V-c_655J4JQ4l2olmg8GcXqH7YLuntsagJWVdL7m2QPnMy7MKOrSOCPabizeoXba0mgg0LeeByTVGZ0SFaVazQ Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 795f1f154dc446c09aba61d0cc914cec Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:27:15.420672 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/795f1f154dc446c09aba61d0cc914cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_795f1f154dc446c09aba61d0cc914cec"}]}] Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 795f1f154dc446c09aba61d0cc914cec Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-201621785 Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiagnosticsNegativeTest-201621785-project Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e7b320e59c4044e6b125be2a72a24df3 Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-201621785-project Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. Aug 30 17:27:15.421940 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e1a5c599-48f8-4b63-9df3-ec6cfb243ffa'} Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:15.422712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. Aug 30 17:27:15.425072 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:15.426682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] Returning 404 to user: Instance e1a5c599-48f8-4b63-9df3-ec6cfb243ffa could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:15.426682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0bffe6a9-7adc-4d5e-9004-c15719d00ba5 tempest-ServerDiagnosticsNegativeTest-201621785 tempest-ServerDiagnosticsNegativeTest-201621785-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa" status: 404 len: 111 microversion: 2.1 time: 0.080171 Aug 30 17:27:15.427186 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 254/476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:15 2022] GET /compute/v2.1/servers/e1a5c599-48f8-4b63-9df3-ec6cfb243ffa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:15.615646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:15.634053 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6ca82b5-57d9-4888-987b-5c4aa7cac8c2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 0.772452 Aug 30 17:27:15.643466 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 223/477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:14 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:16.254835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0", "tag": "aa64c42e-d2b6-4cfe-9ee3-615ee331a08d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:16.277466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.277949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.278386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.318085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] Creating event network-changed:aa64c42e-d2b6-4cfe-9ee3-615ee331a08d for instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 on n-h2-852771-11 Aug 30 17:27:16.337529 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f3a55fcf-2de7-48c5-b2a7-1307a63316f9 req-86154d96-3b0a-4382-98b9-e30f87daefe0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084167 Aug 30 17:27:16.349974 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 255/478] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:16.365330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:16.365948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:16.378436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.378935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.379374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.386203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.386695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.389225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.664432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:16.665627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:16.682019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.682801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.683510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.684636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.686699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.687727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.897438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:16.906473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-669419da-c095-436c-84f9-47f8fe8a6729 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.544926 Aug 30 17:27:16.916980 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 224/479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:16 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:16.923813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "name": "network-vif-plugged", "status": "completed", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:16.950957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.951684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.952224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.986559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] Creating event network-vif-plugged:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h2-852771-11 Aug 30 17:27:16.996624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-172bd41c-da51-4ce6-8112-f743f58802fd req-88d7be6d-3d07-4e5a-8238-883cea690a5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075596 Aug 30 17:27:16.997691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 225/480] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:17.252500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:17.262003 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6436cdf2-bd8e-4b5c-8fb6-4c0738478c55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 0.602207 Aug 30 17:27:17.277739 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 256/481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:16 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:17.291080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1028501147", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "226248007", "adminPass": "***", "networks": [{"uuid": "efd286dd-28fe-4870-9533-dfa9cd57bd94"}], "security_groups": [{"name": "tempest-securitygroup--1517832456"}], "key_name": "tempest-keypair-913373108", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:17.528918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] Calling method '.version_select at 0x7f2d99200b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:17.709277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40696146-c1d8-4b34-8d28-18d5a1fbc07f could not be found", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:27:17.710606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] HTTP exception thrown: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] Request method failure captured: Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-floating-ips/40696146-c1d8-4b34-8d28-18d5a1fbc07f HTTP/1.1 Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkh03qLO-67Hj8PE9cPsuFqyElJs4bdx0JzfpuAqVk_eu_gOLjRoulwF_rh0qgBAdzqidZMGMSFQRA-Upmd9Z0CzHyLS5OqHItix5QE133k8aknGVNMIaKYE_941iFc80JS3wfOUbn05q-43_EUKU6BFsuvqowThHAha5F4y2zsryfw Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9f3defa73ab94ab9948039267cdd6ecc Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-458115958 Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:27:17.726603 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f3defa73ab94ab9948039267cdd6ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f3defa73ab94ab9948039267cdd6ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f3defa73ab94ab9948039267cdd6ecc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f3defa73ab94ab9948039267cdd6ecc"}]}] Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-458115958 Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9f3defa73ab94ab9948039267cdd6ecc Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-458115958 Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-458115958-project Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a482054c9225435abdc78142e08343d4 Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-458115958-project Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: exception: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f Aug 30 17:27:17.728301 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '40696146-c1d8-4b34-8d28-18d5a1fbc07f'} Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:27:17.729251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40696146-c1d8-4b34-8d28-18d5a1fbc07f could not be found Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d4d86a4-1fea-43b0-90ed-e894ba4bfa56'] Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f. Aug 30 17:27:17.730573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:17.731940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:27:17.733367 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:27:17.733367 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f Aug 30 17:27:17.733367 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:27:17.735244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] Returning 404 to user: Floating IP not found for ID 40696146-c1d8-4b34-8d28-18d5a1fbc07f {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:17.737017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15f99418-8b42-42a7-80d3-d4a1b3e09715 tempest-FloatingIPDetailsNegativeTestJSON-458115958 tempest-FloatingIPDetailsNegativeTestJSON-458115958-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/40696146-c1d8-4b34-8d28-18d5a1fbc07f" status: 404 len: 111 microversion: 2.1 time: 0.737929 Aug 30 17:27:17.744364 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 226/482] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:16 2022] GET /compute/v2.1/os-floating-ips/40696146-c1d8-4b34-8d28-18d5a1fbc07f => generated 111 bytes in 746 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:17.938717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:17.940717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:17.956955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:17.957728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:17.958675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:17.960904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:17.961988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:17.968045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] validate_networks() for [('efd286dd-28fe-4870-9533-dfa9cd57bd94', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:17.975192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:18.476763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:18.495123 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3c804dd-2483-414a-b887-df64d003a354 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.560313 Aug 30 17:27:18.510847 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 227/483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:17 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:18.519128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:18.520070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:18.527105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:18.528546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:18.530386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:18.532694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:18.533383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:18.533972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:19.227553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:19.253459 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1e6a692-47d8-4c7c-bcd5-b6782816a9aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1312 microversion: 2.1 time: 0.738864 Aug 30 17:27:19.255464 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 228/484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:18 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1312 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:19.528116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:19.528805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:19.552225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:19.553852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:19.556018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:19.560369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:19.561146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:19.561774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.173866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:20.182828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d8e3211-41dc-43c9-ac67-d5bf039bbd93 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.667539 Aug 30 17:27:20.202494 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 229/485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:19 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:20.212733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0", "name": "network-vif-plugged", "status": "completed", "tag": "aa64c42e-d2b6-4cfe-9ee3-615ee331a08d"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:20.237867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:20.246384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.247088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.249622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.272643 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] Creating event network-vif-plugged:aa64c42e-d2b6-4cfe-9ee3-615ee331a08d for instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 on n-h2-852771-11 Aug 30 17:27:20.283215 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-95dcc18f-2993-40d8-b4dc-aad66dc144ac req-bbde3867-0a0b-4bf5-b07f-f19552bc17eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077973 Aug 30 17:27:20.284433 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 230/486] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:20.326585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:20.329170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:20.339247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.340148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.341360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.342491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.344105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.344940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.348895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:20.349365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:20.349780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:20.350834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:20.353225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:20.396336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.396823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.420175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.421337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.422304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.422755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.470018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:20.482780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for user 0a51e58ea5a14f9bb24a9aa9145dd831 and project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:20.516728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:20.520875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:20.585633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-706d678a-ea72-40c4-9dd6-8b1f8dfce972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.303328 Aug 30 17:27:20.591026 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 257/487] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:27:20.602913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ddfc6352-b477-407b-b37f-7b19649a4ad9 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:20.603779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ddfc6352-b477-407b-b37f-7b19649a4ad9 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:20.680984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:20.708403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7a74a8bf-01af-4c7b-ae0f-f4ecba472bdd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1461 microversion: 2.1 time: 0.421059 Aug 30 17:27:20.723910 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 231/488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:20 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1461 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:20.782318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ddfc6352-b477-407b-b37f-7b19649a4ad9 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:20.799311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ddfc6352-b477-407b-b37f-7b19649a4ad9 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1262 microversion: 2.1 time: 0.201123 Aug 30 17:27:20.800046 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 258/489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:20 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1262 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:21.323955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:21.324613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:21.340352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:21.340938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:21.342062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:21.346830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:21.347331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:21.349538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:21.512143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c756c36b-bbfa-4bd0-a847-e10d33f9d19c tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:21.535643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c756c36b-bbfa-4bd0-a847-e10d33f9d19c tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.539223 Aug 30 17:27:21.538343 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 259/490] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:21.557171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:21.557833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:21.577533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:21.580650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:21.581603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:21.582872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:21.583508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:21.584482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:21.852414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:21.861911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5eaf573d-6465-4d6f-9459-103ade525788 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1311 microversion: 2.1 time: 0.321413 Aug 30 17:27:21.863139 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 260/491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:21 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:21.884044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f5c8bb57-64da-43bb-8c14-6ff1f9dd1a1b tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:21.928546 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f5c8bb57-64da-43bb-8c14-6ff1f9dd1a1b tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3076 microversion: 2.1 time: 0.064085 Aug 30 17:27:21.932128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 261/492] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:27:21 2022] GET /compute/v2.1/flavors => generated 3076 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:22.066493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c423b339-c2b4-4c62-b20e-4fe3195e36d0 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1614 microversion: 2.1 time: 1.335889 Aug 30 17:27:22.068012 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 232/493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:20 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1614 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:22.076346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.078022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:22.088530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.089249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.089834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.091068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.091707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.092429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.227354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:22.242784 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c60340b3-8777-48d9-be5f-34da3d88bf35 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1314 microversion: 2.1 time: 0.172661 Aug 30 17:27:22.255649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 233/494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:22.255649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d18b569-df38-4c0e-b918-7cc34567d4b3 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.266975 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d18b569-df38-4c0e-b918-7cc34567d4b3 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017186 Aug 30 17:27:22.275338 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 234/495] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:22.279969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:22.280578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:22.287509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.289276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.289823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.290610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.291146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.291817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.339616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-680a9bb5-9c17-49cd-a05f-130d20b9feae tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] Calling method '.version_select at 0x7f2d9921faf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.397172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '43cf6f2d2713464d8d47151e01e3f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eac69eb4d6248dca7cd2e4b5eda6894', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:22.397780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] flavor_id is None. Assuming migration. {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 17:27:22.398564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 17:27:22.609100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:22.639539 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a4791d6-103b-43f4-94cf-3f8dbfd9cd88 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab/action" status: 202 len: 0 microversion: 2.1 time: 0.363082 Aug 30 17:27:22.641077 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 235/496] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:22 2022] POST /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:27:22.646129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab26c682-7e9c-4daf-b554-84dc04be081f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.657125 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab26c682-7e9c-4daf-b554-84dc04be081f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014656 Aug 30 17:27:22.658042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 236/497] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:22.662692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.663555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:22.671509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.672234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.672876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.673796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:22.674914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:22.675588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:22.733931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-680a9bb5-9c17-49cd-a05f-130d20b9feae tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 6073 microversion: 2.1 time: 0.797127 Aug 30 17:27:22.735125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 262/498] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:21 2022] GET /compute/v2.1/os-networks => generated 6073 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:22.743868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98cc9133-e05a-488b-9151-15eac8cce13d tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.788853 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98cc9133-e05a-488b-9151-15eac8cce13d tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.052406 Aug 30 17:27:22.790059 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 263/499] 10.222.0.50 () {58 vars in 1165 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:22.809923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9db39442-9565-4177-812a-98a9e607f2b6 tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] Calling method '.version_select at 0x7f2d991ca700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:22.952348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:23.052488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=26 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:23.085695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9db39442-9565-4177-812a-98a9e607f2b6 tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/9d91e91d-ceae-4a13-8796-14f36688b03f" status: 200 len: 652 microversion: 2.1 time: 0.294378 Aug 30 17:27:23.090027 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 264/500] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/os-networks/9d91e91d-ceae-4a13-8796-14f36688b03f => generated 652 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:23.091271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c22dbd1-e8c9-4196-9b03-9cff400f515f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.111830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c22dbd1-e8c9-4196-9b03-9cff400f515f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024021 Aug 30 17:27:23.112451 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 265/501] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:23.118774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.118774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:23.132557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:23.133342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:23.134561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:23.136009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:23.137048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:23.137920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:23.745479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:23.752840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:23.758346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f538bd26-b505-453a-856b-05732882d0fb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1494 microversion: 2.1 time: 0.644831 Aug 30 17:27:23.759556 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 266/502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:23 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1494 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:23.762780 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cda3d643-e5f3-499d-a774-c574a2dc3a26 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1470 microversion: 2.1 time: 1.103410 Aug 30 17:27:23.763341 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 237/503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:22 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1470 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:23.766092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-310f4103-914e-40f3-b6a9-05b233494904 tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] Calling method '.version_select at 0x7f2d991e2ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.771455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ec4d77d-e77c-4cf0-bc08-0997e00b8355 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.837126 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ec4d77d-e77c-4cf0-bc08-0997e00b8355 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.065771 Aug 30 17:27:23.851198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 238/504] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 30 17:27:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:23.859229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.865039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:23.872096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:23.873764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:23.874459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:23.875405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:23.876157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:23.878768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:23.992078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:24.002965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d379738-01c8-414a-aa25-81e84240ad68 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1320 microversion: 2.1 time: 0.147702 Aug 30 17:27:24.004021 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 239/505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:23 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.174233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-310f4103-914e-40f3-b6a9-05b233494904 tempest-NetworksTest-202481407 tempest-NetworksTest-202481407-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 6063 microversion: 2.1 time: 0.413614 Aug 30 17:27:24.174995 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 267/506] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:23 2022] GET /compute/v2.1/os-networks => generated 6063 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.184579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3ca6677-a78a-4a7f-8857-3e74be7eecf6 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.215193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3ca6677-a78a-4a7f-8857-3e74be7eecf6 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038962 Aug 30 17:27:24.225263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 268/507] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.231928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65ffff00-88e1-4409-b4ca-f523a8d3ae8f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.262884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65ffff00-88e1-4409-b4ca-f523a8d3ae8f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034628 Aug 30 17:27:24.263093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.267655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:24.268071 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 269/508] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.276983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20e9fa44-6d23-415d-9562-ece0523755bc tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.277448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:24.278181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:24.278891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:24.288103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:24.289816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:24.293810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:24.375171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20e9fa44-6d23-415d-9562-ece0523755bc tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.101048 Aug 30 17:27:24.390354 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 270/509] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:24.396460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d583a56e-a47d-4e90-80c2-5e03fe9c4d7f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.407848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d583a56e-a47d-4e90-80c2-5e03fe9c4d7f tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015913 Aug 30 17:27:24.415761 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 271/510] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.421304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35a8180c-d82a-4900-9b75-a364a0eeb474 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.455328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35a8180c-d82a-4900-9b75-a364a0eeb474 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038030 Aug 30 17:27:24.468240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 272/511] 10.222.0.50 () {58 vars in 1144 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.475399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f7c60a-97c4-4b98-98e8-1b7656e2efc3 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.490968 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37f7c60a-97c4-4b98-98e8-1b7656e2efc3 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019403 Aug 30 17:27:24.501468 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 273/512] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.518278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54bd9ddb-cfb8-46e4-bb9b-c3f8c0012a80 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.580469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54bd9ddb-cfb8-46e4-bb9b-c3f8c0012a80 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.077778 Aug 30 17:27:24.584564 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 274/513] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.603778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46740ad0-49e8-4f04-bb3f-190c191b8a86 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.649500 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46740ad0-49e8-4f04-bb3f-190c191b8a86 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.047149 Aug 30 17:27:24.658693 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 275/514] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.663682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-317edd2f-141f-4491-a975-fa6815fbf726 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.682429 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-317edd2f-141f-4491-a975-fa6815fbf726 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022444 Aug 30 17:27:24.683791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 276/515] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:24.705293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87bd8919-3c43-4f0b-b83b-418c4e7a4ce9 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.739033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:24.752966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87bd8919-3c43-4f0b-b83b-418c4e7a4ce9 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.058407 Aug 30 17:27:24.770578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 277/516] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.782450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7799a02a-8766-4ec1-bb7e-0c47e4bb6699 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.816934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7799a02a-8766-4ec1-bb7e-0c47e4bb6699 tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.044696 Aug 30 17:27:24.818475 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 278/517] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.823722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:24.825057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:24.835178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:24.836127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:24.846736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:24.849477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:24.851562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:24.852399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:24.943768 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-502851c6-f7f2-4190-9bfb-5ac099f8eac8 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1647 microversion: 2.1 time: 0.922403 Aug 30 17:27:24.944527 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 240/518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1647 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:24.986065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be5caf77-ae06-4ebb-9702-d120801cf8df tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:25.024668 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be5caf77-ae06-4ebb-9702-d120801cf8df tempest-FlavorsV2TestJSON-540418693 tempest-FlavorsV2TestJSON-540418693-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.057840 Aug 30 17:27:25.026854 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 241/519] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:25.052843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:25.057409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:25.083134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.083668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.084108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.086741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.088733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.091245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.720328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:25.738004 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6de1954-4156-402a-ba60-7d1ca106842a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1470 microversion: 2.1 time: 0.917017 Aug 30 17:27:25.740233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 279/520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:24 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1470 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:25.751950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:25.752876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:25.771588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.772827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.773523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.776078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.777517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.778493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.819225 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4521558f-334d-4840-bb34-c7d43c992d35 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1647 microversion: 2.1 time: 0.779954 Aug 30 17:27:25.820912 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 242/521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:25 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1647 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:25.848248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:25.852320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.854279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.854889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.856323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.858906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.862553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.918509 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9e2bb4b-977c-43f0-9f86-6e343f7bff6f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.074164 Aug 30 17:27:25.919815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 243/522] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:27:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:25.931138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:25.934063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:25.949660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.950850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.951440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:25.952426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:25.953597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:25.956600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:26.017565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lazy-loading 'flavor' on Instance uuid 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:27:26.077394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Going to try to live migrate instance to n-h1-852771-11 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:27:26.779819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:26.794320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b06fa8b-0882-4a13-975c-f6fad783573a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 1.051519 Aug 30 17:27:26.810810 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 280/523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:25 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:26.830871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:26.831844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:26.850083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:26.867173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:26.883596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:26.885155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:26.885837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:26.886628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:27.939268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:27.954167 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-521f7b47-c994-4aca-8fc1-33694f6ad2b6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1470 microversion: 2.1 time: 1.138455 Aug 30 17:27:27.954982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 281/524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:26 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1470 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:27.974327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:27.983613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:28.003306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:28.003825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:28.004483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:28.005383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:28.005919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:28.006339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:28.466714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:28.477284 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-662702e8-7ed6-45b5-8fd8-d99554c08702 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.506668 Aug 30 17:27:28.478799 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 282/525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:27 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:28.974543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:28.975840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:28.990423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:28.992342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:28.993392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:28.995289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:29.005596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:29.012492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:29.242021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b6ea68b-9993-4a46-8f5d-1c29e433e062 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0/action" status: 202 len: 0 microversion: 2.1 time: 3.314217 Aug 30 17:27:29.243194 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 244/526] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:25 2022] POST /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0/action => generated 0 bytes in 3316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:27:29.262234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:29.264011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:29.297581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:29.298267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:29.301560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:29.303639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:29.305317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:29.317805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:29.708263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:29.716261 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8495729c-1092-474d-856a-99473244a3cd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1470 microversion: 2.1 time: 0.745632 Aug 30 17:27:29.716849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 283/527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:28 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1470 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:29.747296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:29.748226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:29.756652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:29.760094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:29.760982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:29.764174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:29.765375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:29.768071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:29.906702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:29.915104 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f093ffd3-1ac9-49c8-81a5-a1ced8497466 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.666430 Aug 30 17:27:29.930839 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 245/528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:29 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:30.024897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf9533d-17d8-4ce7-a6e9-c836b390ff62", "tag": "6a145938-980b-4307-9e56-fd34e6e4b171"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:30.041251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:30.041742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:30.042179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:30.072613 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] Creating event network-changed:6a145938-980b-4307-9e56-fd34e6e4b171 for instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 on n-h1-852771-11 Aug 30 17:27:30.083358 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-657d3bee-6419-478c-b5eb-665947d87998 req-7307a547-70a6-4685-9385-b87446b372bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062596 Aug 30 17:27:30.084598 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 246/529] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:27:30.433349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:30.444324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c89cfd0-d3fa-49bd-a942-44562a983bd3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.708955 Aug 30 17:27:30.460047 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 284/530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:29 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:30.738353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:30.744128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:30.746405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:30.756955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:30.757870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:30.758607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:30.759729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:30.760919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:30.761564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:30.798970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:30.941120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1455638162", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:31.035882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:31.292839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:31.303577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b25b51f-543d-4f63-bb93-563fc25056d9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.565562 Aug 30 17:27:31.320676 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 285/531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:30 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:31.485486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:31.485950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:31.486612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:31.487844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:31.488413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:31.503177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:31.506004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:31.506636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:31.508943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:31.511620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:31.512243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:31.532674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:31.538484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:31.554019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:31.557585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:31.656116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2443193d-bc38-4495-a679-8529f998df85 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457574 Aug 30 17:27:31.661669 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 247/532] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:27:31.669739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:31.672267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:31.687763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:31.694021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:31.694624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:31.696121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:31.698805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:31.699545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:31.789635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1832850489", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:31.903327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:32.135757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:32.150252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ab02acb-1ad4-4fcd-8c1f-063da57ae43b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.486969 Aug 30 17:27:32.167620 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 248/533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:31 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:32.186208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:32.188024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:32.204485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.205030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.207733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.208915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.209366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.209820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.442280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:32.450235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:32.451035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:32.452882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:32.453987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:32.490795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.491409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.492014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.493004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.493681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.494654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.526334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Getting quotas for project aa3f513c850349eb87e82b932f0c6f5d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:32.533459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Getting quotas for user 0245e8dbeef340c29fe8aee66243e417 and project aa3f513c850349eb87e82b932f0c6f5d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:32.550756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:32.553278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:32.614294 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ba95dc6-bf0e-44b0-ab6b-4ae33af538fe tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292194 Aug 30 17:27:32.622264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 286/534] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:27:32.628101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:32.628727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:32.638554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.639048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.639624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.640905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.641717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.642550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.781295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:32.788874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:32.793575 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-742a6e7c-93b3-4897-8c2a-14445212b66e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1221 microversion: 2.1 time: 0.170144 Aug 30 17:27:32.811725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 287/535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:32 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:32.811858 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6f0df7a-44ac-4e2c-972f-95f6548465e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.628968 Aug 30 17:27:32.811944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0", "name": "network-vif-unplugged", "status": "completed", "tag": "aa64c42e-d2b6-4cfe-9ee3-615ee331a08d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:32.819588 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 249/536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:32 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:32.831354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:32.834514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:32.841781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.842519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.843962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.845032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.845352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:32.846278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.846917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.848286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:32.850258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:32.884039 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] Creating event network-vif-unplugged:aa64c42e-d2b6-4cfe-9ee3-615ee331a08d for instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 on n-h2-852771-11 Aug 30 17:27:32.898104 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-479ea865-7d67-46df-81e5-a9647a03a6c5 req-cac8e205-2816-4146-92e0-25ce89d75a5d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096260 Aug 30 17:27:32.899048 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 288/537] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:32.914965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0767cf5d-1a06-48b6-ae9d-db02af7e2e24 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d99122af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:33.031079 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0767cf5d-1a06-48b6-ae9d-db02af7e2e24 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4" status: 200 len: 637 microversion: 2.1 time: 0.124008 Aug 30 17:27:33.032085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 289/538] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:27:32 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4 => generated 637 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:33.050097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-74300f9e-005f-4e04-8d51-8b93c380da11 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:33.050928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-74300f9e-005f-4e04-8d51-8b93c380da11 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:33.273576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-74300f9e-005f-4e04-8d51-8b93c380da11 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:33.297068 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-74300f9e-005f-4e04-8d51-8b93c380da11 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1217 microversion: 2.1 time: 0.260688 Aug 30 17:27:33.297983 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 290/539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:33 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:33.308699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ccdc1c1e-35a6-49ea-bf19-cf956f538865 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d9924eca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:33.413272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ccdc1c1e-35a6-49ea-bf19-cf956f538865 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:33.428969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ccdc1c1e-35a6-49ea-bf19-cf956f538865 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:33.459623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:33.471967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3b4926e-d092-4ed1-89a8-ce010440e5a6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.650633 Aug 30 17:27:33.474183 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 250/540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:32 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:33.491705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:33.492590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:33.513651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:33.514141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:33.514742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:33.515462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:33.515947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:33.516383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:33.908789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:33.921598 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-935de7e6-b9a0-4b4a-8f1e-e24289f9de7c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.445599 Aug 30 17:27:33.940815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 251/541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:33 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:33.974017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ccdc1c1e-35a6-49ea-bf19-cf956f538865 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.673717 Aug 30 17:27:33.980138 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 291/542] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:33 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:33.990822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:33.991889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:33.999840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.000690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.001501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.002458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.003787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.004559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.126202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1c1d29fe-15cc-440e-812b-e83a519d15bd tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] Calling method '.version_select at 0x7f2d9909a280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.152023 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1c1d29fe-15cc-440e-812b-e83a519d15bd tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.208209 Aug 30 17:27:34.157030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 252/543] 10.222.0.50 () {60 vars in 1226 bytes} [Tue Aug 30 17:27:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:34.168868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.169944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:34.178479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:34.182608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.185997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.187020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.187981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.189098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.189715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.193862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8fef4d0c-0d71-4c08-8f60-a88e1a7408af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1213 microversion: 2.1 time: 0.209562 Aug 30 17:27:34.200209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 292/544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:33 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:34.223453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7065066-12ae-449a-90cd-25873ee58726 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d9924ef70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.580509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:34.594475 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b92e502-6d70-4241-8042-1c6a61a76014 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.435317 Aug 30 17:27:34.595786 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 253/545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:34 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:34.604342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-38aa53bf-c85d-4aa8-b6db-2c35a16dc6a2 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] Action: 'update', calling method: .version_select at 0x7f2d98fe40d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:34.619051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7065066-12ae-449a-90cd-25873ee58726 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "DELETE /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.401737 Aug 30 17:27:34.626082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 293/546] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 30 17:27:34 2022] DELETE /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_version => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:27:34.631392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.632273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:34.640764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.641412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.642299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.643293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.644005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.644651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.747436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:34.758622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0da3aa2-3b36-4c00-a078-7311c7083241 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1269 microversion: 2.1 time: 0.131365 Aug 30 17:27:34.759210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 294/547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:34 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:34.777342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.781200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:34.794305 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-38aa53bf-c85d-4aa8-b6db-2c35a16dc6a2 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.197023 Aug 30 17:27:34.794916 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 254/548] 10.222.0.50 () {62 vars in 1247 bytes} [Tue Aug 30 17:27:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:34.798397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.801432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.803237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.804793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:34.805614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57c22547-4297-4658-bd2f-29d2283c98a2 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d98fe48b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.807885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:34.808439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:34.839666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:34.884764 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57c22547-4297-4658-bd2f-29d2283c98a2 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 37 microversion: 2.1 time: 0.082524 Aug 30 17:27:34.890809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 255/549] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:34 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 37 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:34.897690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51974c6a-5178-4bdb-8c91-70f91e0510e3 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] Calling method '.version_select at 0x7f2d99200940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:34.929733 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-51974c6a-5178-4bdb-8c91-70f91e0510e3 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.041568 Aug 30 17:27:34.939006 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 256/550] 10.222.0.50 () {60 vars in 1226 bytes} [Tue Aug 30 17:27:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:34.949703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee67d3c3-b5d9-4f86-acf1-d30a44ffd14e tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d99126dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:35.051512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ee67d3c3-b5d9-4f86-acf1-d30a44ffd14e tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:35.071305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ee67d3c3-b5d9-4f86-acf1-d30a44ffd14e tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:35.291616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:35.323256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce7a6267-0815-4178-9c66-632d1fbf3e6b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.556783 Aug 30 17:27:35.326190 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 295/551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:34 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:35.339843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf8b17a1-298d-4ca1-a686-df85850115d8 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99210a60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:35.499668 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf8b17a1-298d-4ca1-a686-df85850115d8 tempest-QuotaClassesAdmin257Test-1535307255 tempest-QuotaClassesAdmin257Test-1535307255-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.167294 Aug 30 17:27:35.503803 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 296/552] 10.222.0.50 () {62 vars in 1247 bytes} [Tue Aug 30 17:27:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:35.511721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:35.515814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:35.530939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.531777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.532423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.533334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.534510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.536665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.652209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee67d3c3-b5d9-4f86-acf1-d30a44ffd14e tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712275 Aug 30 17:27:35.652832 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 257/553] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:34 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:35.657454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0", "tag": "aa64c42e-d2b6-4cfe-9ee3-615ee331a08d"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:35.667034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=7 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:35.682863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.683300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.683937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.716208 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] Creating event network-changed:aa64c42e-d2b6-4cfe-9ee3-615ee331a08d for instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 on n-h2-852771-11 Aug 30 17:27:35.722366 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3227f183-1010-4daa-83e3-a51d0602bbad req-68a004cf-9f46-49b3-b06c-46618cb01e3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068115 Aug 30 17:27:35.723617 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 258/554] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:35.731009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:35.733952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:35.743620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.744677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.746214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.747372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.748032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.748625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.883177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:35.892474 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12d89af5-4c25-4a61-b0d0-4bf4a88ecc11 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1275 microversion: 2.1 time: 0.167409 Aug 30 17:27:35.911277 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 259/555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:35 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:35.917035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:35.918156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:35.943432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.944366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.946220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:35.947216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:35.954443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:35.957669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:36.122097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:36.137025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-acfa111c-5700-4bd9-b5cf-e67dbccd8b79 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.631842 Aug 30 17:27:36.137635 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 297/556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:35 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:36.154214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9671edac-822e-481f-b28b-c266a71fc940 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d99122ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:36.223603 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9671edac-822e-481f-b28b-c266a71fc940 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.084701 Aug 30 17:27:36.224104 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 298/557] 10.222.0.50 () {58 vars in 1290 bytes} [Tue Aug 30 17:27:36 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_distro => generated 33 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:36.245877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:36.246659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:36.261441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:36.262223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:36.262868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:36.263811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:36.265319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:36.266990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:36.447323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:36.456983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5b7f06b-6f79-482e-8cde-879bbfdc6362 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1275 microversion: 2.1 time: 0.226994 Aug 30 17:27:36.458273 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 299/558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:36 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:36.464164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-666d18e7-62eb-4ca1-b70e-b7a5f9694669 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d9921f940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:36.528854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-666d18e7-62eb-4ca1-b70e-b7a5f9694669 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:36.536277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-666d18e7-62eb-4ca1-b70e-b7a5f9694669 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:36.683418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:36.685753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:36.706822 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a7ce484-d773-4aa8-abce-d2a861496767 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.807889 Aug 30 17:27:36.707769 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 260/559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:35 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:36.724241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:36.724978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:36.734888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:36.735209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:36.735672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:36.739127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:36.739901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:36.740371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:36.758533 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-666d18e7-62eb-4ca1-b70e-b7a5f9694669 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.298876 Aug 30 17:27:36.765291 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 300/560] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:36 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:36.770466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0939243-45e8-4913-aaa9-4fbb6d660212 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d9921faf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:36.840096 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0939243-45e8-4913-aaa9-4fbb6d660212 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.073042 Aug 30 17:27:36.847952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 301/561] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:36 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:36.854656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1576f8c4-7900-4a6d-8243-d4fdbf5b1e86 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d99122f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:36.918797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1576f8c4-7900-4a6d-8243-d4fdbf5b1e86 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:36.926325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1576f8c4-7900-4a6d-8243-d4fdbf5b1e86 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:37.099453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:37.110107 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29975646-07c1-45aa-a771-c7049a833a78 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.401181 Aug 30 17:27:37.119521 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 261/562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:36 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:37.122335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:37.125766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:37.147888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.148416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.148865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.149798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.150256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.150685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.205781 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1576f8c4-7900-4a6d-8243-d4fdbf5b1e86 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.356092 Aug 30 17:27:37.206507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 302/563] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:36 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:37.214159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf9533d-17d8-4ce7-a6e9-c836b390ff62", "name": "network-vif-plugged", "status": "completed", "tag": "6a145938-980b-4307-9e56-fd34e6e4b171"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:37.248461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.249588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.250785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.290173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] Creating event network-vif-plugged:6a145938-980b-4307-9e56-fd34e6e4b171 for instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 on n-h1-852771-11 Aug 30 17:27:37.303341 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-062f90fc-eb24-430f-9384-1b92a150bfda req-b465ef31-50b6-4d7e-86cc-30281de676e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092542 Aug 30 17:27:37.303341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 303/564] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:37.316410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:37.319852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:37.327900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:37.334911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.336392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.336848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.338968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.342551 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83414573-1399-4d63-a083-ee05263118b8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1275 microversion: 2.1 time: 0.227507 Aug 30 17:27:37.344459 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 262/565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:37 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:37.346002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.346642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.353391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4396e3d7-a7a4-4b95-a424-191d8c6804c0 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d9909a8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:37.444178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4396e3d7-a7a4-4b95-a424-191d8c6804c0 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:37.452097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4396e3d7-a7a4-4b95-a424-191d8c6804c0 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:37.876231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:37.884202 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9520e0f1-ed39-4ab2-a069-4f1515775f9a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.580718 Aug 30 17:27:37.884757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 304/566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:37 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:37.898872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:37.899580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:37.919106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.919620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.920237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.921506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.922112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.922686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.929995 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4396e3d7-a7a4-4b95-a424-191d8c6804c0 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.583899 Aug 30 17:27:37.930862 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 263/567] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:37 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 64 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:37.948379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:37.949690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:37.967975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.968864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.970494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.972961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.974161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.975274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:38.106087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:38.143671 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dea9f4f7-1917-4417-8e18-dfa020252592 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1275 microversion: 2.1 time: 0.251337 Aug 30 17:27:38.146305 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 305/568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:37 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:38.166806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8da415b-649e-452b-b1c3-eed3085aeabc tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d990dc1f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:38.182109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:38.193109 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6cc889bf-d894-4ec4-86be-e232d4472fcf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1388 microversion: 2.1 time: 0.260979 Aug 30 17:27:38.208679 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 264/569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:37 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1388 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:38.213575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:38.214202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:38.220588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:38.221071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:38.221506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:38.222224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:38.222651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:38.223267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:38.246048 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8da415b-649e-452b-b1c3-eed3085aeabc tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.092661 Aug 30 17:27:38.247316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 306/570] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:38 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 64 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:38.265240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-092510c5-3ee6-4cac-83fe-c639ab82e75f tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d99122dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:38.322527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:38.333236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-092510c5-3ee6-4cac-83fe-c639ab82e75f tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:38.340588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-092510c5-3ee6-4cac-83fe-c639ab82e75f tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:38.865236 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-092510c5-3ee6-4cac-83fe-c639ab82e75f tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.611384 Aug 30 17:27:38.866071 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 307/571] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:38 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 17:27:38.875272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:38.876019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:38.885105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:38.886431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:38.887638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:38.888920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:38.891013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:38.892048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:38.968821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:38.992635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-768acd51-c1d4-4b6d-a9a5-72c8b294af18 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.782106 Aug 30 17:27:39.010244 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 265/572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:38 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:39.021081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a3a250f0-282c-4551-a4d2-93c8e015fa93 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update', calling method: .version_select at 0x7f2d99023af0>, body: {"meta": {"os_version": "alt"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:39.148597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a3a250f0-282c-4551-a4d2-93c8e015fa93 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:39.169418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a3a250f0-282c-4551-a4d2-93c8e015fa93 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:39.468092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:39.489777 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f64dddd7-c04f-415b-a8df-5e7f30b33840 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.621963 Aug 30 17:27:39.489777 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 308/573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:38 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:39.497186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:39.503846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:39.540076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.542760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.543922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:39.544942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.546655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.547331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:39.739467 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a3a250f0-282c-4551-a4d2-93c8e015fa93 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.727716 Aug 30 17:27:39.741646 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 266/574] 10.222.0.50 () {60 vars in 1313 bytes} [Tue Aug 30 17:27:39 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata/os_version => generated 31 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:39.753794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:39.754370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:39.771161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.773631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.774201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:39.776187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.778532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.778897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.341315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:40.352885 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a3c8141-c224-4df8-881c-6ab3781a690f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.861869 Aug 30 17:27:40.359885 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 309/575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:39 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:40.372475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:40.374196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:40.393840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.394577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.395275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.396226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.396840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.397585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.550676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:40.565985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ebe78539-8088-4994-8217-b8b32c5c0a7a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.816760 Aug 30 17:27:40.582515 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 267/576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:39 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:40.582515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cbaee8ae-1c8b-4b4b-bed4-b82dd156f504 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d990dd310>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:40.692338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cbaee8ae-1c8b-4b4b-bed4-b82dd156f504 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 58 microversion: 2.1 time: 0.116174 Aug 30 17:27:40.694253 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 268/577] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:40 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 58 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:40.707348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:40.710080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:40.739161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.739877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.743171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.744358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.746344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.748967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:41.289009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:41.308648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-431662c2-7a52-4b3c-8c00-3bd784573e14 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1588 microversion: 2.1 time: 0.945864 Aug 30 17:27:41.309791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 310/578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:40 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1588 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:41.324207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:41.325102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:41.332205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:41.337686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:41.338316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:41.339207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:41.339958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:41.340542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:41.521279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:41.634508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:41.648863 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c56c4be-3064-4ea6-831c-52bee5faaf9c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.947500 Aug 30 17:27:41.657764 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 269/579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:40 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:41.673774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3cacc895-2ff0-46bc-97a2-502ce8e1a070 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'update_all', calling method: .version_select at 0x7f2d990324c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:41.779597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3cacc895-2ff0-46bc-97a2-502ce8e1a070 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:41.791663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3cacc895-2ff0-46bc-97a2-502ce8e1a070 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:42.295329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:42.310300 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9d463dbd-d604-4c51-9fb6-4d93cde4d3fb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.999169 Aug 30 17:27:42.310923 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 311/580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:41 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:42.320326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:42.320816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:42.333502 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3cacc895-2ff0-46bc-97a2-502ce8e1a070 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.673357 Aug 30 17:27:42.339783 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 270/581] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:27:41 2022] PUT /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 61 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:42.352452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:42.353973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:42.355374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.355906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.356339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.357049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.357631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.358768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.376851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.377325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.377783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.378530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.379891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.380073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.506431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:42.580332 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4cf76980-76b0-48f6-af7b-36277711aa5c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263643 Aug 30 17:27:42.581421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 312/582] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:27:42 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:42.586233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:42.589250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:42.601507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.603857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.604461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.606253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.606900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.607505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.024938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:43.036358 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4e336d7-c96a-47b4-a769-2e57031fc9e8 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.453144 Aug 30 17:27:43.048859 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 313/583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:42 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:43.056574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:43.067979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.068728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.069329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.082323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] Creating event network-changed:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:27:43.087574 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-179a37bb-5d54-485e-896b-cb9921b498e5 req-66d9c796-a2c5-4c88-bff2-e42d6652d372 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035936 Aug 30 17:27:43.088183 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 314/584] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:43.093805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9183a320-35f4-48a4-b255-6ef9b39b5670 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Action: 'create', calling method: .version_select at 0x7f2d99122040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:43.154178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9183a320-35f4-48a4-b255-6ef9b39b5670 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:43.167064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9183a320-35f4-48a4-b255-6ef9b39b5670 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Getting quotas for user e7d990f8baac48a18d5385c202602d7a and project df1eef25ac8446b98f3357bfdd3dde53. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:43.204378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:43.230869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c6c7636-93c3-4399-98b6-7fb13bce60bf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.885738 Aug 30 17:27:43.232436 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 271/585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:42 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:43.258600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:43.261568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:43.285916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.286608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.290438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.291994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.292609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.293183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.617999 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9183a320-35f4-48a4-b255-6ef9b39b5670 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "POST /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.528434 Aug 30 17:27:43.618845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 315/586] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 30 17:27:43 2022] POST /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 85 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:43.786272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:43.789989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.790473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.790916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.791699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.792156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.792582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.820741 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30d9a723-a0ef-4f75-a12a-541136a1c6e9 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.200272 Aug 30 17:27:43.821338 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 316/587] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:43 2022] GET /compute/v2.1/os-services => generated 949 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:43.835743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f469e743-c50d-4bb3-bfe5-12c224de8f51", "tag": "fe8f1ab1-2040-4da8-8fc8-62d5ad4de583"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:43.853134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.853616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.854049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.866787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] Creating event network-changed:fe8f1ab1-2040-4da8-8fc8-62d5ad4de583 for instance f469e743-c50d-4bb3-bfe5-12c224de8f51 on n-h1-852771-11 Aug 30 17:27:43.872873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0a2ef265-05f9-4765-8dd8-7ce2245486fd req-5daab07b-1685-441c-ae0c-60158e98f92f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049560 Aug 30 17:27:43.874055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 317/588] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:43.879265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:43.880287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:43.884248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:43.895790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1dc7af3-bdc5-4839-becd-229341eeb5ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.661314 Aug 30 17:27:43.896495 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 272/589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:43 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:43.910539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.911833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.912500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.912948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c050f2ec-d44a-4025-8dcf-1235b838a557 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] Calling method '.version_select at 0x7f2d99342670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:43.913623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:43.914301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:43.914914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.976205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c050f2ec-d44a-4025-8dcf-1235b838a557 tempest-ImagesMetadataTestJSON-1418241920 tempest-ImagesMetadataTestJSON-1418241920-project] 10.222.0.50 "GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.077601 Aug 30 17:27:43.977898 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 273/590] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:27:43 2022] GET /compute/v2.1/images/22c3ac1c-2b7b-4f63-aa17-47858e37d9d4/metadata => generated 85 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:43.995440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.004609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.009814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.010401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.018864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.019629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.020172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.074045 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9760d14a-5aa8-4a51-bc6b-b659468f5a25 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852771-11" status: 200 len: 581 microversion: 2.1 time: 0.094645 Aug 30 17:27:44.079468 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 274/591] 10.222.0.50 () {58 vars in 1174 bytes} [Tue Aug 30 17:27:43 2022] GET /compute/v2.1/os-services?host=n-d-852771-11 => generated 581 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:44.086118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.087034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:44.094436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.095263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.096165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.097072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.098099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.098848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.168464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:44.179131 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2691981-6ce4-4dc8-9960-dca1e9cb5d9d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.303718 Aug 30 17:27:44.181559 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 318/592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:43 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:44.198465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.203068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.204021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.204639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.205541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.206215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.206773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.239788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7a247f7-12fd-40e9-b009-b5d670270796 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056981 Aug 30 17:27:44.240971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 319/593] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:44.254930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.258563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.259098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.259615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.261639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.262112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.262546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.299118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e588462-9420-406a-8e16-4abce6fc7133 tempest-ServicesAdminTestJSON-1624742632 tempest-ServicesAdminTestJSON-1624742632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.047692 Aug 30 17:27:44.300352 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 320/594] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:44.309380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.314092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:44.320386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.321076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.321706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.323188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.323870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.324513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.781020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:44.794848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35297b71-af92-43e1-9d20-ca5373776f8c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1504 microversion: 2.1 time: 0.490909 Aug 30 17:27:44.795461 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 321/595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:44.919118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.919881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:44.933149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.933934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.934959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.944404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.945048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.945563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.041521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:45.051797 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-748eb098-5085-48b9-a335-05b41910f817 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.969962 Aug 30 17:27:45.068707 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 275/596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:45.205695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:45.206942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:45.228069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.230020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.230454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.234223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.235717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.236934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.344512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:45.354514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a805e9cb-910e-4fb0-94ed-0f2b759dc25b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.441033 Aug 30 17:27:45.361754 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 322/597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:45.760708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:45.772207 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0b91d0a-bbfa-42cf-b01f-c66fed3f8b5f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.573375 Aug 30 17:27:45.773024 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 276/598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:45 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:45.816899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:45.818042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:45.824590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.825080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.829232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.829232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.829232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.829232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.029030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:46.039767 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4855c218-09cc-4a3e-a0a0-b4c7435d5bed tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1494 microversion: 2.1 time: 0.226544 Aug 30 17:27:46.041084 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 323/599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:45 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1494 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:46.062475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8815b569-425b-4a10-9d1b-bd3eeacdc08c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '.version_select at 0x7f2d98fe4e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.066008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8815b569-425b-4a10-9d1b-bd3eeacdc08c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.066659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8815b569-425b-4a10-9d1b-bd3eeacdc08c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.067768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8815b569-425b-4a10-9d1b-bd3eeacdc08c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.081587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.082073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:46.090565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.091056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.091505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.092933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.099547 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8815b569-425b-4a10-9d1b-bd3eeacdc08c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 799 microversion: 2.1 time: 0.040903 Aug 30 17:27:46.108718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.109521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.112534 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 277/600] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/os-migrations => generated 799 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:46.132802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.133517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:46.143528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.144019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.144450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.145143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.146008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.146432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.154152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:46.759496 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e561a4d6-b418-43b0-bb61-aeea9677e90b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1647 microversion: 2.1 time: 0.645002 Aug 30 17:27:46.760545 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 278/601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1647 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:46.767975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.769080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:46.783366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.784370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.785017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.785985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.788655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.793084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.795204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:46.803869 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a7504c2c-17a4-4c4f-a0aa-a2e8e2fda645 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.730516 Aug 30 17:27:46.804460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 324/602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:46.833975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf9533d-17d8-4ce7-a6e9-c836b390ff62", "tag": "6a145938-980b-4307-9e56-fd34e6e4b171"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:46.873671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.879950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.883550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.902466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] Creating event network-changed:6a145938-980b-4307-9e56-fd34e6e4b171 for instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 on n-h1-852771-11 Aug 30 17:27:46.925538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-09b35116-292a-46ac-9bc9-af4774817406 req-fd30b4ae-e738-4aa5-8409-ecce7bff484b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119875 Aug 30 17:27:46.926940 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 325/603] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:46.933558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.941513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:46.963379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.968641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.970356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.972399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.974454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.975187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.246563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:47.262499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c67698db-a082-4a81-9426-5cb6cf23ed5f tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 200 len: 1588 microversion: 2.1 time: 0.498892 Aug 30 17:27:47.262499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 279/604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 1588 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:47.271321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:47.271971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:47.303731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:47.304838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:47.306384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.311723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:47.312258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:47.312963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.488886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:47.500444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56ef8815-1619-424f-a863-e1720f106355 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1475 microversion: 2.1 time: 0.572135 Aug 30 17:27:47.501250 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 326/605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1475 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:47.513134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-400484205", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "555ceb67-cbe8-440f-b69e-5ec755787dff"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:47.617449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] validate_networks() for [('555ceb67-cbe8-440f-b69e-5ec755787dff', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:48.062636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:48.080087 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19ad27d6-5419-449f-9b50-0be4a45f1996 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.817492 Aug 30 17:27:48.083155 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 280/606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:47 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:48.103445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:48.103445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:48.113900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.114417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.114863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.117697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.118196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.118636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.745735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:48.746573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:48.750239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:48.750941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:48.753433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:48.794246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.795219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.796535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.803782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.804460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.806017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.863468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:48.894599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for user 5fa0c244b665489ab32553dd33c47518 and project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:48.946850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:48.947324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:48.952065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:48.959606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8db83ab-8047-461c-84e2-dd63a239e3c9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.875144 Aug 30 17:27:48.960626 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 281/607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:48 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:48.972525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:48.973578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:48.989941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.991292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.992807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.995092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.996790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.998226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.060424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ac22689-b1f3-4853-beef-a0b27b6be745 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557923 Aug 30 17:27:49.063842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 327/608] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:27:49.076439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7240693-07a9-4ed0-a647-e452d49ce3a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:49.078429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7240693-07a9-4ed0-a647-e452d49ce3a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:49.552493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7240693-07a9-4ed0-a647-e452d49ce3a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:49.556777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:49.569545 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c46de337-460b-4b51-8a52-8ff4274ba945 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1474 microversion: 2.1 time: 0.606988 Aug 30 17:27:49.571829 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7240693-07a9-4ed0-a647-e452d49ce3a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1210 microversion: 2.1 time: 0.499608 Aug 30 17:27:49.573449 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 328/609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:49 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1210 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:49.577774 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 282/610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:48 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1474 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:49.588059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "name": "network-vif-unplugged", "status": "completed", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:49.595057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:49.596191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:49.609610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:49.610093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:49.610515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.614920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:49.615412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:49.619526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.620817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:49.625860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:49.626987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.644644 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Creating event network-vif-unplugged:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h1-852771-11 Aug 30 17:27:49.674413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:27:49.710017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-bf9c5e7c-dff5-44e4-9ab4-c8e1132ac8fb req-d4e4b2c2-6533-4ad3-a4ce-b356559f60b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127608 Aug 30 17:27:49.712906 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 283/611] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:49.983104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:49.983986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:50.011089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.011656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.012106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.014180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.014646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.015072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.025726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:50.552076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:50.584311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8cdeb49e-e521-46a1-bbc4-87d5e2d4547e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 1.005953 Aug 30 17:27:50.584951 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 329/612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:49 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:50.632168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:50.633539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:50.640196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.640913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.641531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.642254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.642717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.656399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.764908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:50.781875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a2907c0-74f9-4fbd-9447-23cc0a8c47a0 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.803987 Aug 30 17:27:50.785923 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 284/613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:49 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:50.798658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:50.799430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:50.815384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.815936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.820986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.821981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:50.822621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:50.823206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:50.987203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:50.997050 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-874a5760-439d-441c-a571-cab10a81edcc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1474 microversion: 2.1 time: 0.375288 Aug 30 17:27:50.997643 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 330/614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:50 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:51.128948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:51.149186 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7eec6633-0f8d-4ae7-80aa-e8b0e74d852c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1262 microversion: 2.1 time: 0.357327 Aug 30 17:27:51.149830 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 285/615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:50 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1262 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:51.173119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f469e743-c50d-4bb3-bfe5-12c224de8f51", "name": "network-vif-plugged", "status": "completed", "tag": "fe8f1ab1-2040-4da8-8fc8-62d5ad4de583"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:51.207301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.208645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.213077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.265645 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] Creating event network-vif-plugged:fe8f1ab1-2040-4da8-8fc8-62d5ad4de583 for instance f469e743-c50d-4bb3-bfe5-12c224de8f51 on n-h1-852771-11 Aug 30 17:27:51.294569 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-02e3ba92-ff38-4dd0-8da9-24e4a9f6632b req-cb0ce243-afcd-4e00-b12d-6cee2e7e8974 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109082 Aug 30 17:27:51.295289 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 286/616] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:51.318677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.323210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.324182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.324819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.327360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.328118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.328729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.371873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d2f6866-e0df-4dd4-92fe-82600332194a tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.373141 Aug 30 17:27:51.373597 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 331/617] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:50 2022] GET /compute/v2.1/os-services => generated 949 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:51.389694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.398323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.401185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.403639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.406543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.408902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.409882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.456535 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e29be6a-0a02-4de4-8941-47a4c10bc110 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.074315 Aug 30 17:27:51.457745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 287/618] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:51.473390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.478087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.478775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.479453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.480414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.481207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.481864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.511170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16ef49f9-dc9c-45dd-8b32-b1b32caf72d4 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.043008 Aug 30 17:27:51.512459 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 332/619] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:51.524579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.528328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.528877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.531532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.532481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.533570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.535035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.589225 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-889135d2-fcac-4dea-8337-bb0594d3e41d tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852771-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.068376 Aug 30 17:27:51.590146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 288/620] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services?host=n-d-852771-11&binary=xxx => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 17:27:51.602839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.605470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.606196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:51.606505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.606994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.611063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.612241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.614873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.615364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.615789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.616004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.616602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.616765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.617221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.617644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.679218 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-77399762-85a1-4b96-b84a-de9d97e7e6de tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.080484 Aug 30 17:27:51.689644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 333/621] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:51.694932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.701233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.701899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.702501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.703406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.704261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.704870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.741772 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-abcd73b4-b474-4da1-8f0b-66271dbf7732 tempest-ServicesAdminNegativeTestJSON-1988014769 tempest-ServicesAdminNegativeTestJSON-1988014769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.050545 Aug 30 17:27:51.742404 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 334/622] 10.222.0.50 () {58 vars in 1198 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:27:51.814258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:51.934843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f8bcfc3-7d8b-4781-9488-1302ba017513 tempest-ServicesAdminNegativeTestJSON-873971453 tempest-ServicesAdminNegativeTestJSON-873971453-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:51.939406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f8bcfc3-7d8b-4781-9488-1302ba017513 tempest-ServicesAdminNegativeTestJSON-873971453 tempest-ServicesAdminNegativeTestJSON-873971453-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9a5ebd2e45fb4e078671b937592809a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484ba9bc59444fbaa40b23261a4c4e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f8bcfc3-7d8b-4781-9488-1302ba017513 tempest-ServicesAdminNegativeTestJSON-873971453 tempest-ServicesAdminNegativeTestJSON-873971453-project] Request method failure captured: Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkiV-47V7Mu6ckVGkGohJOv6f3IQPKBoM_AcHNjoKc1jGSTz_O7cZQV9t6VKvKdXbgoHK_GbB3rlrEhM1rXZyNfsdvYDdv3M4gekYa9TG3PjK-ta5Wo4GW5xD05ByrgURABQCeyDpXb5z50zdNcj0jxdfMB8z3Ul3bveaNvRqyPqgZg Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 484ba9bc59444fbaa40b23261a4c4e96 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-873971453 Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:27:51.941561 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/484ba9bc59444fbaa40b23261a4c4e96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/484ba9bc59444fbaa40b23261a4c4e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/484ba9bc59444fbaa40b23261a4c4e96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_484ba9bc59444fbaa40b23261a4c4e96"}]}] Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-873971453 Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 484ba9bc59444fbaa40b23261a4c4e96 Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-873971453 Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServicesAdminNegativeTestJSON-873971453-project Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 9a5ebd2e45fb4e078671b937592809a1 Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-873971453-project Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:27:51.942914 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:27:51.943753 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:27:51.946261 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:27:51.948845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f8bcfc3-7d8b-4781-9488-1302ba017513 tempest-ServicesAdminNegativeTestJSON-873971453 tempest-ServicesAdminNegativeTestJSON-873971453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:51.948845 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f8bcfc3-7d8b-4781-9488-1302ba017513 tempest-ServicesAdminNegativeTestJSON-873971453 tempest-ServicesAdminNegativeTestJSON-873971453-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.189623 Aug 30 17:27:51.948845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 335/623] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/os-services => generated 112 bytes in 191 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:51.950034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:51.961732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.962495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.963063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.977917 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Creating event network-changed:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h1-852771-11 Aug 30 17:27:51.993435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:27:52.009713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f45de508-b62f-498f-9aa1-bc79b39d795f req-ec777c62-80b8-4e8b-8829-8241386299ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064622 Aug 30 17:27:52.012683 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 336/624] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:52.019902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:52.027428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:52.032075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:52.037781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.038463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.039054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.039945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.040588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.041194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.319180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:52.328525 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1bf5e7f7-8207-4a6c-b9eb-f3d8ed9a5590 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1317 microversion: 2.1 time: 0.726160 Aug 30 17:27:52.329808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 289/625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:51 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:52.334822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:52.335856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:52.343234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.343876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.344541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.345619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.346287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.346990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.459080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:52.472954 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b73301a9-4fd4-41c6-9ad8-91d8515165e6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.454110 Aug 30 17:27:52.473785 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 337/626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:52 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:52.480963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:52.483327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:52.508557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.514424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.515959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.519875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:52.521913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:52.522458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:52.646996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:52.663408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4924136b-d2d2-4a84-b817-0a944fe919c9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1268 microversion: 2.1 time: 0.186330 Aug 30 17:27:52.667845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 338/627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:52 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:52.853572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:52.867338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9de1693-8352-4939-b5ad-67b75af1c86b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1474 microversion: 2.1 time: 0.536181 Aug 30 17:27:52.872536 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 290/628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:52 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:53.351447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:53.352491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:53.360924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.361151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-plugged", "status": "completed", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:53.363238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.363937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.365035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.365982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.366632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.380742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.384057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.384537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.408624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] Creating event network-vif-plugged:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:27:53.421038 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8286aac5-505d-4514-8e44-e34e2666e8de req-578c5fce-ac29-4c5c-acff-070ab4f4a0f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064741 Aug 30 17:27:53.423715 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 291/629] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:53.495830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:53.496541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:53.509699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.510480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.511079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.515310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.516216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.516999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.707179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:53.723256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7728a357-c26e-4efe-bd11-947cf587a5ff tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1467 microversion: 2.1 time: 0.374563 Aug 30 17:27:53.723908 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 339/630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:53 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1467 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:53.752299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:53.752912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:53.759402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.760133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.760716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:53.761601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:53.762049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:53.762466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:54.021353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:54.031668 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66b4fed2-afab-43a4-a76b-e874f49898a4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 0.540748 Aug 30 17:27:54.032813 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 292/631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:53 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:54.100546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:54.111469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd476657-d1d9-4c14-885d-cf0ea75dcd24 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.364817 Aug 30 17:27:54.112875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 340/632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:53 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:54.162987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:54.166978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:54.197328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:54.200424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:54.201823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:54.208620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:54.211238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:54.212842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:54.315645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:54.316514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:54.327716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:54.330828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:54.331446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:54.332574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:54.333185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:54.334597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:54.878249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:54.889977 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-992f0ccd-959d-451a-ae59-0abc7dc9f8b3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1472 microversion: 2.1 time: 0.775660 Aug 30 17:27:54.906488 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 341/633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:54 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1472 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:54.914000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf96994-a6ac-4549-8ba3-d002fd4b1110", "tag": "1bb6904e-a9ec-49c6-b728-e8ee4971db77"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:54.970507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:54.975445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:54.976382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:55.032341 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] Creating event network-changed:1bb6904e-a9ec-49c6-b728-e8ee4971db77 for instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 on n-h2-852771-11 Aug 30 17:27:55.063985 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d3b07f0f-65e6-4c78-b3c9-c3a05a0a91ef req-75ae8f17-89be-40d0-b245-9cea9af92d33 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152292 Aug 30 17:27:55.067018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 342/634] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:55.083213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:55.086731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:55.104643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:55.108078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:55.111703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:55.112656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:55.115945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:55.116599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:55.487165 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12283b19-5efa-4412-84c7-f65929bd3237 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1620 microversion: 2.1 time: 1.453104 Aug 30 17:27:55.499886 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 293/635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:54 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1620 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:55.518104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:55.518737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:55.541521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:55.541927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:55.542366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:55.543097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:55.552607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:55.553242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:56.108917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:56.121339 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-60bf3a05-531c-4519-8683-307341366dab tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.617546 Aug 30 17:27:56.135893 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 294/636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:55 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:56.174965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: .version_select at 0x7f2d98f84790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2092450397", "policies": ["affinity"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:56.218374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:56.225184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:56.229609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:56.422634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:56.438223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:56.464915 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35f3e4d5-31f1-4917-a187-c415cc173974 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.327721 Aug 30 17:27:56.480204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 295/637] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 30 17:27:56 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:56.491941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:56.501075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:56.512865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:56.514177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:56.519178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:56.520180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:56.520821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:56.521918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:56.575011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:56.603383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb6f6a8c-c2b5-49b6-97a2-dd7f21eea063 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1317 microversion: 2.1 time: 1.534278 Aug 30 17:27:56.619942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 343/638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:55 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1317 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:56.817079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-802713868", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b324eccc-1358-4ed4-8dea-2d5a19cfe003"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:57.033798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:27:57.387569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:57.402676 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9188c068-e374-4211-b585-f3677b8abde3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1469 microversion: 2.1 time: 0.916693 Aug 30 17:27:57.405813 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 296/639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:56 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1469 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:57.412342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:57.413708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:57.442920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.443929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.444583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.446991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.448700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.449395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.742347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:57.743609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:57.744530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:57.744938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:57.745390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:57.808893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.809320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.810767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.811802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.814617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.815239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.834517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:57.851540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ea0e7bf-bc78-4a4a-945d-9891fa53a86e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.444355 Aug 30 17:27:57.857330 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 297/640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:57 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:57.869439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:57.871422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:57.902748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.903373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:57.904154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.909911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.912234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:57.912874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:57.915677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:57.919666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:57.966786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 2 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:57.976864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:58.072736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122124) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 17:27:58.094861 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b6889c1-f8ec-4c50-8430-ce4f84f6ebf6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab/action" status: 204 len: 0 microversion: 2.1 time: 0.235948 Aug 30 17:27:58.095888 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 298/641] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:57 2022] POST /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab/action => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:27:58.114937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:58.117223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:58.150185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:58.151148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:58.152629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:58.153271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:58.157137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:58.157888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:58.160047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:58.177923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:58.374445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:58.392862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:58.431768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=95e414bb-ae04-4825-9c15-eadea2d0af60,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:58.545965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:58.553318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:58.740069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:58.758378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:58.876161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bca7e513-b320-49bf-bbdc-991f188980be tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.064722 Aug 30 17:27:58.885236 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 344/642] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 2075 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 17:27:58.910345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:58.911175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:58.957267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:58.957781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:58.958225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:58.969904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:58.970411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:58.970858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:59.186556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:59.199499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75378a46-a039-4ca2-b17b-897858dd25a7 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1466 microversion: 2.1 time: 1.102062 Aug 30 17:27:59.202989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 299/643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:58 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1466 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:59.212360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:59.215356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:59.233734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:59.240583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:59.242153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:59.243112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:59.244072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:59.244656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:59.846550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:59.862500 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eca753a8-ea3b-4ae0-9c82-816bea1bb6fa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1469 microversion: 2.1 time: 0.975977 Aug 30 17:27:59.876073 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 345/644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:58 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1469 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:59.889425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:59.911360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:59.912181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Searching by: {'deleted': False, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:27:59.941171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:59.950257 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2cb0f0f-060c-478d-9fe2-b3cfb626d0a9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.745975 Aug 30 17:27:59.954336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 300/645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:59 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:59.968989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-767781971", "metadata": {"image_type": "test"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:59.974455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:59.990741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:59.992137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:59.994642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:59.995670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:59.996165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:59.999262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:00.022696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:00.023233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:00.025223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:00.026051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:00.031630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:00.032191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:00.162326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Getting quotas for project aa3f513c850349eb87e82b932f0c6f5d. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:00.188021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Getting quotas for user 0245e8dbeef340c29fe8aee66243e417 and project aa3f513c850349eb87e82b932f0c6f5d. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:00.365864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:28:00.633054 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf93d0ff-b164-4bd7-8227-8c3cb92413fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.753473 Aug 30 17:28:00.633593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 346/646] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:27:59 2022] GET /compute/v2.1/servers => generated 1002 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:00.660755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c209af86-d0f6-492e-a3ae-685d1dd53358 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:00.661415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c209af86-d0f6-492e-a3ae-685d1dd53358 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:00.667535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:00.741604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e8a4e957-609e-40fa-8fc2-a231ee32d5d4 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "POST /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f/action" status: 202 len: 0 microversion: 2.1 time: 0.784324 Aug 30 17:28:00.751846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 301/647] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:59 2022] POST /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:28:00.758281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ba7b30c1-f185-480b-876d-22d0f609c51d tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d990ddf70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:00.900132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c209af86-d0f6-492e-a3ae-685d1dd53358 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:00.902824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=61 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:00.909830 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ba7b30c1-f185-480b-876d-22d0f609c51d tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.139370 Aug 30 17:28:00.910493 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 302/648] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:00 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:00.927213 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c209af86-d0f6-492e-a3ae-685d1dd53358 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1218 microversion: 2.1 time: 0.278948 Aug 30 17:28:00.930045 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 347/649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:00 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:00.961439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:00.962307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:00.987642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:00.988961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:00.989084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:00.991046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:00.991983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:00.992742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:00.996873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:01.000153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:01.006073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:01.007717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:01.008171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:01.014721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:01.015285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:01.015778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:01.361901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:01.372122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41e65538-beb4-42d2-8680-cb4ede177b85 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.391753 Aug 30 17:28:01.382969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 348/650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:00 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:01.546693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:01.759278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:01.782865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea9c333c-1225-4096-82fc-ed760e891857 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1469 microversion: 2.1 time: 0.861521 Aug 30 17:28:01.793600 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 303/651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:00 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1469 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:01.932751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c19328a-76c5-4567-96dd-4be67fb6b2a6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d99106550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:01.957262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:01.958223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:01.968456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:01.972698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:01.974982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:01.977627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:01.978322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:01.978972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:02.020006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c19328a-76c5-4567-96dd-4be67fb6b2a6 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.093853 Aug 30 17:28:02.031002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 349/652] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:01 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:02.058865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "name": "network-vif-plugged", "status": "completed", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:02.107046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:02.108381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:02.109877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:02.132071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:02.136943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Creating event network-vif-plugged:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h1-852771-11 Aug 30 17:28:02.158033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:28:02.179648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3178b1b0-249a-464b-a36b-ecdd7381ddeb req-c5b61b2f-d5dc-44f6-8e4a-ae871e5b4766 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123859 Aug 30 17:28:02.180956 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 350/653] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:02.197627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:02.235041 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b84a6e34-f0e6-48c9-9e52-816b9a54c092 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1270 microversion: 2.1 time: 0.280509 Aug 30 17:28:02.237453 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 304/654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:01 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:02.407373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:02.409428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:02.435379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:02.451448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:02.454637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:02.464285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:02.468666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:02.472078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:02.811801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:02.813211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:02.827092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:02.828348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:02.830500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:02.831543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:02.837675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:02.838789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:03.017856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:03.034670 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb290f1c-2e60-4e60-8073-f18e885f6585 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 0.634810 Aug 30 17:28:03.049462 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 351/655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:02 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:03.065620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60638a7e-b593-45ab-bda2-f49d418ecaea tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d99058820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:03.140686 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60638a7e-b593-45ab-bda2-f49d418ecaea tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.087124 Aug 30 17:28:03.147101 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 352/656] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:03 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:03.266315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:03.266906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:03.279681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:03.281604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:03.282346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:03.283016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:03.283984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:03.284649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:03.293255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:03.415288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:03.427506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a74f7d3-8546-4bc8-b03a-0b7018246fdb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1276 microversion: 2.1 time: 0.164985 Aug 30 17:28:03.433972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 353/657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:03 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:03.611806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:03.628438 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a27cf73-6a10-479e-947d-93804a2d580a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1469 microversion: 2.1 time: 0.821067 Aug 30 17:28:03.631242 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 305/658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:02 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:04.074455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:04.076561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:04.099779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.101732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.121970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:04.121970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.121970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.121970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:04.163290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ce8cd4b-7d7d-4217-8641-45385dd47da5 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f58dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:04.308902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ce8cd4b-7d7d-4217-8641-45385dd47da5 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.152751 Aug 30 17:28:04.326818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 306/659] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:04 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:04.465839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:04.467181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:04.480569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.482087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.491950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:04.493283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.496404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.497222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:04.833512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:04.858569 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4c5c93b-8cc4-462a-9d0a-5b345e1af696 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1276 microversion: 2.1 time: 0.390474 Aug 30 17:28:04.858569 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 307/660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:04 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1276 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:04.888868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:04.890247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:04.930533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.933473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.934191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:04.938304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:04.944218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:04.947062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:05.237998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:05.254311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee789e6f-33e0-4ef1-a017-77c9fbfcc765 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 1.183482 Aug 30 17:28:05.289198 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 354/661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:04 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:05.339017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85846fd3-5a81-441d-9c6f-ebc0e63d9447 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d99097700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:05.455996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85846fd3-5a81-441d-9c6f-ebc0e63d9447 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.126428 Aug 30 17:28:05.467193 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 355/662] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:05 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:05.875890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:05.886597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:05.887221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:05.895406 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1891b2aa-907f-4a8b-b908-801dc215fddb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1461 microversion: 2.1 time: 1.036197 Aug 30 17:28:05.896029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 308/663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:04 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1461 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:05.905679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:05.912233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:05.912929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:05.913973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:05.914591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:05.919468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:05.927594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:05.928518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:05.949270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:05.950985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:05.952024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:05.956131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:05.957603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:05.958282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:06.452615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:07.311412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a93c839b-f0e7-4d35-8f86-bbdedd4bec9a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1614 microversion: 2.1 time: 1.387759 Aug 30 17:28:07.353015 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 309/664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:05 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1614 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:07.378517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf96994-a6ac-4549-8ba3-d002fd4b1110", "name": "network-vif-plugged", "status": "completed", "tag": "1bb6904e-a9ec-49c6-b728-e8ee4971db77"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:07.402625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:07.403306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:07.404565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:07.430592 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] Creating event network-vif-plugged:1bb6904e-a9ec-49c6-b728-e8ee4971db77 for instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 on n-h2-852771-11 Aug 30 17:28:07.446628 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b915515d-d556-4b02-9122-429cfa6ed380 req-aa352152-e546-4cfa-a317-b23718224b24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076257 Aug 30 17:28:07.451564 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 310/665] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:07.463408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:07.464555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:07.480038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:07.480819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:07.482175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:07.490837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:07.491810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:07.492480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:07.751881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:07.763224 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2ed49ec-fed9-42eb-bc62-40685c06bd30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1318 microversion: 2.1 time: 1.880259 Aug 30 17:28:07.763805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 356/666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:05 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1318 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:07.790352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6f8ed2c-92b9-4a0f-8851-5164839fd3ff tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f68280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:07.880786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6f8ed2c-92b9-4a0f-8851-5164839fd3ff tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1423 microversion: 2.1 time: 0.101617 Aug 30 17:28:07.881695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 357/667] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:07 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:07.888704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa4f642f-9dba-4b9b-beaa-fe995e3373e2 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '.version_select at 0x7f2d98f198b0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:07.900656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa4f642f-9dba-4b9b-beaa-fe995e3373e2 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:07.909007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa4f642f-9dba-4b9b-beaa-fe995e3373e2 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:07.909853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa4f642f-9dba-4b9b-beaa-fe995e3373e2 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:07.936380 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa4f642f-9dba-4b9b-beaa-fe995e3373e2 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.053226 Aug 30 17:28:07.939314 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 358/668] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:28:07 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:08.203318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-604996276", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:08.352640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:08.478282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:08.492441 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b602f05-a28e-438b-a7d3-09c36125c2de tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1310 microversion: 2.1 time: 1.039270 Aug 30 17:28:08.495675 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 311/669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:07 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1310 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:08.794825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:08.796189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:08.811180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:08.817725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:08.821985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:08.826849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:08.830686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:08.831472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:08.891275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:08.892689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:08.893408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:08.894587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:08.895338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:08.914859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:08.915845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:08.916533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:08.917553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:08.919665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:08.921638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:08.976170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:08.993899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:09.047901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:09.053912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:09.182585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3a34e8ca-4e8a-47f3-9d6d-d5308fcfef2f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985646 Aug 30 17:28:09.193466 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 359/670] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:28:09.205455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc4568c0-e7c4-4f69-94c7-1d88ed5238ae tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f190d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:09.572945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:09.593550 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1869f287-cdd6-4122-8709-4fa4a8c059aa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1318 microversion: 2.1 time: 0.799856 Aug 30 17:28:09.596262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 312/671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:08 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:10.129376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-891810265", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "761babee-31fe-4fa1-8591-541df7f3d7a0"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:18.934816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=22 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:18.936712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=30 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:19.025985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:19.114669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:19.578942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:20.171206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:25.961398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc4568c0-e7c4-4f69-94c7-1d88ed5238ae tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1432 microversion: 2.1 time: 16.771371 Aug 30 17:28:25.970598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 360/672] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:09 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1432 bytes in 16773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:25.973120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] validate_networks() for [('761babee-31fe-4fa1-8591-541df7f3d7a0', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:25.981164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e414bb-ae04-4825-9c15-eadea2d0af60", "tag": "c1b941bb-ed7a-4fdf-95de-0b3b287b2301"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:26.011235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:26.014107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:26.014704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:26.037450 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] Creating event network-changed:c1b941bb-ed7a-4fdf-95de-0b3b287b2301 for instance 95e414bb-ae04-4825-9c15-eadea2d0af60 on n-h2-852771-11 Aug 30 17:28:26.045649 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bbe2ca92-06ed-4eb5-97e8-5867fb1b52be req-e8093eb2-e9b9-458f-a48e-2c78bb2b0e7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080968 Aug 30 17:28:26.046807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 361/673] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:26.053037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:26.054481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:26.067921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:26.069213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:26.070201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:26.071168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:26.073248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:26.073866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:26.442541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:26.454621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67ab5a1e-c4a1-4dd8-9b08-718e39f58b6d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1312 microversion: 2.1 time: 0.406288 Aug 30 17:28:26.461060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 362/674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:26 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:26.468303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:26.472474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:26.542225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:26.546653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:26.548109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:26.548966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:26.555143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:26.556831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.039593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:27.055568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4f98857-aca5-4c7c-b032-aa37759807b6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1493 microversion: 2.1 time: 0.592995 Aug 30 17:28:27.058049 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 363/675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:26 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1493 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:27.071916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847aa5c3-3996-466d-acab-f7319e82318b", "tag": "0df21985-7e53-4ea0-a50b-cb0bbbbc24d5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:27.097754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.102752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.103417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.140127 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] Creating event network-changed:0df21985-7e53-4ea0-a50b-cb0bbbbc24d5 for instance 847aa5c3-3996-466d-acab-f7319e82318b on n-h2-852771-11 Aug 30 17:28:27.146450 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cd4d956f-7b8a-47e6-a203-1d3604220583 req-237f1c0e-c3f1-4b00-a2bd-1584ef7fb940 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083551 Aug 30 17:28:27.147703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 364/676] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:27.177370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:27.184160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:27.204934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.205643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.206778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.209438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.211404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.212485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.686408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:27.686964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:27.687281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:27.687782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:27.688189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:27.704769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:27.706978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.709365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.710205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.711006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.721184 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a819e8d0-b7fc-494b-95ce-741a2d4fa4bc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1318 microversion: 2.1 time: 0.572071 Aug 30 17:28:27.722101 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 365/677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:27 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:27.725023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.725863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.726779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-plugged", "status": "completed", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:27.747392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.751029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.754386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.762522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:27.774408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for user e9055e63b6e44751844a7274c1979566 and project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:27.784739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] Creating event network-vif-plugged:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:28:27.791709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:27.794976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:27.797211 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f6dab2dd-372c-462c-a82f-569581476709 req-da4008af-a28d-4a69-b964-4d578a030bb9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073570 Aug 30 17:28:27.798173 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 366/678] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:27.807257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:27.808070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:27.825375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.826014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.827847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.831321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:27.836186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:27.837021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:27.865619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adf2588d-56b5-4903-8015-960624d5c763 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.265530 Aug 30 17:28:27.866884 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 313/679] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 18267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:28:27.872824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd42b3ef-5bb1-49c8-b61f-990b38fdf494 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98eec790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:27.916375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:28:27.990075 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd42b3ef-5bb1-49c8-b61f-990b38fdf494 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 200 len: 1432 microversion: 2.1 time: 0.121850 Aug 30 17:28:27.991247 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 314/680] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:27 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 1432 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:28.004068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:28.006061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:28.021530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.023367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.025406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.028527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.029643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.030058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.106710 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ab3b37d1-edb7-4e2e-ba80-dd454afd04d3 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 204 len: 0 microversion: 2.1 time: 0.306073 Aug 30 17:28:28.109260 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 367/681] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:28:27 2022] DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:28:28.127645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:28.141355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:28.158894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.159405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.160091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.160995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.161458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.161887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.367415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5af3ce7e-4699-4fd9-8150-39e70fd62a4c tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1646 microversion: 2.1 time: 0.372614 Aug 30 17:28:28.384498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 315/682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:27 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1646 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:28.389912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9c80ab1-4f66-4cee-9c14-e2100769a66a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:28.390761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9c80ab1-4f66-4cee-9c14-e2100769a66a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:28.483074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9c80ab1-4f66-4cee-9c14-e2100769a66a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:28.493442 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9c80ab1-4f66-4cee-9c14-e2100769a66a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1207 microversion: 2.1 time: 0.107261 Aug 30 17:28:28.494037 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 316/683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:28 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1207 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:28.518175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:28.520304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:28.536080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.540019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.540798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.541740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.542393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.545195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.583258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:28.599692 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d821734-781b-4b62-921a-2dfc53a2384e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1312 microversion: 2.1 time: 0.488471 Aug 30 17:28:28.613415 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 368/684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:28 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:28.643916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045973ae-b001-4849-9c29-0a7d3bb9f44e", "tag": "b5be2547-1b39-4e07-8398-963a0500c05d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:28.665799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:28.670403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:28.671365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:28.700936 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] Creating event network-changed:b5be2547-1b39-4e07-8398-963a0500c05d for instance 045973ae-b001-4849-9c29-0a7d3bb9f44e on n-h1-852771-11 Aug 30 17:28:28.708859 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-857726c6-69cf-4c02-8db6-304d685117d4 req-c7d3a5b6-79c7-4d1e-a55a-4bf934079f2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090847 Aug 30 17:28:28.710307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 369/685] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:28.854476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:28.871834 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b9c8413-ed43-4958-9345-1a770797e32e tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1466 microversion: 2.1 time: 0.369695 Aug 30 17:28:28.872688 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 317/686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:28 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1466 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:28.895825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1089488615", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "2030959982", "adminPass": "***", "networks": [{"uuid": "efd286dd-28fe-4870-9533-dfa9cd57bd94"}], "security_groups": [{"name": "tempest-securitygroup--1517832456"}], "key_name": "tempest-keypair-913373108", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:29.094255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8f693af-fb25-4663-b80c-ae517b264a4d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Action: 'create', calling method: .version_select at 0x7f2d99106550>, body: {"keypair": {"name": "tempest-keypair-643085243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhRBAeE+yVBpnX1K6JHdfed55r0Gc167I8KAn7whesxG/ygVP3nLguMgFVaZOmdCUwqBvyNHuXHkoI+xci/Wjz7E04ezvFNvE6UxjEUrmDB38TBE64z7/TBys9nwOoVA=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:29.122141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] validate_networks() for [('efd286dd-28fe-4870-9533-dfa9cd57bd94', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:29.145808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e8f693af-fb25-4663-b80c-ae517b264a4d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Getting quotas for project 56a9a816d75f4ea4a7cde9aab3938a0c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:29.152513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e8f693af-fb25-4663-b80c-ae517b264a4d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Getting quotas for user d76c3aa4984048889e8d5ca4d93ed785 and project 56a9a816d75f4ea4a7cde9aab3938a0c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:29.191305 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8f693af-fb25-4663-b80c-ae517b264a4d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.479568 Aug 30 17:28:29.192134 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 370/687] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:28:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:29.199625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:29.202552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:29.211762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.212627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.213242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.214116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.215043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.215656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.681032 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67cfc44a-ec20-457f-80a6-9466b1504f29 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1646 microversion: 2.1 time: 0.487823 Aug 30 17:28:29.682443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 371/688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:29 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1646 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:29.761893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:29.762636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:29.763535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:29.764170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:29.765258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:29.776936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.778301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.778969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.780073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.780839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.781666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.818426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:29.827084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Getting quotas for user 0a51e58ea5a14f9bb24a9aa9145dd831 and project 240ac0ee255c4bd1b475e0535d3be030. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:29.843162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:29.846016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:29.854665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2bb06bda-be9c-4c7f-9fd6-70b59a63f8bf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Action: 'create', calling method: .version_select at 0x7f2d98f70d30>, body: {"keypair": {"name": "tempest-keypair-188296336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj9EzBwJ91Lp265AON/oSCOruRCN4oE2c+6isffqekFIFV6pvAX5LnpNoscT5nu/TBQ1OEC23p1O4R95EBxDQ2AllnD/VnwZey6osroDaaq0bYwCUYPBTCE6VPEX3LPGw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:29.889874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2bb06bda-be9c-4c7f-9fd6-70b59a63f8bf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for project c7af706e5f574c11b8ee4691053b836d. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:29.898413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2bb06bda-be9c-4c7f-9fd6-70b59a63f8bf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for user 613b6b57b6b94a74ba11d34d1b84f529 and project c7af706e5f574c11b8ee4691053b836d. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:29.935586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24973912-e078-4957-9b0d-1cb8e2415743 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.053263 Aug 30 17:28:29.936895 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 318/689] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:28:29.945364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:29.947287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:29.968445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.968941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.969378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.970129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:29.970529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:29.970954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:29.971787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2bb06bda-be9c-4c7f-9fd6-70b59a63f8bf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.273786 Aug 30 17:28:29.975296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 372/690] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:28:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:29.985271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf7f4976-6516-44e1-bd29-e2709b3b7312 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f31af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.055682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf7f4976-6516-44e1-bd29-e2709b3b7312 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515" status: 200 len: 784 microversion: 2.1 time: 0.078945 Aug 30 17:28:30.059530 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 373/691] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:29 2022] GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515 => generated 784 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:30.083940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.085357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:30.097067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.097518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.097970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.098655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.099100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.102367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.235961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:30.248271 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e272eda1-d4b5-43f0-82fa-643aace062bd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1318 microversion: 2.1 time: 0.310189 Aug 30 17:28:30.253411 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 319/692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:29 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:30.258147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.260620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:30.280129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.280921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.281538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.282436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.283069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.283699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.334909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:30.345506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ab940277-df5e-41e5-a8f8-0a80ea3ea709 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1265 microversion: 2.1 time: 0.286237 Aug 30 17:28:30.346132 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 374/693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:30.362409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.381066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.381741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.382342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.383422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.384202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.384937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.413788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e92652fe-a7e9-4ad9-861c-8ebbdb99769d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.059665 Aug 30 17:28:30.415053 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 375/694] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:30.420307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847aa5c3-3996-466d-acab-f7319e82318b", "name": "network-vif-plugged", "status": "completed", "tag": "0df21985-7e53-4ea0-a50b-cb0bbbbc24d5"}, {"server_uuid": "95e414bb-ae04-4825-9c15-eadea2d0af60", "name": "network-vif-plugged", "status": "completed", "tag": "c1b941bb-ed7a-4fdf-95de-0b3b287b2301"}, {"server_uuid": "045973ae-b001-4849-9c29-0a7d3bb9f44e", "name": "network-vif-plugged", "status": "completed", "tag": "b5be2547-1b39-4e07-8398-963a0500c05d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:30.434802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.437032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.437641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.486327 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Creating event network-vif-plugged:0df21985-7e53-4ea0-a50b-cb0bbbbc24d5 for instance 847aa5c3-3996-466d-acab-f7319e82318b on n-h2-852771-11 Aug 30 17:28:30.487082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Creating event network-vif-plugged:c1b941bb-ed7a-4fdf-95de-0b3b287b2301 for instance 95e414bb-ae04-4825-9c15-eadea2d0af60 on n-h2-852771-11 Aug 30 17:28:30.487898 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] Creating event network-vif-plugged:b5be2547-1b39-4e07-8398-963a0500c05d for instance 045973ae-b001-4849-9c29-0a7d3bb9f44e on n-h1-852771-11 Aug 30 17:28:30.502351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8a178839-a200-494e-a387-d3a216cc188a req-e1a8bdf4-b266-4c83-8cff-c258ca6fc07b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.085417 Aug 30 17:28:30.504276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 376/695] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:30.538794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b4813d1-31aa-4cde-9786-6a1841f16316 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.541293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b4813d1-31aa-4cde-9786-6a1841f16316 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:30.565250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:30.575013 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d975baba-60cc-4d55-83f9-1de9a415fea2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1312 microversion: 2.1 time: 0.320393 Aug 30 17:28:30.587161 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 320/696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:30.626665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f6615a2-5355-4932-aa4d-3f43e06aaf2a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.654912 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f6615a2-5355-4932-aa4d-3f43e06aaf2a tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051377 Aug 30 17:28:30.655516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 321/697] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:30.670354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:30.671179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:30.694073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.694566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.695293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.696521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.697122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.697729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.771326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b4813d1-31aa-4cde-9786-6a1841f16316 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:30.779076 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b4813d1-31aa-4cde-9786-6a1841f16316 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1264 microversion: 2.1 time: 0.273115 Aug 30 17:28:30.782156 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 377/698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1264 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:30.798309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0ede20c-b7fb-45f3-ae21-bbba265e81e9 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110/action" status: 202 len: 0 microversion: 2.1 time: 0.130915 Aug 30 17:28:30.800838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 322/699] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:30 2022] POST /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:28:30.804219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34afc3a0-875f-4ecc-9250-f54910c70347 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f86d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.882107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:30.888060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:30.916349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.917215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.924984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:30.925938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:30.927992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:30.932098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:31.682174 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c9c443f-c27b-4497-b71a-8203192b249f tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1651 microversion: 2.1 time: 0.838556 Aug 30 17:28:31.688756 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 323/700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:30 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1651 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:31.704449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:31.704449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:31.721156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:31.721791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:31.722318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:31.723124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:31.727514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:31.728096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:31.973390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34afc3a0-875f-4ecc-9250-f54910c70347 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "DELETE /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 204 len: 0 microversion: 2.1 time: 1.181201 Aug 30 17:28:31.973967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 378/701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:30 2022] DELETE /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 0 bytes in 1191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:28:31.978833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:31.979427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:31.986791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:31.987698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:31.988357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:31.989167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:31.989825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:31.990243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.123783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:32.146945 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7432e4f1-cf77-4b36-8a59-afbca5361e40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1265 microversion: 2.1 time: 0.171847 Aug 30 17:28:32.148099 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 379/702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:31 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:32.154346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:32.155230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:32.161895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.162380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.162811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.163547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.163996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.164412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.456493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:32.480343 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15b2f524-7960-4634-a6b7-3475d01bf07e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1318 microversion: 2.1 time: 0.786151 Aug 30 17:28:32.482475 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 324/703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:31 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:32.489869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:32.490743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:32.506825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.508358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.509038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.510600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.519680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.521455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.645039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:32.661057 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29121935-fe59-459f-b706-172d7c1da507 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1316 microversion: 2.1 time: 0.176322 Aug 30 17:28:32.662159 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 325/704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:32 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:32.667031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89e6b2df-6514-410d-b832-cb8291387551 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98fe4af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:32.703093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-89e6b2df-6514-410d-b832-cb8291387551 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] HTTP exception thrown: Image not found. Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89e6b2df-6514-410d-b832-cb8291387551 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Request method failure captured: Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 HTTP/1.1 Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkiCFiqJvni_-e_rsdJJzdUBVneHQcwdKD56vHMa4q32jNrwzaJa5GQwa6xq7htzUduh4kZMcJtnkUtuA0Tc-ExfEvdEmdJTdoSvQVR0cIBlQHo6Dup3bhtJydxNBlfX5hlvtUq6iwVPt9x7QZ3ieBbcQak-mwErC432zjT1x-w11ZA Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:28:32.766114 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa3f513c850349eb87e82b932f0c6f5d"}]}] Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0245e8dbeef340c29fe8aee66243e417 Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bd643ef3-64a0-4355-9893-f33f6bfca8c6'} Aug 30 17:28:32.767889 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:28:32.768767 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd643ef3-64a0-4355-9893-f33f6bfca8c6 Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:28:32.769842 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd643ef3-64a0-4355-9893-f33f6bfca8c6 could not be found. Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:28:32.771754 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89e6b2df-6514-410d-b832-cb8291387551 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:28:32.775674 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89e6b2df-6514-410d-b832-cb8291387551 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 404 len: 62 microversion: 2.1 time: 0.104250 Aug 30 17:28:32.777703 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 326/705] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:32 2022] GET /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:28:32.777976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:32.805942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.807949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.808969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.836800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] Creating event network-vif-unplugged:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:28:32.855519 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4dce6205-96e1-4f03-9eb8-b87f92b54dd5 req-7bf47207-4362-4931-b822-1ecf2523d1fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079553 Aug 30 17:28:32.855519 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 327/706] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:32.860461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:32.861771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:32.887423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.889028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.895105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:32.900401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.901229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.901750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.902204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.910308 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca895d60-a6ad-4ca7-ba78-811e0bdf46c0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1312 microversion: 2.1 time: 0.760867 Aug 30 17:28:32.912477 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 380/707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:32 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1312 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:32.922309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1579286089"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:32.925751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:32.941694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.947611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.948319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:32.950210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:32.952113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:32.952724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:33.412805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29086193-7e61-447d-94a7-11cb9b1379de tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "POST /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f/action" status: 202 len: 0 microversion: 2.1 time: 0.498224 Aug 30 17:28:33.416217 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 381/708] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:32 2022] POST /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:28:33.430786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:33.433414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:33.451343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:33.452812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:33.453433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:33.456651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:33.458842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:33.460259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:33.988525 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fde94b8d-37ef-49d9-932d-8b3c31194e13 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1631 microversion: 2.1 time: 1.129624 Aug 30 17:28:34.015673 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 328/709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:32 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1631 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:34.023678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-282ad36e-0600-4e46-b68f-03555db8ec0f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98f41280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:34.113590 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-282ad36e-0600-4e46-b68f-03555db8ec0f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1429 microversion: 2.1 time: 0.096570 Aug 30 17:28:34.114762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 329/710] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:34 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:34.120155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:34.121757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:34.128746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.130110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.130747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.131730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.132381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.133003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.279530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:34.287399 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d6d5dd9-16d8-4e8c-8915-6878fff45ae6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1307 microversion: 2.1 time: 0.869769 Aug 30 17:28:34.288027 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 382/711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:33 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1307 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:34.305944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:34.306789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:34.313441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.314175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.314777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.315660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.316259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.316837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.339103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:34.588605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:34.605977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04f92da9-68d2-4ab3-aa11-d481f7945ea3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1468 microversion: 2.1 time: 0.489756 Aug 30 17:28:34.645271 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 330/712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:34 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1468 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:34.653820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:34.654445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:34.679733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.680398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.681001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.681885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.682499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.683831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.700795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:34.717192 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6254c09d-ffd5-4cfe-95d2-b615b7597c0b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1322 microversion: 2.1 time: 0.415005 Aug 30 17:28:34.718099 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 383/713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:34 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:34.728434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:34.731351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:34.741922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.744875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.748221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.748985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:34.749456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:34.749884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:34.980175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lazy-loading 'flavor' on Instance uuid bbf96994-a6ac-4549-8ba3-d002fd4b1110 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:28:35.159225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Going to try to live migrate instance to n-h1-852771-11 {{(pid=122124) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:28:35.688415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:35.699976 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb2500d6-cc6c-4409-ac12-1e79bca1c8ea tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1462 microversion: 2.1 time: 1.053437 Aug 30 17:28:35.707834 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 331/714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:34 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1462 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:35.719794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:35.720648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:35.728716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:35.731318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:35.735945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:35.738458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:35.739733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:35.742440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.231820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:36.245531 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ecd0dde8-b3af-46ab-8251-6718bec8228c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 200 len: 1467 microversion: 2.1 time: 0.534529 Aug 30 17:28:36.246623 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 332/715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:35 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 1467 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:36.255444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf9533d-17d8-4ce7-a6e9-c836b390ff62", "name": "network-vif-deleted", "tag": "6a145938-980b-4307-9e56-fd34e6e4b171"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:36.283683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:36.284891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:36.285387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.310996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] Creating event network-vif-deleted:6a145938-980b-4307-9e56-fd34e6e4b171 for instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 on n-h1-852771-11 Aug 30 17:28:36.320290 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7aa201dd-4287-4a10-a611-c57177b67c62 req-184599a6-a1a0-4f4a-b1f4-e2f522971f69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072363 Aug 30 17:28:36.323994 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 333/716] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:36.333454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-402194f6-5709-4e4b-9bc2-79c42a5a7f95 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98ed9ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:36.403011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-402194f6-5709-4e4b-9bc2-79c42a5a7f95 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1429 microversion: 2.1 time: 0.075906 Aug 30 17:28:36.404422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 334/717] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:36 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:36.415119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:36.416562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:36.426975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:36.427716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:36.428793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.430596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:36.431220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:36.436133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.697299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:36.709303 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff112928-aa2f-4163-bcc9-121e252455f4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1307 microversion: 2.1 time: 0.303001 Aug 30 17:28:36.709897 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 335/718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:36 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1307 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:36.718413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:36.720877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:36.738066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:36.738550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:36.738976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.739759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:36.747361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:36.747864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:36.869102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:36.877007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 17:28:36.885015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:36.885764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:36.887421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:36.888267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:36.889142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:36.993746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:37.047373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b608afd2-07dd-421a-9f5c-e2177299cd95 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e/action" status: 202 len: 0 microversion: 2.1 time: 0.331206 Aug 30 17:28:37.050453 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 336/719] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:36 2022] POST /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:28:37.068777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:37.069431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:37.092586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:37.092994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:37.093634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:37.098460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:37.098941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:37.099391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:37.384960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:37.395513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ffdc17bf-1de2-4908-ba50-f29952461ab0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.340337 Aug 30 17:28:37.396391 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 337/720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:37 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:37.402823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1296906164", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "92268812-2d89-475b-a754-68d4d19df53f"}], "security_groups": [{"name": "tempest-securitygroup--2007117280"}], "key_name": "tempest-keypair-188296336", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:37.939617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] validate_networks() for [('92268812-2d89-475b-a754-68d4d19df53f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:38.892005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d33d8ab1-2c18-4d97-bddc-fe933f7b5ae3 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110/action" status: 202 len: 0 microversion: 2.1 time: 4.172348 Aug 30 17:28:38.892764 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 384/721] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:34 2022] POST /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110/action => generated 0 bytes in 4174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:28:38.897981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:38.904506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:38.909369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Searching by: {'reservation_id': 'r-tl6rr04e', 'deleted': False, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:28:38.920949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:38.921425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:38.928586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:38.929639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:38.930268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:38.930868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:38.997407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:38.997972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:38.998651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:38.999599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:39.000296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:39.019225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:39.019995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:39.020588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:39.021993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:39.023251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:39.024010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:39.052874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for project c7af706e5f574c11b8ee4691053b836d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:39.060381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for user 613b6b57b6b94a74ba11d34d1b84f529 and project c7af706e5f574c11b8ee4691053b836d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:39.077514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:39.081120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:39.144761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:28:39.149196 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4b93a8b-a04a-4f21-a414-04ba69bfd274 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.751369 Aug 30 17:28:39.150409 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 338/722] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:28:39.155560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1765219536", "imageRef": "d439e93c-6cae-4cb0-921b-447f91452f74", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "662334ce-7018-45c9-8563-760f7dd1ab97"}], "security_groups": [{"name": "tempest-securitygroup--436034745"}], "key_name": "tempest-keypair-643085243", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:39.384316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] validate_networks() for [('662334ce-7018-45c9-8563-760f7dd1ab97', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:39.468126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:39.486511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:39.487063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:39.488237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:39.658124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6676b119-eb21-4dd6-b497-c5f3e982c762 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-tl6rr04e" status: 200 len: 2928 microversion: 2.1 time: 0.763998 Aug 30 17:28:39.658949 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 385/723] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Aug 30 17:28:38 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tl6rr04e => generated 2928 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:39.666462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:39.668197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:39.693939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:39.695197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:39.696052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:39.697358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:39.698698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:39.699750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:39.976976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:39.992799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0285927-155f-4313-b577-1d7190f9c117 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1471 microversion: 2.1 time: 0.330977 Aug 30 17:28:39.995935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 386/724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:39 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:40.004723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af70b0e7-fb03-4a9c-aa20-8c62a8dc8c82 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d990dc550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:40.065788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:40.066732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:40.078769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:40.079202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:40.079649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:40.084571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:40.090290 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af70b0e7-fb03-4a9c-aa20-8c62a8dc8c82 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1429 microversion: 2.1 time: 0.088844 Aug 30 17:28:40.100170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 387/725] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:39 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:40.116527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2aa2e-0a18-4113-9020-2af16249315f", "tag": "4c724896-da2a-45d6-81de-9ce9b17d287d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:40.121875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.124709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.125263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.126119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.128379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.128988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.152555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.153029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.153451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.161830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Getting quotas for project 56a9a816d75f4ea4a7cde9aab3938a0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:40.168059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Getting quotas for user d76c3aa4984048889e8d5ca4d93ed785 and project 56a9a816d75f4ea4a7cde9aab3938a0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:40.168336 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] Creating event network-changed:4c724896-da2a-45d6-81de-9ce9b17d287d for instance 9df2aa2e-0a18-4113-9020-2af16249315f on n-h1-852771-11 Aug 30 17:28:40.174128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e6e6fb72-18f6-41e0-a48a-b895df7b3b94 req-6e232ddc-da9e-4a2b-8034-3bbd5fcf5a7e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072435 Aug 30 17:28:40.175262 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 388/726] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:40.181585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:40.182711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:40.183231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:40.185531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d439e93c-6cae-4cb0-921b-447f91452f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:40.190074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.190764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.191345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.192341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.193200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.193774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.246829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1e5f4ba-3191-4e3b-b012-fed313b41d0e tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.095053 Aug 30 17:28:40.248216 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 339/727] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:28:40.253364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b09f88a-fa60-412b-9ae5-644b99ee7c89", "tag": "8c4e1a6e-294f-4240-85fc-ab701baf45e7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:40.266436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.267094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.267723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.281783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] Creating event network-changed:8c4e1a6e-294f-4240-85fc-ab701baf45e7 for instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 on n-h2-852771-11 Aug 30 17:28:40.288304 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2fedfb7e-2a83-4f27-a718-c766589a50bc req-cbf7cea7-e797-4e49-b187-f07d72324bcf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038357 Aug 30 17:28:40.289659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 340/728] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:40.306798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:40.309714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:40.319058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.319927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.320697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.321782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.322501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.323123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.577203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:40.596002 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-034eb223-cf6c-4fcc-bc2a-92708304c3ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1307 microversion: 2.1 time: 0.418655 Aug 30 17:28:40.597271 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 389/729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:40 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:40.602679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:40.603702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:40.608214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:40.613630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.616138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.616757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.617935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.621510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.622171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.629312 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b669e3a9-06fe-4e17-912b-65e00b2bafbb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.326484 Aug 30 17:28:40.629993 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 341/730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:40 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:40.669401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:40.672285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:40.702518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.704747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.705191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:40.709170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:40.713314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:40.715327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.047453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:41.055845 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d757cf92-8a93-4f65-a4a9-94bea765751b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1245 microversion: 2.1 time: 0.407570 Aug 30 17:28:41.056425 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 342/731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:40 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1245 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:41.074378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-plugged", "status": "completed", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:41.119622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.120306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.120747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.179017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] Creating event network-vif-plugged:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:28:41.206937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d4b123a9-7f53-4399-8a66-d35692f2c412 req-d10c60ed-92fb-42b1-baa4-15ad6b8997c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149254 Aug 30 17:28:41.210292 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 343/732] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:41.221595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:41.284613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.server_groups [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Querying cell d64e249a-e872-487f-b759-da855b1e5621(cell1) for 2 instances {{(pid=122123) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 17:28:41.285698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.286374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.290943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.334735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:41.344687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe5eea14-911b-49ff-92dc-0416e86a17dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.746187 Aug 30 17:28:41.345269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 390/733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:40 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:41.358184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd5089cb-7760-4f12-8fd4-93c74c228689 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/b324eccc-1358-4ed4-8dea-2d5a19cfe003" status: 200 len: 266 microversion: 2.1 time: 0.143773 Aug 30 17:28:41.359412 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 344/734] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:28:41 2022] GET /compute/v2.1/os-server-groups/b324eccc-1358-4ed4-8dea-2d5a19cfe003 => generated 266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:41.373862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:41.377301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:41.377601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfab72d2-6e59-45e8-8826-027f35a770d9 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:41.378320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfab72d2-6e59-45e8-8826-027f35a770d9 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:41.392374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.393322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.394087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.395827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.396530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.397251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.644092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfab72d2-6e59-45e8-8826-027f35a770d9 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:41.654778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfab72d2-6e59-45e8-8826-027f35a770d9 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1245 microversion: 2.1 time: 0.300422 Aug 30 17:28:41.656449 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 391/735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:41 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1245 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:41.663153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53d74fdc-b256-4443-8541-227f3cfc621f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d9921ff70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:41.754312 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53d74fdc-b256-4443-8541-227f3cfc621f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1429 microversion: 2.1 time: 0.096605 Aug 30 17:28:41.766244 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 392/736] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:41 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:41.777035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:41.777772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:41.789305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.789809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.790250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:41.790971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:41.791430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:41.791989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.031840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:42.041374 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48801b8d-5af1-4bb7-950b-557b39169298 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1471 microversion: 2.1 time: 0.680106 Aug 30 17:28:42.046001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 345/737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:41 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1471 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:42.059681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:42.060301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:42.075641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.078386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.079024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.080155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.081841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.083167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.361245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:42.374863 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b31fae24-c21c-4d44-b61e-96f02d6e8b38 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1307 microversion: 2.1 time: 0.327730 Aug 30 17:28:42.375999 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 346/738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:42 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:42.393548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:42.399360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:42.407637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.408260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.408791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.409588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.410135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.410675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.597443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:42.611963 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d80cf658-cc54-4a78-aa53-39b648b129a0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.234433 Aug 30 17:28:42.615065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 347/739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:42 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:42.628015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:42.628985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:42.638607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.639533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.640235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.641202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:42.641854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:42.642522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:42.950658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:42.969313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae0b87d2-2080-469e-8d27-b12c9f464b22 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1301 microversion: 2.1 time: 0.352467 Aug 30 17:28:42.987897 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 348/740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:42 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1301 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:42.992894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:42.996231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:43.011253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.011838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.012212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.017545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.017545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.017545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.050993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68777a33-214e-4eee-94be-4e91900aca8f tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 200 len: 1621 microversion: 2.1 time: 1.277790 Aug 30 17:28:43.055842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 393/741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:41 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 1621 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:43.063313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:43.064650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:43.081345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.082204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.082868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.083839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.086124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.086808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.221976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:43.233765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5af45a44-3d30-4a53-aa02-18c2b7990bae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1297 microversion: 2.1 time: 0.175766 Aug 30 17:28:43.235815 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 394/742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:43 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1297 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:43.254671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46abc26b-66dc-45a5-8f56-93ac57bda721 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d991d94c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:43.282966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:43.293985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53376554-2146-42f1-a140-698170229430 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.305034 Aug 30 17:28:43.295058 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 349/743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:42 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:43.299989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:43.300770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:43.311154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.312462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.327521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.328536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.330059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46abc26b-66dc-45a5-8f56-93ac57bda721 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1429 microversion: 2.1 time: 0.092994 Aug 30 17:28:43.330638 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 395/744] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:43 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:43.337657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.338218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.381415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:43.383727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:43.408531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.409020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.409455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.410156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.418446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.419168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.640914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:43.657605 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-460b1659-4399-49d2-8cc2-4cd259970ce9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1471 microversion: 2.1 time: 0.361220 Aug 30 17:28:43.658560 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 350/745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:43 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:43.671435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b09f88a-fa60-412b-9ae5-644b99ee7c89", "name": "network-vif-plugged", "status": "completed", "tag": "8c4e1a6e-294f-4240-85fc-ab701baf45e7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:43.691965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.696275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.697751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.743298 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] Creating event network-vif-plugged:8c4e1a6e-294f-4240-85fc-ab701baf45e7 for instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 on n-h2-852771-11 Aug 30 17:28:43.751682 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-82cd286e-f284-48cd-b89d-89f859fe29ac req-b1433ef4-cada-4540-9f29-be1f19393799 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091552 Aug 30 17:28:43.755737 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 351/746] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:43.769515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:43.772705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:43.794857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.795858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.799331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:43.802803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:43.804564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:43.808269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.100869 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a670f3b4-4bca-41d9-b6b0-6a8920f0a414 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 200 len: 1620 microversion: 2.1 time: 0.745629 Aug 30 17:28:44.102477 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 396/747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:43 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 1620 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:44.109423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:44.110425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:44.116681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:44.120719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.121585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.122410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.123380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.124232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.124884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.245049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:44.254591 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0216f3de-47af-43e0-82c8-5f564f9b6879 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1307 microversion: 2.1 time: 0.495163 Aug 30 17:28:44.259767 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 352/748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:43 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:44.267745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:44.273406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:44.287744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.289018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.292957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.293943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.294572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.295164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.412415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:44.432923 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db20cfaf-567d-4b33-af01-0d2878b8b2ad tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1299 microversion: 2.1 time: 0.169367 Aug 30 17:28:44.434260 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 353/749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:44 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:44.453426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: .version_select at 0x7f2d98ed9ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-977423199", "policies": ["anti-affinity"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:44.468425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:44.492824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c8a20de-68be-4736-85eb-e7b27f677191 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.388596 Aug 30 17:28:44.502454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 397/750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:44 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:44.522060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:44.529126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:44.533062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:44.553105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:44.555709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.562810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.565065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.566273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.568164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.572433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.654906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:44.673908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:44.725634 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a77bd0ee-5eaa-442a-bc0f-ed955f39a229 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.289895 Aug 30 17:28:44.743626 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 354/751] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 30 17:28:44 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:44.749662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:44.756373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:44.777318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:44.778341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.778949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.779468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.780448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:44.780909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:44.781336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:44.791011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ef78e4e-ae4c-4847-9f2a-0dbf6555934f tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1303 microversion: 2.1 time: 0.282676 Aug 30 17:28:44.807992 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 398/752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:44 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1303 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:44.816291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c6f1bed-5480-47b9-ba33-1a4e9c2925da tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d991b9670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:45.755508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:45.771816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a2a950c6-7c4a-4a89-aaf3-0a68a6c3de5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 1.028376 Aug 30 17:28:45.775025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 355/753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:44 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:45.791536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf96994-a6ac-4549-8ba3-d002fd4b1110", "name": "network-vif-unplugged", "status": "completed", "tag": "1bb6904e-a9ec-49c6-b728-e8ee4971db77"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:45.806632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:45.816124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:45.819631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:45.842837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] Creating event network-vif-unplugged:1bb6904e-a9ec-49c6-b728-e8ee4971db77 for instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 on n-h2-852771-11 Aug 30 17:28:45.855813 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f98fe2be-8584-41c9-a043-cd514bbb6335 req-a83c0a0b-3980-4f5c-b3b7-c593f3b9ae1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077756 Aug 30 17:28:45.860148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 356/754] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:45.869023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:45.871086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:45.879276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:45.879793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:45.880234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:45.880943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:45.881395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:45.881820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:46.182740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:46.187752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:46.209747 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf64d32e-0445-4223-bda4-8c5436dd2f5b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.348242 Aug 30 17:28:46.222296 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 357/755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:45 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:46.230810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1853926840", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7bc9954a-752c-4bbf-96ee-4f82dca857fd"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:49.003747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:50.146878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:51.648699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:52.153794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:28:52.158766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c6f1bed-5480-47b9-ba33-1a4e9c2925da tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1438 microversion: 2.1 time: 7.358785 Aug 30 17:28:52.159433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 399/756] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:44 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1438 bytes in 7362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:52.173438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:52.174256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:52.180880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.181636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.182264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.183081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.183700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.184253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.362478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:52.370684 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-76db93b3-6084-48de-a4ae-3eea1a1c7cfd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1488 microversion: 2.1 time: 0.201858 Aug 30 17:28:52.372064 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 400/757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:52 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1488 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:52.376901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:52.377758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:52.383988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.384561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.385592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.386363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.386938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.387424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.421170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:28:52.426660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:28:52.427159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:28:52.427631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:28:52.428051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:28:52.450833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.451316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.451815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.452581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.453039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.453462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.473344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:52.478991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:52.495313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 2 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:28:52.499541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:52.542399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:52.556127 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69f5bd5b-8835-44ec-91e7-ca70e3cd578b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.178673 Aug 30 17:28:52.556127 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 401/758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:52 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:52.558996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:52.559695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:52.559950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122123) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 17:28:52.565878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.566372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.566958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.567842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.568307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.568730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.583085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:52.592172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:52.598766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:52.668851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:52.679896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:52.721807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=d844b1b6-9083-45c5-95cf-7e21bad87b9c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:28:52.749459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:52.765444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04e34ca2-ee50-453c-b023-3b1beb064362 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.211645 Aug 30 17:28:52.777194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:52.779830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 402/759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:52 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:52.782966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:52.785809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df2aa2e-0a18-4113-9020-2af16249315f", "name": "network-vif-plugged", "status": "completed", "tag": "4c724896-da2a-45d6-81de-9ce9b17d287d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:52.796057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.796885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.797541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.802207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:52.813915 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] Creating event network-vif-plugged:4c724896-da2a-45d6-81de-9ce9b17d287d for instance 9df2aa2e-0a18-4113-9020-2af16249315f on n-h1-852771-11 Aug 30 17:28:52.819846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3e789318-ffd4-43e0-ab4f-160388f6c4d0 req-77bde867-9814-4f80-a7ab-e33e4b479dc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Aug 30 17:28:52.821067 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 403/760] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:52.828439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:52.829220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:52.831408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:28:52.837696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'server_group_members'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:28:52.840462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.841019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.841562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.842410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.843013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.843593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.886400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f6fd252-7228-4100-8e50-e9d7e109626a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 6.666287 Aug 30 17:28:52.892853 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 358/761] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:28:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 6671 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 17:28:52.900961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:52.904491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:52.921143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.923827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.924829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:52.926648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:52.929194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:52.930130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.123430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:53.149320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-089fc34e-10ae-43a6-acd8-73061e7238e2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.326646 Aug 30 17:28:53.155541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 404/762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:52 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.160525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.161172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:53.169652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.170453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.171047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.172498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.173114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.173849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.191777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:53.197244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-882d4c3e-5628-41a6-b464-42d8cffb4a62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.303250 Aug 30 17:28:53.197244 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 359/763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:52 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.212322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf96994-a6ac-4549-8ba3-d002fd4b1110", "tag": "1bb6904e-a9ec-49c6-b728-e8ee4971db77"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:53.223695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.224067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.224316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.246482 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] Creating event network-changed:1bb6904e-a9ec-49c6-b728-e8ee4971db77 for instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 on n-h2-852771-11 Aug 30 17:28:53.251876 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-dfad6b4d-3775-44f8-aaed-f71843c5ce92 req-8bf69216-b8f7-405d-a293-68e6de59d1c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053473 Aug 30 17:28:53.252698 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 360/764] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:53.268672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d", "tag": "d91a0cb9-3531-4beb-8356-4f5fbf5225be"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:53.289061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.290037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.290623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.306112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] Creating event network-changed:d91a0cb9-3531-4beb-8356-4f5fbf5225be for instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d on n-h1-852771-11 Aug 30 17:28:53.314518 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-db6cb642-f859-4a8c-b483-4552d8aec8ad req-cdf5a761-1e53-48f0-95b3-7778fa295236 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060122 Aug 30 17:28:53.339297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 361/765] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:53.348440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a612a81d-7dc3-462c-91f2-fb8afee9b87d tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d98daaa60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.424834 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a612a81d-7dc3-462c-91f2-fb8afee9b87d tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 200 len: 1438 microversion: 2.1 time: 0.083353 Aug 30 17:28:53.435241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 362/766] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.442413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:53.443416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:53.452096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.453166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.453885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.454832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.455668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.456235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.482343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:53.498226 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2cf3a10d-a880-46ca-b61a-0f8b062cb6bb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.341343 Aug 30 17:28:53.513994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 405/767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.524545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.540512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:53.545024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Searching by: {'deleted': False, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:28:53.547349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0decd350-61e9-4aa5-b679-351f8f0dfa26 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89/action" status: 202 len: 0 microversion: 2.1 time: 0.110460 Aug 30 17:28:53.551005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 363/768] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:53 2022] POST /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:28:53.556465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.557323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:53.566244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.566830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.567396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.568287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.569554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.570035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.608373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.609148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.613664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.614775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.615421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.616118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.679594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:28:53.777386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec4e67d1-523c-47ca-9a3f-e77254b000f5 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.266078 Aug 30 17:28:53.779938 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 406/769] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/servers => generated 1664 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.785076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.786355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:53.794098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.795152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.796140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.797753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.798724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.799471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.850732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:53.860965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-573e8f54-ed9d-42db-b429-02241d04fd44 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1479 microversion: 2.1 time: 0.310784 Aug 30 17:28:53.866141 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 364/770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1479 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:53.896082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:53.896844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:53.925421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.925421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.927521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:53.929427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:53.929960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:53.931058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.168366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:54.180334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03347055-a461-4b55-8cde-5eed890f3df2 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.303321 Aug 30 17:28:54.194269 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 365/771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:54.216573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3947f69a-f1ee-4254-8171-aa3717a0453e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:54.225223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3947f69a-f1ee-4254-8171-aa3717a0453e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:54.290528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:54.312820 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c07f1d10-5ce6-4489-8d08-39aec92efacc tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1493 microversion: 2.1 time: 0.531427 Aug 30 17:28:54.321212 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 407/772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:53 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1493 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:54.333690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:54.336496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:54.373560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.376506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.380513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.385225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.386021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.392191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.422778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3947f69a-f1ee-4254-8171-aa3717a0453e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:54.432703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3947f69a-f1ee-4254-8171-aa3717a0453e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1219 microversion: 2.1 time: 0.234550 Aug 30 17:28:54.443910 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 366/773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:54 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:54.456951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:54.461412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:54.484595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.489903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.490609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.491467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.497586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.498129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.700972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:54.709683 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ba413f6-a582-405d-8393-0bf4f1669ebf tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.386683 Aug 30 17:28:54.710269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 408/774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:54 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:54.724946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:54.727772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:54.741067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.741561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.741997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.748100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.748581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.749013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.807889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:54.816094 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0dfa1165-a3b2-44ea-8a9a-6327cb47c054 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.370843 Aug 30 17:28:54.831322 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 367/775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:54 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:54.836447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:54.837212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:54.844071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.844674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.845207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.846023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:54.846598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:54.847122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:54.986003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.006988 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df27045a-89be-4e47-a0b2-be320b6318d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.291742 Aug 30 17:28:55.023624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 409/776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:54 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:55.030685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.031829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.046361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.047117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.048277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.049270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.049878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.050526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.067932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.084060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e8b9e7af-5a9c-4de3-9758-ff2bd72dfd2c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.251000 Aug 30 17:28:55.085163 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 368/777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:54 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:55.215106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.216618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.227453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.234450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.235223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.236463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.237207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.237798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.246965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.259633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-750910c5-ac43-49d0-afd3-9df1b15629d9 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1479 microversion: 2.1 time: 0.233645 Aug 30 17:28:55.277526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 410/778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1479 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:55.340207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.342400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.351924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.357226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.357810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.358920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.359530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.360032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.452275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.465857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e3195076-1459-4009-b8f9-3a06ad936d21 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.255432 Aug 30 17:28:55.466771 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 369/779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:55.471586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5515e53-fea6-4869-9cda-21a7c6d7cd30", "tag": "93f1d1cb-660e-413e-b6ae-2505b1587313"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:55.504826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.507607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.508517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.523350 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] Creating event network-changed:93f1d1cb-660e-413e-b6ae-2505b1587313 for instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 on n-h1-852771-11 Aug 30 17:28:55.536996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-140b616d-7e7f-403d-b4ea-f82930371247 req-b49d34f4-0c5f-4a6d-bc34-d392cb51c725 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068799 Aug 30 17:28:55.537929 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 370/780] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:55.543459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.544322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.552170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.552748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.553289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.553976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.554426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.554855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.645411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.655171 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b89844ee-d350-4477-83d5-2893175b0ae9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1215 microversion: 2.1 time: 0.116162 Aug 30 17:28:55.667538 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 371/781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:55.736687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.737038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.738928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.745473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.745948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.746370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.747197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.747522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.747950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.748579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef1a18dc-6a06-4432-9d1e-2208dd553281 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 200 len: 1473 microversion: 2.1 time: 0.418039 Aug 30 17:28:55.749757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 411/782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:55.770918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1824241341"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:55.773357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.780147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.780642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.781088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.781794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.782252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.782684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.898133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:55.907546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90839893-ebb8-4cb6-835b-0fd37b79795e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.175850 Aug 30 17:28:55.918259 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 372/783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:55.918259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:55.918259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:55.925528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.926110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.926708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:55.927738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:55.928268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:55.928696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.013857 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-90a4d60d-d664-4249-9a76-808ea2055145 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89/action" status: 202 len: 0 microversion: 2.1 time: 0.246890 Aug 30 17:28:56.019698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 412/784] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:28:55 2022] POST /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 30 17:28:56.032711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc5a6e9f-c40f-4753-9a9c-5036416d12e1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d991b9310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.088684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.099625 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a44c9c81-888d-40fe-a0ce-ff13cb8efe2c tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.189672 Aug 30 17:28:56.101297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 373/785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:55 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.112354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc5a6e9f-c40f-4753-9a9c-5036416d12e1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.084949 Aug 30 17:28:56.114879 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 413/786] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.118604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.120032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.122755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.124267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.126810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.127373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.127862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.128561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.129005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.129425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.133256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.133750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.134187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.134921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.135380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.135832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.277957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.286059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9888e71f-6b56-42a3-af86-df33bc119d4a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.173259 Aug 30 17:28:56.286808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 374/787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.291344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.291967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.297808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.298283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.298869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.299763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.300358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.300935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.379146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.393572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4937bb82-0a51-4365-b52e-cad0655b3089 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.275686 Aug 30 17:28:56.394555 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 414/788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.489584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.491138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.499898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.501362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.501799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.502928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.504012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.504922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.567616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.608563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c67fa95-bcd3-4a34-ad15-2c135c29ef4b tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1479 microversion: 2.1 time: 0.319772 Aug 30 17:28:56.609913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 375/789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1479 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.679772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.680360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.688724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.689204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.689633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.690532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.690984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.691504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.823924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.832910 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab8fafd3-3186-4cbe-80fd-801966bbacaf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1271 microversion: 2.1 time: 0.157080 Aug 30 17:28:56.833704 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 376/790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:56.849161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:56.858943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7b49420-ba3e-4a62-805c-b5b2ae4829d7 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.374383 Aug 30 17:28:56.860364 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 415/791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:56.931125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:56.931523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:56.941088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.941680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.942799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:56.943787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:56.944593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:56.945288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.131094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.131741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.151387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.159581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.161436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.163094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.165260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.168862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.323747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.333482 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f57d3dea-81b6-4252-939d-7c5497c48958 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.407406 Aug 30 17:28:57.334221 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 377/792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:56 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.339377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fa441fe7-e95b-4914-9936-e69f04f0229e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d99023040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.391265 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fa441fe7-e95b-4914-9936-e69f04f0229e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.055711 Aug 30 17:28:57.393032 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 378/793] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.402301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.404239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.410710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.411564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.412074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.412991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.413445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.414232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.418877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:57.452473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.461256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2c7d13f-06b9-405e-9d02-dcd0e0c132ae tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.338014 Aug 30 17:28:57.476054 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 416/794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.483429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.484313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.490788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.491385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.491980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.492968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.493483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.493952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.584049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.593207 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1c641df-0436-4a6c-9d83-971e951f766a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.198343 Aug 30 17:28:57.593982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 379/795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.631442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.632119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.638617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.639108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.639568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.640403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.640859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.641288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.759305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.767372 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f45a8bb-d826-4ee3-944b-c7fd2b8891cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.289101 Aug 30 17:28:57.767993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 417/796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.783254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.792703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a26dbc0-5e09-4dbe-b26e-373be12b4875 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1466 microversion: 2.1 time: 0.165667 Aug 30 17:28:57.793352 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 380/797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1466 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:57.815691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91472f06-022d-42af-8102-1b700c40bc59 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d991e2d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.855783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.856317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.863286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.863858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.864464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.865135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.865649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.866133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.936972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:57.944968 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-41467465-2342-447e-8877-ac95a50954ec tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1271 microversion: 2.1 time: 0.094418 Aug 30 17:28:57.945814 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 381/798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:57.957271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:57.957896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:57.965820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.966517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.967153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:57.968100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:57.968739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:57.969362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.126494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:58.135677 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75c05b57-4d6c-4ef7-aec5-a85f321ebcd9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.188108 Aug 30 17:28:58.143611 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 382/799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:58.149956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d844b1b6-9083-45c5-95cf-7e21bad87b9c", "tag": "79cb5d7d-8589-416f-8076-0e597bf5a8d0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:58.163805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.164296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.164676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.176793 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] Creating event network-changed:79cb5d7d-8589-416f-8076-0e597bf5a8d0 for instance d844b1b6-9083-45c5-95cf-7e21bad87b9c on n-h2-852771-11 Aug 30 17:28:58.182588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-429f878f-dea9-4e2a-bfb8-49548667a2fd req-3acfda25-55ec-4ad7-8f99-bfc8604c8b9e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 Aug 30 17:28:58.183459 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 383/800] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:28:58.362473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.364143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.379380 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91472f06-022d-42af-8102-1b700c40bc59 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "DELETE /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300" status: 204 len: 0 microversion: 2.1 time: 0.567543 Aug 30 17:28:58.385699 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 418/801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:57 2022] DELETE /compute/v2.1/images/29bbb633-6a96-4a0b-a7bb-c92c9f17f300 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:28:58.397997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98b5dd87-d86e-44f3-9589-fd8164a36333 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '.version_select at 0x7f2d992109d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.411019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.414764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.414764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.415727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.416713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.417251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.562793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:58.571471 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e605651-b50e-47b4-8e9d-6aa4cfc57113 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.216269 Aug 30 17:28:58.572128 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 384/802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:58.577098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c584dd8d-5785-44e1-808c-236b9d601303 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98fbf9d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.628816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c584dd8d-5785-44e1-808c-236b9d601303 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.055526 Aug 30 17:28:58.629428 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 385/803] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:58.635372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.635987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.636592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-98b5dd87-d86e-44f3-9589-fd8164a36333 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] HTTP exception thrown: Image not found. Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98b5dd87-d86e-44f3-9589-fd8164a36333 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Request method failure captured: Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 HTTP/1.1 Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkiCFiqJvni_-e_rsdJJzdUBVneHQcwdKD56vHMa4q32jNrwzaJa5GQwa6xq7htzUduh4kZMcJtnkUtuA0Tc-ExfEvdEmdJTdoSvQVR0cIBlQHo6Dup3bhtJydxNBlfX5hlvtUq6iwVPt9x7QZ3ieBbcQak-mwErC432zjT1x-w11ZA Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:28:58.641768 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa3f513c850349eb87e82b932f0c6f5d"}]}] Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0245e8dbeef340c29fe8aee66243e417 Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bd643ef3-64a0-4355-9893-f33f6bfca8c6'} Aug 30 17:28:58.643150 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bd643ef3-64a0-4355-9893-f33f6bfca8c6 to delete Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:58.643978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd643ef3-64a0-4355-9893-f33f6bfca8c6 could not be found. Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:28:58.645133 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:28:58.646343 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:28:58.648789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98b5dd87-d86e-44f3-9589-fd8164a36333 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:28:58.649879 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98b5dd87-d86e-44f3-9589-fd8164a36333 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "DELETE /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6" status: 404 len: 62 microversion: 2.1 time: 0.259755 Aug 30 17:28:58.651194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 419/804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] DELETE /compute/v2.1/images/bd643ef3-64a0-4355-9893-f33f6bfca8c6 => generated 62 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:28:58.655735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.656486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.656660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.657420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.657824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.658022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.658307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.659462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.668469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.669260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.669960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.670881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.671571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.672363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.813253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:58.813798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:58.821309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfb368ea-c6a1-4cb6-9618-df23363ec3ff tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.168592 Aug 30 17:28:58.831508 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 420/805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:58.831707 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de58fbaf-6432-4e95-b455-351b0e1d35dc tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.192637 Aug 30 17:28:58.831707 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 386/806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:58.831882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.831882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.832032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.832032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.832032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:58.833841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.834965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.835649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.836645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.837327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.838448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.840794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.841447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.841888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.842854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.843068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.843438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.868508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:28:58.871673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:28:58.952637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e5545a7-def2-469f-b451-a7b70c70c338 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 204 len: 0 microversion: 2.1 time: 0.129006 Aug 30 17:28:58.953234 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 421/807] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:28:58 2022] DELETE /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:28:58.963636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:58.964332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:58.970135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.970615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.971045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.971772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:58.972224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:58.972646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:58.987030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:58.996380 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5231944-b16d-4560-91ce-168de82eadd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.171492 Aug 30 17:28:58.996964 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 387/808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:59.001493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.002539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:59.008775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.009257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.010197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.010884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.012004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.012436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.076909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:59.086805 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09fd03ca-e001-400f-8a88-861163fefe05 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1271 microversion: 2.1 time: 0.088826 Aug 30 17:28:59.088693 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 388/809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:59.114999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:59.121107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:28:59.124475 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87c91654-3357-4974-b2a2-ca2a85605cec tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1472 microversion: 2.1 time: 0.165591 Aug 30 17:28:59.125057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 422/810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:58 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:59.130568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.131036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.131464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.145338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] Creating event network-vif-unplugged:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:28:59.151017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-44633057-f6d4-40e1-af73-32d59eea6a84 req-c3f86aa8-d666-45e6-b32c-2da952ca7481 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033104 Aug 30 17:28:59.151985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 389/811] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:28:59.159088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.159757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:59.166752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.166865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.167274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.168075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.168534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.168956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.301211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:59.309505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b512606e-fd88-483c-a13d-43d3f8d14b72 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.154572 Aug 30 17:28:59.310078 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 423/812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:59 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:28:59.593935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.594628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:59.600745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.601223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.601684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.602364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.602811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.603690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.642836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96dd06d4-8e59-462e-a7a1-dfa2757e49c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d990855e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.688819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-96dd06d4-8e59-462e-a7a1-dfa2757e49c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.049647 Aug 30 17:28:59.689638 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 424/813] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:28:59 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:59.746470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:28:59.754823 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-10981c82-066f-422c-9b57-282b5df0cc5b tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1390 microversion: 2.1 time: 0.165642 Aug 30 17:28:59.755393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 390/814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:59 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:28:59.845978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.846511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:28:59.846801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:59.847235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:28:59.854117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.854604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.854748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.855042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.855234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.855779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.855888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.856398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.856551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:28:59.856826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:28:59.857164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:28:59.857757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.037659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.048170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1c3ce05-aa46-43c6-8afe-b79c1ab489c7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.205678 Aug 30 17:29:00.048761 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 391/815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:59 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.054904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.055551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.062297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.063167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.063648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.064341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.064786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.065198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.131743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.141237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23c3dbcb-8f87-4621-b334-f5021b2ef01b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.299064 Aug 30 17:29:00.141820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 425/816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:28:59 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.146543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.147147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.157753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.158274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.158711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.159411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.159907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.160512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.205501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.213262 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7bb25f1-d2e6-4568-993c-2ee06ad38d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.162921 Aug 30 17:29:00.213829 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 392/817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.218355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.218950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.224557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.225025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.225454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.226140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.226583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.226996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.262529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.273188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2980098e-363c-4744-8ef1-d715278eff4b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1271 microversion: 2.1 time: 0.130158 Aug 30 17:29:00.274087 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 426/818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.330939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.332595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.340436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.340978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.341462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.342259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.342863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.343297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.371036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.379842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d34afdb-f91a-4ffd-8ad0-4a176213063f tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1472 microversion: 2.1 time: 0.164819 Aug 30 17:29:00.383520 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 393/819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.487972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.497639 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-14a960e3-df2b-4578-8260-088922e3cec6 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.170818 Aug 30 17:29:00.498427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 427/820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:00.703795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bffa4d3c-4c2f-4b61-84ea-b864e233f816 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98fbf0d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.753076 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bffa4d3c-4c2f-4b61-84ea-b864e233f816 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.053208 Aug 30 17:29:00.760518 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 394/821] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.779546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.780137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.787025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.787548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.788164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.789044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.789697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.790125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.952020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:00.961497 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-948c4c9f-85b6-4e76-87f9-1a30e63d513c tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1590 microversion: 2.1 time: 0.188563 Aug 30 17:29:00.962075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 428/822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1590 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:00.982918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:00.983796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:00.992910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.993468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.994031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:00.994792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:00.995314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:00.995903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.070586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.072264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.083079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.083736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.084179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.084898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.085505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.085950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.323541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:01.334855 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a0469be-0b65-4159-aaaf-d2498df6f337 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.268072 Aug 30 17:29:01.336272 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 429/823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:01.342037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.342895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.352885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.354525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.355178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.356158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.356814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.357462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.450683 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76c58d5e-b7d9-4318-ac63-e7b7818e92cb tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.472116 Aug 30 17:29:01.451689 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 395/824] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:29:00 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f/os-interface => generated 285 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:01.456526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b09f88a-fa60-412b-9ae5-644b99ee7c89", "name": "network-vif-plugged", "status": "completed", "tag": "8c4e1a6e-294f-4240-85fc-ab701baf45e7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:01.472617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.473383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.473969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.489789 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] Creating event network-vif-plugged:8c4e1a6e-294f-4240-85fc-ab701baf45e7 for instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 on n-h2-852771-11 Aug 30 17:29:01.495778 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-81686f80-4ab8-4039-af2c-94cce1cae90a req-f2a52a82-ca7a-42dc-944a-d4a6c95af299 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Aug 30 17:29:01.496721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 396/825] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:01.501975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.502839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.510187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.510717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.511148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.514075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.514717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.515315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.708933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:01.729866 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a53239d-a962-4054-810c-2f123b40ccdf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.231771 Aug 30 17:29:01.733985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 397/826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:01.752599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.753541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.762808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.764277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.764909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.766093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.766733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.768805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.785331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:01.795648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3762bd41-8f8d-4843-ada9-c13f8edcac98 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.457439 Aug 30 17:29:01.805880 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 430/827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:01.811922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.824109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.831260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.832051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.832682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.833581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.834255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.834899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.924625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:01.936079 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ca16f3c-092f-4a0a-be84-543385b11c90 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1271 microversion: 2.1 time: 0.200677 Aug 30 17:29:01.937070 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 398/828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:01.942193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:01.943155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:01.950862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.951880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.952715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:01.954140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:01.954853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:01.955672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:02.461921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:02.654412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:02.656421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:02.668366 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f0116b8-dbad-4924-878c-33d014de3e10 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.729861 Aug 30 17:29:02.668553 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5b68f88-5aba-4ebf-8030-16695b5e2528 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1472 microversion: 2.1 time: 0.859191 Aug 30 17:29:02.679582 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 399/829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:02.679582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d573810e-8d49-419e-89da-63032e5d49e0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d992ce5e0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:02.691284 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 431/830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:01 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1472 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:02.707507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:02.718606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:02.730692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:02.731724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:02.732495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:02.733229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:02.733683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:02.734104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:02.766635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d573810e-8d49-419e-89da-63032e5d49e0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.095941 Aug 30 17:29:02.768310 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 400/831] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:02 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:02.780561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:02.784137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:02.799704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:02.802233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:02.804290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:02.805582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:02.808001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:02.810825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:02.821607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:03.350060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:03.369650 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a100059-2460-492c-a464-b7db65066e55 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.599391 Aug 30 17:29:03.378429 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 401/832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:02 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:03.401488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:03.402964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:03.410935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.411919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.412649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.414362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.415092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.416387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.584016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:03.600059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3407c8e-47b6-4902-9207-9fb9e4696eef tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1503 microversion: 2.1 time: 0.907103 Aug 30 17:29:03.600671 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 432/833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:02 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1503 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:03.630404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:03.635056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:03.645117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:03.659859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.660364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.662628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.667433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.668013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.668460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.852350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:03.864820 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11c144af-9dcf-40cb-a5ef-ce13c8250a39 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1277 microversion: 2.1 time: 0.254392 Aug 30 17:29:03.867830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 433/834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:03 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:03.874870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d844b1b6-9083-45c5-95cf-7e21bad87b9c", "name": "network-vif-plugged", "status": "completed", "tag": "79cb5d7d-8589-416f-8076-0e597bf5a8d0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:03.909441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.911002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.912681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.933438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] Creating event network-vif-plugged:79cb5d7d-8589-416f-8076-0e597bf5a8d0 for instance d844b1b6-9083-45c5-95cf-7e21bad87b9c on n-h2-852771-11 Aug 30 17:29:03.939560 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-18d84178-0971-4d9e-9dab-c25d9900f83b req-1679dd87-ef9e-4ddc-bca7-6764ac5c85ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068944 Aug 30 17:29:03.941439 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 434/835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:03.949329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:03.949778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:03.957436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.958121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.958793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:03.959628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:03.960218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:03.960805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:04.346199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:04.360589 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-544043bc-7d9c-40d5-920e-c963524bddde tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.962254 Aug 30 17:29:04.361754 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 402/836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:03 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:04.380963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:04.384853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:04.403059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:04.408096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:04.410611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:04.412145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:04.414569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:04.417006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:04.483926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=58 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:04.763146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:04.774840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-58267c89-c8d9-4a32-ba62-d66cdc7aa653 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1472 microversion: 2.1 time: 0.409290 Aug 30 17:29:04.784634 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 403/837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:04 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:04.800248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1794a605-76aa-4a7e-9b93-54b8eccca2de tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d99533a60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:04.897908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1794a605-76aa-4a7e-9b93-54b8eccca2de tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.111068 Aug 30 17:29:04.907002 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 404/838] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:04 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:04.915712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:04.919928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:04.926614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:04.927164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:04.927660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:04.928492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:04.929023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:04.929508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.121680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:05.132967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad8403aa-f761-4c7c-9896-59801a640b9e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 1.189940 Aug 30 17:29:05.133707 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 435/839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:03 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:05.154029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:05.172318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:05.202056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.202558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.203000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.217835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.218915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.219434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.451207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:05.481514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d4bfc17-9522-4f26-861a-bad0d3170e99 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.572963 Aug 30 17:29:05.484643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 405/840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:04 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:05.492337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:05.498681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:05.546636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.550891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.551715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.553087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.556414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.557115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.684412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:05.698495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-991e33bb-1d86-4092-82de-ff70123a2d4b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1478 microversion: 2.1 time: 0.563889 Aug 30 17:29:05.702526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 436/841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:05 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1478 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:05.714796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f78cdb8-3656-4d17-8abf-85c88cea430f", "name": "network-vif-deleted", "tag": "7f5e63de-f29e-4023-8a30-9bcacfbd5570"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:05.770728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.771581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.774360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.814666 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] Creating event network-vif-deleted:7f5e63de-f29e-4023-8a30-9bcacfbd5570 for instance 8f78cdb8-3656-4d17-8abf-85c88cea430f on n-h1-852771-11 Aug 30 17:29:05.823037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a0aa60b2-9a37-47df-a0ef-c708f7185736 req-65fc99fe-5399-4cd7-ad8b-8f4885e75bc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118738 Aug 30 17:29:05.824200 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 437/842] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:05.841958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:05.844100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:05.851962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:05.858600 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1681f93f-c027-40fb-9ff6-6b2a4ce769af tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.372618 Aug 30 17:29:05.859261 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 406/843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:05 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:05.864032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.867844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.868603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.869950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.870629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.871264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.880850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-924c2a9b-6c9b-4292-be3d-f39c89719360 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '.version_select at 0x7f2d9938d280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:05.902151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-924c2a9b-6c9b-4292-be3d-f39c89719360 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.902674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-924c2a9b-6c9b-4292-be3d-f39c89719360 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.903120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-924c2a9b-6c9b-4292-be3d-f39c89719360 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.919499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-924c2a9b-6c9b-4292-be3d-f39c89719360 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.058874 Aug 30 17:29:05.932779 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 407/844] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:29:05 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:05.942015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:05.942754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:05.960916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.963681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.964160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:05.964911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:05.965375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:05.967693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.170682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:06.185123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c60404df-d155-419e-9aaa-fba6422232af tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.359132 Aug 30 17:29:06.187232 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 438/845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:05 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.196706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:06.198714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:06.234105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.236017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.236905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.238446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.239586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.240643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.263161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:06.340652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.342138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.342737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.343345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lazy-loading 'fault' on Instance uuid 8f78cdb8-3656-4d17-8abf-85c88cea430f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:29:06.393540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:06.404114 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1dbad2f-d080-4dc5-bba7-6c31fc5c227a tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1590 microversion: 2.1 time: 0.469184 Aug 30 17:29:06.406748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0245e8dbeef340c29fe8aee66243e417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3f513c850349eb87e82b932f0c6f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:06.412452 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 408/846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:05 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1590 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.418994 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8e18b6b-4198-4827-9a2d-778d356fb478 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 200 len: 1307 microversion: 2.1 time: 0.230344 Aug 30 17:29:06.420991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 439/847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:06 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.425779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:06.426388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:06.434129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.434305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ad0c360-658e-4e5e-a002-fcb03ce9906a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98eec430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:06.434936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.435571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.436438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.436887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.437300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.524719 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ad0c360-658e-4e5e-a002-fcb03ce9906a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.110819 Aug 30 17:29:06.526137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 409/848] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:06 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.549710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5515e53-fea6-4869-9cda-21a7c6d7cd30", "name": "network-vif-plugged", "status": "completed", "tag": "93f1d1cb-660e-413e-b6ae-2505b1587313"}, {"server_uuid": "d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d", "name": "network-vif-plugged", "status": "completed", "tag": "d91a0cb9-3531-4beb-8356-4f5fbf5225be"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:06.594332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.597151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.597619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.621738 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Creating event network-vif-plugged:93f1d1cb-660e-413e-b6ae-2505b1587313 for instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 on n-h1-852771-11 Aug 30 17:29:06.622246 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] Creating event network-vif-plugged:d91a0cb9-3531-4beb-8356-4f5fbf5225be for instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d on n-h1-852771-11 Aug 30 17:29:06.630161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ccd1f7fe-9280-4982-a42a-eb0bbd75c2a0 req-4be63bc4-5b82-4d11-8bf8-be7bf448b237 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099335 Aug 30 17:29:06.631611 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 410/849] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:06.640714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:06.641619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:06.648188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-90941286-05a0-442f-8acf-a4fe4089b08e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1631 microversion: 2.1 time: 0.225769 Aug 30 17:29:06.649487 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 440/850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:06 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1631 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.657871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:06.658860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:06.668085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.668837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.669615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.670802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.671946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.672575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.692565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.699340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.699788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.700528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:06.701568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:06.703538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:06.927774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:06.960436 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-760dddee-7410-478f-a91f-b4c85b109810 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.309216 Aug 30 17:29:06.961504 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 441/851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:06 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:06.966602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a52d65ce-1e42-4453-baff-f07ca33ecac2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: .version_select at 0x7f2d99085af0>, body: {"keypair": {"name": "tempest-keypair-1326200053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0f3ZkK7jKyCcegoZGcVlY97dNc417CY9PKRw0KDhPPb3hpqzNi25pdENSnnm20rk0lBo+eYXYY0Gzowqp92x6ZXeEgs1XotVRYxWySh0R8oYyheKSPn6pCl8esLaqjtw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:06.996217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a52d65ce-1e42-4453-baff-f07ca33ecac2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:07.006499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a52d65ce-1e42-4453-baff-f07ca33ecac2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for user 5fa0c244b665489ab32553dd33c47518 and project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:07.033688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:07.038220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a52d65ce-1e42-4453-baff-f07ca33ecac2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075652 Aug 30 17:29:07.039455 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 442/852] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:29:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:07.048890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a512e56-05de-4a89-a168-6d78ba55f28d", "tag": "a11be65a-7537-4f92-8f02-f501ec9de2ad"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:07.058852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:07.059549 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1831ebc2-bee1-4670-947f-d59419f3d526 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.426181 Aug 30 17:29:07.065924 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 411/853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:06 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:07.081026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.081306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:07.081519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.081991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.082120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:07.088869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.090075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.090682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.091595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.092211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.092853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.115052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] Creating event network-changed:a11be65a-7537-4f92-8f02-f501ec9de2ad for instance 3a512e56-05de-4a89-a168-6d78ba55f28d on n-h1-852771-11 Aug 30 17:29:07.127051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-82af1af0-a619-4f3b-a09e-b95a40565030 req-84d722bb-6d84-48d5-b527-aff93fe17e06 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084854 Aug 30 17:29:07.128257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 443/854] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:07.215643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:07.216343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:07.230352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.234156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.237095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.239107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.239610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.240087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.367432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:07.386409 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83b0dcb6-2eb1-46c4-bad5-d94fc8aa286f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.318980 Aug 30 17:29:07.401891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 412/855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:07 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:07.445135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:07.446065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] [instance: 8f78cdb8-3656-4d17-8abf-85c88cea430f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:07.455308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.456575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.457184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.458174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.462888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.463339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.486809 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] HTTP exception thrown: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. Aug 30 17:29:07.488604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Request method failure captured: Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f HTTP/1.1 Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkiCFiqJvni_-e_rsdJJzdUBVneHQcwdKD56vHMa4q32jNrwzaJa5GQwa6xq7htzUduh4kZMcJtnkUtuA0Tc-ExfEvdEmdJTdoSvQVR0cIBlQHo6Dup3bhtJydxNBlfX5hlvtUq6iwVPt9x7QZ3ieBbcQak-mwErC432zjT1x-w11ZA Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:29:07.489247 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa3f513c850349eb87e82b932f0c6f5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa3f513c850349eb87e82b932f0c6f5d"}]}] Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aa3f513c850349eb87e82b932f0c6f5d Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1333076818 Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0245e8dbeef340c29fe8aee66243e417 Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerTestJSON-1333076818-project Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. Aug 30 17:29:07.490836 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8f78cdb8-3656-4d17-8abf-85c88cea430f'} Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:07.491769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. Aug 30 17:29:07.493332 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:07.496536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] Returning 404 to user: Instance 8f78cdb8-3656-4d17-8abf-85c88cea430f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:07.497557 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6bf70286-33b5-4ef5-b70a-6cadaccbca83 tempest-ImagesOneServerTestJSON-1333076818 tempest-ImagesOneServerTestJSON-1333076818-project] 10.222.0.50 "GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f" status: 404 len: 111 microversion: 2.1 time: 0.059228 Aug 30 17:29:07.498588 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 413/856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:07 2022] GET /compute/v2.1/servers/8f78cdb8-3656-4d17-8abf-85c88cea430f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:29:07.511391 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8ecff9c-434d-4922-ae19-f75a2136891b tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.300385 Aug 30 17:29:07.518053 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 444/857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:07 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:07.539695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-143f966a-b393-4424-b4cc-fcc4e3058fc9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d993ba4c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:07.597000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-143f966a-b393-4424-b4cc-fcc4e3058fc9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.061085 Aug 30 17:29:07.597604 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 414/858] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:07 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:07.870417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2aa2e-0a18-4113-9020-2af16249315f", "tag": "4c724896-da2a-45d6-81de-9ce9b17d287d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:07.890193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:07.895989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:07.896915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:07.950419 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] Creating event network-changed:4c724896-da2a-45d6-81de-9ce9b17d287d for instance 9df2aa2e-0a18-4113-9020-2af16249315f on n-h1-852771-11 Aug 30 17:29:07.968760 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-33a2e94f-c98d-446e-a6a4-b15c47c957ef req-ce9affd7-bf32-44ad-a2fd-573749c1ac1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103847 Aug 30 17:29:07.973469 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 445/859] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:08.000701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:08.002266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:08.020322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.026998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.029302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.033490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.034596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.036649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.082080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:08.082837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:08.102540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.105338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.106077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.110397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.111749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.113912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.386451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:08.398217 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-555dcf65-a9f9-4efd-915a-8b3e42bfa531 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1367 microversion: 2.1 time: 0.320935 Aug 30 17:29:08.417276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 446/860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:08 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:08.433018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:08.437993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:08.446328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.448300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.448902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.450402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.451077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.451705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.613932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:08.627966 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-18cfb823-bdc6-43b7-85ff-a696b816cd4d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1476 microversion: 2.1 time: 0.634162 Aug 30 17:29:08.628550 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 415/861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:07 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1476 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:08.637367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:08.638175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:08.652511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.653021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.653458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.655142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:08.655807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:08.656397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:08.669834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:08.681905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80ebddec-944e-43a1-a3c0-b62466a84dc4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.258693 Aug 30 17:29:08.687829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 447/862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:08 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:08.696191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03194e7c-b930-49b8-a29c-2616f4e3a6d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9924eb80>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:08.808614 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03194e7c-b930-49b8-a29c-2616f4e3a6d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.118739 Aug 30 17:29:08.812024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 448/863] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:08 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:09.434116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:09.436485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:09.454961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.456346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.458586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.462613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.463778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.465116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.506210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:09.519560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27fd42c1-6c0d-43e3-9388-830de5b920d4 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1370 microversion: 2.1 time: 0.889514 Aug 30 17:29:09.521677 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 416/864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:08 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1370 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:09.655141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:09.657869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:09.669159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.672661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.674028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.675265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.677584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.678360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.717606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:09.727534 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4651618f-e21d-4c40-855a-cda53d4898bd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1558 microversion: 2.1 time: 0.302115 Aug 30 17:29:09.743943 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 449/865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:09 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:09.751427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:09.752079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:09.761542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.762044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.762492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.763211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.763706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.764146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.927356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:09.936765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58a67d91-df89-4116-bdba-fd81a4b4dcd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.198579 Aug 30 17:29:09.937354 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 450/866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:09 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:09.943263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:09.943790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:09.960483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.960989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.961425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:09.962706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:09.963168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:09.963652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:10.084235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-318fe7ee-0781-4a5a-8734-31e9bbf1a885 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144506 Aug 30 17:29:10.085153 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 451/867] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:29:09 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:10.096849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1737491e-8309-4ff5-80d3-07fa66a3ece5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9944f310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:10.196051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1737491e-8309-4ff5-80d3-07fa66a3ece5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.110011 Aug 30 17:29:10.208277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 452/868] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:10 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:10.334382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:10.350233 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3cfd67db-dcef-4574-a891-de1d973129e4 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1475 microversion: 2.1 time: 0.702754 Aug 30 17:29:10.350831 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 417/869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:09 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1475 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:10.377918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60d5efcf-4192-42d2-9f69-027c378017c9 tempest-ListImageFiltersNegativeTestJSON-914121228 tempest-ListImageFiltersNegativeTestJSON-914121228-project] Calling method '.version_select at 0x7f2d992b0c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:10.426767 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-60d5efcf-4192-42d2-9f69-027c378017c9 tempest-ListImageFiltersNegativeTestJSON-914121228 tempest-ListImageFiltersNegativeTestJSON-914121228-project] HTTP exception thrown: Image not found. Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60d5efcf-4192-42d2-9f69-027c378017c9 tempest-ListImageFiltersNegativeTestJSON-914121228 tempest-ListImageFiltersNegativeTestJSON-914121228-project] Request method failure captured: Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/images/19bce15d-92c8-4a15-a0d2-89c60de72db6 HTTP/1.1 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkjleQ9FXovwAHbKyFVVsZp-Zu5xRBaqOdNL7PEBbBoLpG90KaqKXP7u1NTOq0XSzV8PQ2zTiFcBVRXLX9pxoc2eQcK5yutIPqJp8LpkHlSBPiGARveLBv8U-QogNrYN7HoQfIEhUq30RXCXnovnYlcJgPcFZQnOEvjl1jdewsvuHYw Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6f86b393f2784965bd7a0363854e6528 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-914121228 Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:10.429190 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f86b393f2784965bd7a0363854e6528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f86b393f2784965bd7a0363854e6528"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6f86b393f2784965bd7a0363854e6528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6f86b393f2784965bd7a0363854e6528"}]}] Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-914121228 Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6f86b393f2784965bd7a0363854e6528 Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-914121228 Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListImageFiltersNegativeTestJSON-914121228-project Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d92eb6a1fd7e4c9e8d04530b399bde4f Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-914121228-project Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '19bce15d-92c8-4a15-a0d2-89c60de72db6'} Aug 30 17:29:10.431037 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:29:10.432065 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 19bce15d-92c8-4a15-a0d2-89c60de72db6 Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:29:10.433360 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19bce15d-92c8-4a15-a0d2-89c60de72db6 could not be found. Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:29:10.435334 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:10.436847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60d5efcf-4192-42d2-9f69-027c378017c9 tempest-ListImageFiltersNegativeTestJSON-914121228 tempest-ListImageFiltersNegativeTestJSON-914121228-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:10.438032 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60d5efcf-4192-42d2-9f69-027c378017c9 tempest-ListImageFiltersNegativeTestJSON-914121228 tempest-ListImageFiltersNegativeTestJSON-914121228-project] 10.222.0.50 "GET /compute/v2.1/images/19bce15d-92c8-4a15-a0d2-89c60de72db6" status: 404 len: 62 microversion: 2.1 time: 0.223244 Aug 30 17:29:10.438755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 453/870] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:10 2022] GET /compute/v2.1/images/19bce15d-92c8-4a15-a0d2-89c60de72db6 => generated 62 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:29:10.540526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:10.541340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:10.552436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:10.554875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:10.555583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:10.559167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:10.559898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:10.563452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:10.959235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:10.959833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:10.980791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:10.983041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:10.983682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:10.987863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:10.991000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:10.992072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.216911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:11.226587 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9fef1422-5ae1-497b-9d5f-f7299e5d9098 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1555 microversion: 2.1 time: 0.689845 Aug 30 17:29:11.230540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 418/871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:10 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1555 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:11.244629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-111367dc-8e0c-4904-b1f2-758fe95da7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9938d4c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:11.326058 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-111367dc-8e0c-4904-b1f2-758fe95da7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.094108 Aug 30 17:29:11.328104 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 419/872] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:11 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:11.344517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:11.344856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:11.345524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:11.359335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:11.361260 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-240942dc-e0f9-4512-80ab-b05f9a2d2e53 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.406777 Aug 30 17:29:11.362771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:11.363262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.364138 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 454/873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:10 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:11.364492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:11.365082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:11.367079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.383110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045973ae-b001-4849-9c29-0a7d3bb9f44e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5be2547-1b39-4e07-8398-963a0500c05d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:11.404350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:11.407257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:11.407772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.438125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Creating event network-vif-unplugged:b5be2547-1b39-4e07-8398-963a0500c05d for instance 045973ae-b001-4849-9c29-0a7d3bb9f44e on n-h1-852771-11 Aug 30 17:29:11.459333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:29:11.477122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-739ab6a7-4247-4b63-87cb-fc9e89a9970c req-22ed8559-b321-4ce2-bb93-b305b377fd65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111293 Aug 30 17:29:11.478991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 455/874] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:11.485324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:11.486281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:11.496953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:11.497691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:11.498291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.499928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:11.500596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:11.501193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:11.704472 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-641129e0-1676-4dd2-b1b3-2da51f17ece3 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.375227 Aug 30 17:29:11.705128 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 420/875] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:29:11 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-interface => generated 284 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:12.194517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:12.206887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b9c22d7-51a5-483b-ae07-abbe6a014df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1475 microversion: 2.1 time: 0.726464 Aug 30 17:29:12.212673 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 456/876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:11 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1475 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:12.302231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d", "tag": "d91a0cb9-3531-4beb-8356-4f5fbf5225be"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:12.328316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:12.329055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:12.329663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:12.341978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f608991a-a4cf-4369-ad42-912f688b439d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9944f280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:12.356715 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] Creating event network-changed:d91a0cb9-3531-4beb-8356-4f5fbf5225be for instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d on n-h1-852771-11 Aug 30 17:29:12.375335 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e1f934b8-024b-495c-9dc7-a48ad58c1fdc req-e709d831-659c-4688-8d5e-479401f6731f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078097 Aug 30 17:29:12.376288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 421/877] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:12.389530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:12.390241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:12.399020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:12.400225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:12.400863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:12.401535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:12.401991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:12.402445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:12.439522 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f608991a-a4cf-4369-ad42-912f688b439d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.101361 Aug 30 17:29:12.443060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 457/878] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:12 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:12.685352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-891321206", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "555ceb67-cbe8-440f-b69e-5ec755787dff"}], "security_groups": [{"name": "tempest-securitygroup--1742081205"}], "key_name": "tempest-keypair-1326200053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:12.717245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:12.753905 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56a29cc7-446d-4609-bd9c-0a4622194433 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.368592 Aug 30 17:29:12.772048 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 422/879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:12 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:12.881324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] validate_networks() for [('555ceb67-cbe8-440f-b69e-5ec755787dff', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:13.234156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:13.235829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:13.249770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:13.251327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:13.254820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:13.257006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:13.258459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:13.260968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:13.699276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:13.708663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6da8ff3a-52ce-4b02-875a-fbaf6a95b5e3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1475 microversion: 2.1 time: 0.479099 Aug 30 17:29:13.710504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 423/880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:13 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:13.724470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b2034b5-d154-4784-a9f7-dccb0ccd4eb0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d992f6e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:13.822301 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b2034b5-d154-4784-a9f7-dccb0ccd4eb0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.108809 Aug 30 17:29:13.824638 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 424/881] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:13 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:13.835233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:13.837848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:13.845794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:13.846912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:13.847870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:13.849585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:13.850515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:13.853558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.164068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:14.170774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:14.179593 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a22c3be-8256-4284-b9b2-3b476a9af531 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.353654 Aug 30 17:29:14.194972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 425/882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:13 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:14.415256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:14.416924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.417474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.418358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.419312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.421864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.422371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.463099 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-065c2b6d-a346-4d96-9044-47bcda56fddf tempest-AZV2TestJSON-909372617 tempest-AZV2TestJSON-909372617-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.259719 Aug 30 17:29:14.465913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 426/883] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 30 17:29:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:29:14.546932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5515e53-fea6-4869-9cda-21a7c6d7cd30", "tag": "93f1d1cb-660e-413e-b6ae-2505b1587313"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:14.568532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.569011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.569450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.585260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:14.586503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:14.587233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:14.587902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:14.589052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:14.601562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.603995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.604772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.605882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.606604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.607380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.611449 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] Creating event network-changed:93f1d1cb-660e-413e-b6ae-2505b1587313 for instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 on n-h1-852771-11 Aug 30 17:29:14.624771 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8fe37604-bad9-4694-b115-a040b16509a7 req-e2afd80a-20e7-46ac-9fbb-5ec8c23850e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081496 Aug 30 17:29:14.625393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 427/884] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:14.641057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:14.648444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for user 5fa0c244b665489ab32553dd33c47518 and project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:14.667604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:14.670998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:14.732744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:14.733360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:14.746274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.746760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.747192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.747930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:14.748371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:14.753418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:14.794680 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bdffcb8d-43c3-4040-9abf-ffb1d48e7199 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.114101 Aug 30 17:29:14.804425 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 458/885] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:29:14.811366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e0e02d6-2714-4e96-9bd1-65c31e306d81 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:14.812365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e0e02d6-2714-4e96-9bd1-65c31e306d81 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:14.949784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e0e02d6-2714-4e96-9bd1-65c31e306d81 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:14.962586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e0e02d6-2714-4e96-9bd1-65c31e306d81 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1234 microversion: 2.1 time: 0.156057 Aug 30 17:29:14.992843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 459/886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:14 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1234 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:15.016310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30415322-c9e6-48e1-994e-ff1b1c33f97a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d99318700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:15.124421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:15.135781 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2449690e-22fc-42b0-8431-b580b9318e76 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1473 microversion: 2.1 time: 0.407295 Aug 30 17:29:15.136523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 428/887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:14 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1473 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:15.137328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30415322-c9e6-48e1-994e-ff1b1c33f97a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.140402 Aug 30 17:29:15.138961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 460/888] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:14 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:15.201709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:15.208027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:15.215680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:15.216389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:15.216983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:15.217848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:15.218460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:15.219071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:15.926580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:15.937106 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-771b3b84-c896-42a1-9eae-148963eda565 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.739218 Aug 30 17:29:15.943849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 429/889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:15 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:15.984171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:15.985376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:15.996749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:15.997499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:15.998198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:15.999076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:15.999717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.004202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.154430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ea5bdc3-652a-41db-89bb-b210fe9e5ebb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d993270d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:16.182698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:16.193518 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e517f3b-c85b-4131-90e2-7f73d865d7db tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1238 microversion: 2.1 time: 0.212700 Aug 30 17:29:16.200703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 461/890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:15 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1238 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:16.230180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:16.233127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:16.248285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.249319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.265427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.267190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.276628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.277596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.288436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ea5bdc3-652a-41db-89bb-b210fe9e5ebb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.139032 Aug 30 17:29:16.289163 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 430/891] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:16 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:16.615861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:16.640334 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78f7fe2f-75ab-42e3-ad1c-8fb2b7d6369d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1470 microversion: 2.1 time: 0.436806 Aug 30 17:29:16.643241 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 462/892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:16 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1470 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:16.668134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:16.668813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:16.683055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.684107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.684681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.685626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.686193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.689079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.813488 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c7403fac-1ee4-46b1-910c-96dd60fe1c32 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e/action" status: 204 len: 0 microversion: 2.1 time: 0.152532 Aug 30 17:29:16.815015 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 431/893] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:29:16 2022] POST /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e/action => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:29:16.823224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:16.824492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:16.842585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.843746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.845217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.851456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.851995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.853164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.961006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:16.962453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:16.977575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.984081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.985445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:16.986697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:16.987382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:16.988230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:17.116348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:17.128019 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2afdd1f5-b6b6-4df0-943b-7cd6261d1b73 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1470 microversion: 2.1 time: 0.308875 Aug 30 17:29:17.133828 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 463/894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:16 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:17.219126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:17.220559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:17.234355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:17.235152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:17.236426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:17.238960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:17.239759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:17.241331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:17.495357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:17.520143 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2d31df7-2fca-4564-bafe-9c63510e314d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1294 microversion: 2.1 time: 0.306121 Aug 30 17:29:17.541369 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 464/895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:17 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:17.558235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-169751e7-380d-42ca-a213-76ddd5416dd7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98dcd5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:17.612382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:17.630018 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4910f76d-024e-46db-a6f1-cb43209aca97 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.673650 Aug 30 17:29:17.648911 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 432/896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:16 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:17.701949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-169751e7-380d-42ca-a213-76ddd5416dd7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1414 microversion: 2.1 time: 0.159200 Aug 30 17:29:17.711329 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 465/897] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:17 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:17.947629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a512e56-05de-4a89-a168-6d78ba55f28d", "name": "network-vif-plugged", "status": "completed", "tag": "a11be65a-7537-4f92-8f02-f501ec9de2ad"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:17.982026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:17.984317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:17.986242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.016750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] Creating event network-vif-plugged:a11be65a-7537-4f92-8f02-f501ec9de2ad for instance 3a512e56-05de-4a89-a168-6d78ba55f28d on n-h1-852771-11 Aug 30 17:29:18.026303 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5705d79b-a91f-4535-828b-a5ed2d8d7d22 req-f5d1a7d4-bcda-4902-9f74-fac28b9e4099 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082926 Aug 30 17:29:18.027120 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 433/898] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:18.155740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:18.157429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:18.176690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.179318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.179964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.181692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.183747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.184593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.245027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:18.459362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:18.474508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-55f21a8c-3132-4649-a91c-ea39cc5269b5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1470 microversion: 2.1 time: 0.322116 Aug 30 17:29:18.478011 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 466/899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:18 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:18.543990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:18.544893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:18.560323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.561095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.561744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.562834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.563968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.564964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.661314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:18.662203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:18.672627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.672858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.673298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.674379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:18.675021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:18.675641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:18.730145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:18.739953 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad4e50ab-0ce1-4a9e-b99e-769cfca58701 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1292 microversion: 2.1 time: 0.200537 Aug 30 17:29:18.741309 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 434/900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:18 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1292 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:18.760571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97422658-b9e3-46ac-a971-b206c3fe6b31 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d990dd550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:18.874190 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97422658-b9e3-46ac-a971-b206c3fe6b31 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1423 microversion: 2.1 time: 0.131103 Aug 30 17:29:18.875042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 435/901] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:18 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:18.891333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4944d534-afb9-405f-8114-488dff853739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d99002790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:18.935280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:18.943613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e1610b4-0413-47ba-bedb-680cd138ab22 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1319 microversion: 2.1 time: 0.286343 Aug 30 17:29:18.944424 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 467/902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:18 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:18.971192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4944d534-afb9-405f-8114-488dff853739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 200 len: 1423 microversion: 2.1 time: 0.085222 Aug 30 17:29:18.972129 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 436/903] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:29:18 2022] GET /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:18.985562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce51d26e-0af4-401d-b36c-8b5602344c99 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d993021f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:19.497843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:19.504427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:19.520358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:19.520852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:19.522604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:19.525698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:19.526514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:19.531930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:19.809755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:19.831167 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a3154647-0467-402a-b884-df2fa543beb6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1470 microversion: 2.1 time: 0.339356 Aug 30 17:29:19.842359 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 437/904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:19 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:19.856351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:19.859434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:19.897503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:19.910697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:19.917706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:19.918939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:19.921677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:19.924115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:19.930368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce51d26e-0af4-401d-b36c-8b5602344c99 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 204 len: 0 microversion: 2.1 time: 0.948449 Aug 30 17:29:19.931370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 468/905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:18 2022] DELETE /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 0 bytes in 950 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:29:19.939169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:19.986904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:19.988563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:19.990741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.019068 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] Creating event network-changed:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h2-852771-11 Aug 30 17:29:20.025316 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-eb20b610-958a-4bcb-8b24-12f32e96b8b1 req-a84fe3cd-ceb4-4618-965b-83f6f7aaa970 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091821 Aug 30 17:29:20.026443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 469/906] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:20.032033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:20.032834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:20.039310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.040531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.041240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.042098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.042863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.043438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.075317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:29:20.185131 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e7220dc-c9d9-4e44-bf0e-7e11a2d3b150 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 204 len: 0 microversion: 2.1 time: 0.155673 Aug 30 17:29:20.192055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 470/907] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:20 2022] DELETE /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:29:20.198315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:20.199019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:20.205642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.206335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.207135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.208030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.208638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.209286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.393252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:20.402384 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2aca211d-8df4-4682-8eac-ed25087e45e0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1469 microversion: 2.1 time: 0.209014 Aug 30 17:29:20.415951 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 471/908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:20 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:20.423211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:20.424685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045973ae-b001-4849-9c29-0a7d3bb9f44e", "name": "network-vif-plugged", "status": "completed", "tag": "b5be2547-1b39-4e07-8398-963a0500c05d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:20.435570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.436455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.437102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.437720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0bef0669-df58-48fb-b395-191cfab94b68 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.593628 Aug 30 17:29:20.438618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 438/909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:19 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:20.450536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-163304466", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "761babee-31fe-4fa1-8591-541df7f3d7a0"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:20.459240 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Creating event network-vif-plugged:b5be2547-1b39-4e07-8398-963a0500c05d for instance 045973ae-b001-4849-9c29-0a7d3bb9f44e on n-h1-852771-11 Aug 30 17:29:20.467462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:29:20.475187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a592be90-0154-4905-8b63-3db08eccff01 req-5c3f4785-0ce3-4f6e-9e00-125f59b3a9b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056915 Aug 30 17:29:20.475908 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 472/910] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:20.482717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:20.483517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:20.494280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.495371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.496080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.496874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.498725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.499244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.517129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] validate_networks() for [('761babee-31fe-4fa1-8591-541df7f3d7a0', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:20.677735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:20.688918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe60bb9b-19dc-474f-b1b3-e98ce9c53f66 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1469 microversion: 2.1 time: 0.211294 Aug 30 17:29:20.703505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 473/911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:20 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:20.714145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:20.721840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:20.722929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Searching by: {'reservation_id': 'r-a3die9kv', 'deleted': False, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:29:20.729783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.730530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.731144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.732051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.733195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.733794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:20.863964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:29:20.938837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:20.946582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:20.947230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:20.947716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.100881 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-913f73c6-4d40-438f-b311-d75cd087214c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-a3die9kv" status: 200 len: 2931 microversion: 2.1 time: 0.392403 Aug 30 17:29:21.103295 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 474/912] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Aug 30 17:29:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-a3die9kv => generated 2931 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:21.109989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:21.111500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:21.118998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.119728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.120301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.121388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.122021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.122597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.304099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:21.317109 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-74777875-2e12-4b9c-acee-914e37facb3a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1462 microversion: 2.1 time: 0.212481 Aug 30 17:29:21.328210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 475/913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:21 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1462 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:21.328210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:21.345587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_groups [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Querying cell d64e249a-e872-487f-b759-da855b1e5621(cell1) for 2 instances {{(pid=122124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 17:29:21.346315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.346795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.347229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.382759 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-609873af-bc77-420e-ac33-ad13458399a0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/7bc9954a-752c-4bbf-96ee-4f82dca857fd" status: 200 len: 270 microversion: 2.1 time: 0.061250 Aug 30 17:29:21.383625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 476/914] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:29:21 2022] GET /compute/v2.1/os-server-groups/7bc9954a-752c-4bbf-96ee-4f82dca857fd => generated 270 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:21.388703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:21.389779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:21.396728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.397449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.398091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.399644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.400274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.401191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.539767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:21.548370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1f0f5703-08d6-421e-93e8-7ed8ebf16f34 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1462 microversion: 2.1 time: 0.163244 Aug 30 17:29:21.548966 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 477/915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:21 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:21.553650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:21.554284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:21.567667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.568877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.569642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.571319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.572431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.572915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.587299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:21.588060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:21.588687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:21.589309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:21.590805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:21.621554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.622059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.622486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.623263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.623791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.624210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.651766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:21.657122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for user e9055e63b6e44751844a7274c1979566 and project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:21.670459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:21.672844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:21.723446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87191b1d-66e9-4dc8-9d69-793e8dfbcf36 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282795 Aug 30 17:29:21.724395 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 439/916] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:29:21.729154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:21.729963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:21.732253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:21.740214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.740959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.741835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:21.742774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:21.743379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:21.744985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:22.074568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:22.087093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-110c78f3-d394-4b8d-840e-ef18bf8d4f84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.360233 Aug 30 17:29:22.087999 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 440/917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:21 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:22.098509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae40a499-d5cb-4f49-a60f-7345df62b8af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'create', calling method: .version_select at 0x7f2d993270d0>, body: {"keypair": {"name": "tempest-keypair-350239531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq6UiDPXLftxwjiqAK2SnYS5ARk/dUhttI4Qtf5TVvCcQMNE00rmqekTWGN+PcuFuHLUA8tzVkzhnzc8Gppk1A4HEKuMyscU7pgVHt+GjLKf9iOjuPK2XKEGh3Lgklz9w=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:22.140819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ae40a499-d5cb-4f49-a60f-7345df62b8af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:22.156888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ae40a499-d5cb-4f49-a60f-7345df62b8af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:22.161084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-178bdfb7-d6ad-410c-9e67-f41dc477b9a0 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 200 len: 1622 microversion: 2.1 time: 0.610863 Aug 30 17:29:22.176943 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 478/918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:21 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 1622 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:22.182681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b69593cd-cbd3-4bd3-a3ad-3bfe01d12d6d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:22.183308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b69593cd-cbd3-4bd3-a3ad-3bfe01d12d6d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:22.205460 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae40a499-d5cb-4f49-a60f-7345df62b8af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114946 Aug 30 17:29:22.206053 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 441/919] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:29:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:22.212738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:22.225198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:22.234319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:22.241792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:22.243863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:22.245823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:22.247047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:22.249203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:22.292611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b69593cd-cbd3-4bd3-a3ad-3bfe01d12d6d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:22.308403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b69593cd-cbd3-4bd3-a3ad-3bfe01d12d6d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1207 microversion: 2.1 time: 0.126384 Aug 30 17:29:22.309925 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 479/920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:22 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1207 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:22.686661 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dce51b72-ca6a-45fc-8cb8-2f2ed2d70d3c tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1622 microversion: 2.1 time: 0.477756 Aug 30 17:29:22.687841 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 442/921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:22 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1622 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:22.801762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-799940774", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f469e743-c50d-4bb3-bfe5-12c224de8f51"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:22.897778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:23.111828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:23.112740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:23.119872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.120586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.121286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.122436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.122966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.123493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.261627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:23.262768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:23.263417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:23.264011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:23.264604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:23.278063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.278743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.279465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.280384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.281145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.281735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.306377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:23.318708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:23.361051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:23.363165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:23.379280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:23.450906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c96c0b18-617e-439f-851f-c404f65c3ccd tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653385 Aug 30 17:29:23.452334 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 480/922] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:29:23.459742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b09f88a-fa60-412b-9ae5-644b99ee7c89", "name": "network-vif-deleted", "tag": "8c4e1a6e-294f-4240-85fc-ab701baf45e7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:23.468330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:23.472669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.473289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.474828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.480851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-398bb9ca-25e3-4a06-a87a-f947609258eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.372878 Aug 30 17:29:23.491192 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 443/923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:23 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:23.491192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:23.491192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:23.507996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] Creating event network-vif-deleted:8c4e1a6e-294f-4240-85fc-ab701baf45e7 for instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 on n-h2-852771-11 Aug 30 17:29:23.513847 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6946b744-c4f2-4313-82ea-c6cc11b64935 req-b2c52c2b-9957-4f85-b23d-dec2bc5f2356 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060313 Aug 30 17:29:23.515251 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 481/924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:23.522729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b549075f-91c0-4927-b970-466fb27f5beb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:23.524395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b549075f-91c0-4927-b970-466fb27f5beb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:23.537929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.540780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.541420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.542302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:23.545307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:23.546484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:23.696890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:23.713202 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0c31c15-5a57-4211-8606-153720c9b337 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1259 microversion: 2.1 time: 0.227070 Aug 30 17:29:23.717209 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 444/925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:23 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:23.753215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b549075f-91c0-4927-b970-466fb27f5beb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:23.765507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b549075f-91c0-4927-b970-466fb27f5beb tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1216 microversion: 2.1 time: 0.248075 Aug 30 17:29:23.778749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 482/926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:23 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1216 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:24.506705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:24.509850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:24.539707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.541682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.543116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:24.545443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.546336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.547261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:24.748562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:24.749928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:24.765978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.767013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.767715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:24.768797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.769467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.772006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:24.865028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:24.874698 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96e187c3-7aaf-45bd-9d13-822b9e3e9129 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.375071 Aug 30 17:29:24.875735 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 445/927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:24 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:24.881121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:24.882038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:24.899360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.900111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.903918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:24.905003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:24.905690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:24.906332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:25.004216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:25.026136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7561042b-36a3-4759-b720-9414db6a3186 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1277 microversion: 2.1 time: 0.281527 Aug 30 17:29:25.031965 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 483/928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:24 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:25.063659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:25.080280 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4419acf-f76d-4e89-b3e0-429d8dcdb04a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1268 microversion: 2.1 time: 0.203005 Aug 30 17:29:25.080946 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 446/929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:24 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:25.897568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:25.898181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:25.911351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:25.912261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:25.912925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:25.913885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:25.915527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:25.916213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.053532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:26.054949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:26.066853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:26.067712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:26.069914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.072863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:26.073614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:26.074285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.168333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:26.178427 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-abd673fb-05c0-4865-8a14-10e13cba5efd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1265 microversion: 2.1 time: 0.129280 Aug 30 17:29:26.194419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 447/930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:26 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:26.210326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:26.210952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:26.227526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:26.228030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:26.228736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.229844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:26.230461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:26.231196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.240839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:26.361610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:26.371855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65d3c7bc-f938-4955-9fb0-58e53edc9d25 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1274 microversion: 2.1 time: 0.173481 Aug 30 17:29:26.373157 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 448/931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:26 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:26.482458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:26.495778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ddf1066b-4b40-4a2b-9444-7b542538dcec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.599463 Aug 30 17:29:26.496733 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 484/932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:25 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:26.626270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7534ba7-8367-4d41-89c9-60c9c8ef340a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '.version_select at 0x7f2d991e5280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:26.630468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7534ba7-8367-4d41-89c9-60c9c8ef340a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:26.637696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7534ba7-8367-4d41-89c9-60c9c8ef340a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:26.638778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7534ba7-8367-4d41-89c9-60c9c8ef340a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:26.660545 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7534ba7-8367-4d41-89c9-60c9c8ef340a tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.039151 Aug 30 17:29:26.661161 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 449/933] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:29:26 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:26.682794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a796578-3ceb-46cf-8296-4c6c59392857 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:26.694089 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a796578-3ceb-46cf-8296-4c6c59392857 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018380 Aug 30 17:29:26.705708 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 485/934] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:29:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:26.709897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61f41e36-e87e-40d3-b7e5-2094d7ebd580 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-886412508", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:26.746695 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61f41e36-e87e-40d3-b7e5-2094d7ebd580 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.040197 Aug 30 17:29:26.749106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 450/935] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Aug 30 17:29:26 2022] POST /compute/v2.1/flavors => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:26.769228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89c3f6e8-e3c9-43c2-a8e3-aa7ca5630722 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:26.788802 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89c3f6e8-e3c9-43c2-a8e3-aa7ca5630722 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033269 Aug 30 17:29:26.792249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 486/936] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 30 17:29:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:29:27.005945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-189975713", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "29fb62f7-2f80-4d99-abac-79d5b1c5e115"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:27.094043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:27.202227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:27.204170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:27.238157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.240672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.242500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.244779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.246505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.249503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.764509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:27.767052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:27.768265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:27.771318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:27.772464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:27.792863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.795275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.795762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.796559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.797012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.797472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.808183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:27.828143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:27.833784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:27.844419 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4629d3a-62d1-44d1-9617-9f31aea30ce6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.644897 Aug 30 17:29:27.848329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:27.850669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:27.861877 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 487/937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:27 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:27.878731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "name": "network-vif-plugged", "status": "completed", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:27.897753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.898833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.900468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.908766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:27.919223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e3dfa691-bbca-41ed-bfd4-84d6fcc984f3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917120 Aug 30 17:29:27.922205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 451/938] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:29:27.936281 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] Creating event network-vif-plugged:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h2-852771-11 Aug 30 17:29:27.939590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:27.949123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9cb8d096-f7fd-4e1d-8742-b0762be86356 req-a4da6c4f-6fdf-4cf7-a71e-6b838cf6b24e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085369 Aug 30 17:29:27.951057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 488/939] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:27.951710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:27.967420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:27.972779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.973489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.974073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.975152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:27.977111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:27.977718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:27.980464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:28.007099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.007810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.010084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.015272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.016041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.016774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.385514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:28.396351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-497dac0f-fb1c-41c2-8b16-04859ed83ddb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.441076 Aug 30 17:29:28.397791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 489/940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:27 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:28.404384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d71ed0e-e8b9-46e5-8b16-cac6519fcb1a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:28.405673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d71ed0e-e8b9-46e5-8b16-cac6519fcb1a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:28.517707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d71ed0e-e8b9-46e5-8b16-cac6519fcb1a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:28.525884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:28.530059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d71ed0e-e8b9-46e5-8b16-cac6519fcb1a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1278 microversion: 2.1 time: 0.130389 Aug 30 17:29:28.531185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 490/941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:28 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:28.540094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b20018f1-2178-4858-ad44-5e78e34a07f5", "tag": "b127ffbf-7ecd-4f36-946d-1f106d1eba0f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:28.547708 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03c9a849-8cf7-47e6-a815-dd918c0f7894 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.624062 Aug 30 17:29:28.549034 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 452/942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:27 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:28.554045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.555277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.556011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.567215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] Creating event network-changed:b127ffbf-7ecd-4f36-946d-1f106d1eba0f for instance b20018f1-2178-4858-ad44-5e78e34a07f5 on n-h2-852771-11 Aug 30 17:29:28.572688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d64bde74-9ca9-462a-bcb5-9762c6431e67 req-e6384fb9-1681-4c93-b825-b5491b5400d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038417 Aug 30 17:29:28.573480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 491/943] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:28.710044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5de5d84-d461-4587-984e-3561d9cd735a", "tag": "6d010187-aee8-4991-9d8f-4e07e234c2b8"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:28.757629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.761839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.764543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.788733 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] Creating event network-changed:6d010187-aee8-4991-9d8f-4e07e234c2b8 for instance c5de5d84-d461-4587-984e-3561d9cd735a on n-h2-852771-11 Aug 30 17:29:28.800368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-04ad5686-a4fe-44cb-aa14-3adb6648a271 req-83763ebe-9fcb-43f3-bbc9-175e467c55c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098354 Aug 30 17:29:28.807886 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 453/944] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:28.874634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:28.875626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:28.885150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.885640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.886076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.886789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:28.887240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:28.893239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:28.986451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b92b1fe5-e91b-4891-aad7-f6f86eae50ba tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Action: 'create', calling method: .version_select at 0x7f2d98dcdb80>, body: {"keypair": {"name": "tempest-keypair-1056851449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSZRJEp5kuEnXduAiUzL+stVlOrE0N5oB4bmPQTjwMk/iBx0Xi4NfaLDigQINaRKuh+guuUsRTn9saZhCevvkfkeJDfrA53xI9fgp/nt7Rg+FPTYrkh80ugzVgsVrAO0A=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:29.006715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b92b1fe5-e91b-4891-aad7-f6f86eae50ba tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Getting quotas for project 96bd4eea15f44593b4213e27a90bc197. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:29.013205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b92b1fe5-e91b-4891-aad7-f6f86eae50ba tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Getting quotas for user 69e124bb201348b8adc5db7d060b5a3b and project 96bd4eea15f44593b4213e27a90bc197. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:29.045043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b92b1fe5-e91b-4891-aad7-f6f86eae50ba tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.295664 Aug 30 17:29:29.046285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 492/945] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:29:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:29.074343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:29.084270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22a09221-6dcb-4c2f-8668-39bf10e090fb tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.213695 Aug 30 17:29:29.085730 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 454/946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:28 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:29.424796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:29.426897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:29.447102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.448884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.451239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.453065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.454738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.455844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.554749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:29.554749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:29.563391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.564441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.565102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.566085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.566726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.567254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.689557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:29.700791 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-582c227b-c72f-405e-973b-cc5fc8c57d30 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1360 microversion: 2.1 time: 0.284044 Aug 30 17:29:29.701118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:29.701993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 493/947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:29 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:29.708785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:29.710372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:29.721114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.721307 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a2ab26d-004d-43b0-b078-a94d2fcbc321 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1330 microversion: 2.1 time: 0.172716 Aug 30 17:29:29.721936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.722510 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 455/948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:29 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1330 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:29.723333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.724387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:29.724903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:29.725445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:29.887705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:29.896637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07b6efe2-7669-4627-acc3-6c62edda0070 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.192736 Aug 30 17:29:29.897315 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 494/949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:29 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:30.107930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:30.108559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:30.116518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.117422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.118379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.119100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.119582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.120011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.333725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:30.349302 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ffdbdf20-4ed8-40d7-9530-578c9df07d92 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.245302 Aug 30 17:29:30.349988 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 456/950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:30 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:30.722680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:30.723882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:30.731393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.731905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.732296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.732999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.733458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.733886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.743939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:30.745297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:30.760458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.761979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.762871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.765541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:30.766105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:30.767807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:30.923390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:30.935060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-242c0c49-256d-41bf-a804-8553c8feb832 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1330 microversion: 2.1 time: 0.196346 Aug 30 17:29:30.948463 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 457/951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:30 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1330 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:30.957232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "504b4a9c-05dd-4dea-b8ac-46be63918ff2"}], "security_groups": [{"name": "tempest-securitygroup--1074356760"}], "key_name": "tempest-keypair-1056851449", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:31.007573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:31.022384 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-226bc788-6371-4139-b88a-cbbc7e450711 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1544 microversion: 2.1 time: 0.299991 Aug 30 17:29:31.025005 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 495/952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:30 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:31.031058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:31.050400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:31.066739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.067392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.067929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.069158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.069876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.070586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.187103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] validate_networks() for [('504b4a9c-05dd-4dea-b8ac-46be63918ff2', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:31.237658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:31.254599 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65a64d90-5b6e-4cad-9b95-ccac08922df6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.228299 Aug 30 17:29:31.255495 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 496/953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:31 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:31.262907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:31.264235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:31.280176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.280924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.283201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.284216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.284870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.285503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.390441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3db577cd-7b28-452c-8fe8-7bcc75ad83f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132978 Aug 30 17:29:31.392056 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 497/954] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:29:31 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:31.396531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:31.397927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:31.410807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.411823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.412223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.413184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.414655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.415149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.668412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:31.668827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:31.669470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:31.669923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:31.670613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:31.681555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.682032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.682459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.683358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.683977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.684567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.704643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Getting quotas for project 96bd4eea15f44593b4213e27a90bc197. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:31.711148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Getting quotas for user 69e124bb201348b8adc5db7d060b5a3b and project 96bd4eea15f44593b4213e27a90bc197. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:31.725488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:31.728253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:31.754483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:31.768870 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c00a39a8-fa34-483d-8088-97249dc8b1b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.375986 Aug 30 17:29:31.769499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 498/955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:31 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:31.795559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fc8959a-39d8-4b03-93d0-65652fabd6eb tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.845284 Aug 30 17:29:31.796211 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 458/956] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:29:31.811704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d3f77af-c493-4777-9587-2db68dcce9e3 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:31.812327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d3f77af-c493-4777-9587-2db68dcce9e3 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:31.938068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d3f77af-c493-4777-9587-2db68dcce9e3 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:31.947323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=31 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:31.951964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d3f77af-c493-4777-9587-2db68dcce9e3 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1226 microversion: 2.1 time: 0.145775 Aug 30 17:29:31.952972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 499/957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:31 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:31.962345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:31.963007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:31.970600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.971104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.971547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:31.972782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:31.973558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:31.974461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.257384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:32.277995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:32.278619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:32.280288 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-caa6e8a1-4a76-4cce-ae1f-428d5b7d68ae tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1338 microversion: 2.1 time: 0.319255 Aug 30 17:29:32.294036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 459/958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:31 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1338 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:32.301298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.311143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.315807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.316892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.317962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.319039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.716515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:32.725222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4661c61b-bc27-4173-8e1e-22ac15f2e4c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.450969 Aug 30 17:29:32.751826 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 500/959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:32 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:32.792905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:32.793808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:32.802082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.803241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.803924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.805007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.805702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.806453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.975228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:32.977519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:32.990289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.993014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.993830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:32.994739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:32.995362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:32.996034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:33.189106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:33.199980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8124b58a-313f-4e25-b165-e6e526bac51c tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1278 microversion: 2.1 time: 0.228994 Aug 30 17:29:33.201266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 501/960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:32 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:33.309561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:33.310435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:33.316137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:33.325797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:33.327439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:33.328522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:33.329595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:33.330751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:33.331461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:33.458087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:33.468303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-878bd7f7-6ad1-41f6-8a7f-bd99629c98e6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1336 microversion: 2.1 time: 0.166375 Aug 30 17:29:33.482074 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 502/961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:33 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1336 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:33.561541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:33.573932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:33.574566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:33.575098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:33.589279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] Creating event network-changed:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h2-852771-11 Aug 30 17:29:33.595694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7b1944d9-67e5-4f7c-97d5-5c013b20ed5c req-f3d6466e-2dc5-49a2-b552-89acd1eaeff1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039604 Aug 30 17:29:33.597416 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 503/962] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:33.688936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:33.699012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ffe5ef2e-b4cd-419e-8de1-633c7705e5cf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.912754 Aug 30 17:29:33.700540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 460/963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:32 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:33.755096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:33.756266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:33.774524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:33.776004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:33.777195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:33.778243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:33.780765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:33.784251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.104666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:34.113243 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cbc8e3f4-0511-48d5-a831-acbe55299e42 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.369361 Aug 30 17:29:34.127664 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 504/964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:33 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:34.222294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:34.223521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:34.231296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.232028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.232640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.233488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.234090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.234669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.422333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:34.433672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ec607be-3c8d-4961-88f3-b8da34381537 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1284 microversion: 2.1 time: 0.215111 Aug 30 17:29:34.435740 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 461/965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:34 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:34.493351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:34.494247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:34.500778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.501464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.502062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.502925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.503588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.504300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.575812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:34.584773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4ff6bb2-6561-4ea8-951e-8d3953b2b7f5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1336 microversion: 2.1 time: 0.096009 Aug 30 17:29:34.586912 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 505/966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:34 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:34.723429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:34.724066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:34.730602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.731080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.731676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:34.732367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:34.732810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:34.733226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.106663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:35.122615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b60206cd-965d-415a-9e37-6d0dd3747540 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.403586 Aug 30 17:29:35.123270 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 462/967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:34 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:35.136477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:35.136477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:35.153112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.153587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.154050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.154819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.155512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.155943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.361532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:35.371139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eea62ee8-2745-4817-a103-b4bdeb89afa7 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.240657 Aug 30 17:29:35.371764 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 506/968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:35 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:35.457822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:35.458579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:35.466393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.466904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.467360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.468067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.468547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.468965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.551621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:35.560445 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb7e4014-22d0-4bca-8d4a-f1d514d18e9e tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1284 microversion: 2.1 time: 0.108871 Aug 30 17:29:35.561025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 463/969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:35 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:35.607134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:35.607882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:35.613878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.614426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.614923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.615704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.616529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.617748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.772392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:35.783432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8de8fad-94fc-4481-a72c-d3234432c5af tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.179037 Aug 30 17:29:35.785216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 507/970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:35 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:35.879738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de5d84-d461-4587-984e-3561d9cd735a", "name": "network-vif-plugged", "status": "completed", "tag": "6d010187-aee8-4991-9d8f-4e07e234c2b8"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:35.899346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:35.899845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:35.900271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:35.928531 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] Creating event network-vif-plugged:6d010187-aee8-4991-9d8f-4e07e234c2b8 for instance c5de5d84-d461-4587-984e-3561d9cd735a on n-h2-852771-11 Aug 30 17:29:35.934279 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f6ae7cdb-ba07-4cb8-be0e-f45bad415c25 req-b380554c-7e1c-4f33-ab39-544bf1734c4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060320 Aug 30 17:29:35.935443 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 464/971] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:36.145246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:36.146200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:36.155195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.155932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.156518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.157436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.158204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.158783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.370828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:36.380690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0382a68-a15e-46e8-87bd-992e245b8938 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.239770 Aug 30 17:29:36.381300 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 508/972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:36 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:36.393053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:36.393944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:36.402742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.403690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.404257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.405146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.406051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.406603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.584368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:36.585436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:36.596265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.597461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.598123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.599364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.600407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.601721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.761830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:36.771213 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d309fd8-cefd-4b0a-8693-a5071fb10f04 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.192863 Aug 30 17:29:36.775599 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 509/973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:36 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:36.784676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:36.795047 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b53ac9b-1559-4f67-a120-eeef01c36bbf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.406526 Aug 30 17:29:36.796078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 465/974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:36 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:36.807593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:36.808882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:36.818225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.818717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.819155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.819943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.820403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.820829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.825345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:36.967817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:36.969500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:36.980232 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b4b6bd5-5e29-41c9-8132-2c067f062a1d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.179456 Aug 30 17:29:36.980461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:36.980704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:36.980861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 510/975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:36 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:36.981411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:36.994592 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] Creating event network-changed:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:29:36.999691 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e96f1447-39a9-4560-b534-5535c49829d6 req-996c0ba1-8bf0-44c4-8c51-b5b40b97106f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034067 Aug 30 17:29:37.000285 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 466/976] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:37.405113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:37.405744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:37.413051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.413598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.413987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.414703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.415161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.415618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.557877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:37.565697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87a01ae3-c921-4c98-9a66-0e8198bad7c0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1307 microversion: 2.1 time: 0.164643 Aug 30 17:29:37.566274 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 511/977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:37 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:37.793734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:37.794428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:37.800490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.800966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.801391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.802071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.802520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.802935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.820619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:37.821352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:37.827488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.827992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.828421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.829111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:37.829578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:37.830165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:37.987784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:37.998414 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ec86f41-cd5b-4401-825c-ee890c29e174 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.182347 Aug 30 17:29:37.999420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 512/978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:37 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:38.011342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20018f1-2178-4858-ad44-5e78e34a07f5", "name": "network-vif-plugged", "status": "completed", "tag": "b127ffbf-7ecd-4f36-946d-1f106d1eba0f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:38.020838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.021316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.021745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.033022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] Creating event network-vif-plugged:b127ffbf-7ecd-4f36-946d-1f106d1eba0f for instance b20018f1-2178-4858-ad44-5e78e34a07f5 on n-h2-852771-11 Aug 30 17:29:38.037996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-44e9c00f-405c-4c24-9c19-90703e9235ff req-ad556b84-30ac-4ed8-8d78-0617d02a7444 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Aug 30 17:29:38.041682 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 513/979] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:38.046897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:38.048253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:38.055560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:38.055772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.056227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.056667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.057374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.057829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.058726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.068674 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c638758-12f4-4f53-9c9e-4c35ae37250a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.279231 Aug 30 17:29:38.069556 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 467/980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:37 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:38.203216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:38.211708 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a476232-1bfa-4f60-b3a0-156e1095a1df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.168864 Aug 30 17:29:38.212320 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 514/981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:38 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:38.587015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:38.587643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:38.593541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.594013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.594499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.595178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.595649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.596065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.728455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:38.736086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd08276d-532f-4d40-8d73-e8d066b8ddf9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1487 microversion: 2.1 time: 0.152952 Aug 30 17:29:38.736649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 468/982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:38 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1487 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:38.756565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:38.763721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.764212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.764653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.825339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Going to try to stop instance {{(pid=122124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:29:38.867555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45711be9-64aa-4d29-b43d-5ffeb63be6b0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a/action" status: 202 len: 0 microversion: 2.1 time: 0.114727 Aug 30 17:29:38.868164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 515/983] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:29:38 2022] POST /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:29:38.876245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:38.876852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:38.883721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.884190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.884619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:38.885293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:38.885734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:38.886147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.014855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:39.017231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:39.021122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:39.021862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:39.025221 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1620a95e-8cfb-42bd-8ad3-d8b8b8fd377d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.152687 Aug 30 17:29:39.025831 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 469/984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:38 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:39.035700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.035700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.035700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.036027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843620e-f9b8-4233-b4e5-33a005a2c77a", "tag": "fc7e65db-2b93-4534-9dca-751e0e58e45e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:39.036119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.036119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.036119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.036370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:39.042064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.042534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.042962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.054957 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] Creating event network-changed:fc7e65db-2b93-4534-9dca-751e0e58e45e for instance b843620e-f9b8-4233-b4e5-33a005a2c77a on n-h1-852771-11 Aug 30 17:29:39.059973 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ac21e61d-9a5e-40fb-a2cf-67832a117353 req-ee0cff54-1d80-4ca1-b74e-dd9bebdd8fc4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033019 Aug 30 17:29:39.060574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 470/985] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:39.096258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:39.096956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:39.103735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.104220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.104654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.105346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.105797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.106216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.177111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:39.185618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46ecb259-244c-4acb-b320-482c29f1936d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.169335 Aug 30 17:29:39.186286 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 516/986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:39 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:39.232975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:39.233560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:39.239864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.240345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.240770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.241777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:39.242317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:39.242738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:39.371724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:39.372061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:39.379787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4107faa1-ccd2-4891-98e1-eaa6e81f1bcd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.150924 Aug 30 17:29:39.385645 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 517/987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:39 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:39.385848 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f1dc5b7-4934-4f53-953e-0227874c0af0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.288703 Aug 30 17:29:39.386728 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 471/988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:39 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:40.047697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:40.048347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:40.056536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.057143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.057656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.058457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.058987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.059517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.206353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:40.206944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:40.215233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.215744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.216166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.216858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.217302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.217854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.228202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:40.238800 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-797ce9a6-3fb4-45d3-9580-175e81574f69 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.194733 Aug 30 17:29:40.239899 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 518/989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:40 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:40.402152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:40.402897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:40.411603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.412046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.412489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.413218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.413786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.414203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.429659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:40.444393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a75a2073-3757-422b-be75-84b5519b294e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1316 microversion: 2.1 time: 0.241880 Aug 30 17:29:40.446213 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 472/990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:40 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:40.451369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:40.453838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:40.462143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.463147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.463147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.463889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:40.464336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:40.464761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:40.586290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:40.595765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60542095-567b-4168-9dc9-f5926d50fe54 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.198106 Aug 30 17:29:40.596643 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 519/991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:40 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:40.646681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:40.657307 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71d8aaae-877e-43f3-9a72-7162521a82c2 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.209853 Aug 30 17:29:40.658134 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 473/992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:40 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:41.261206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:41.261779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:41.265696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:41.269695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.270170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.270596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.271278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.271750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.272169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.405135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:41.412844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e783fd26-08d1-4a9b-95b2-4342a60e0db8 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.156188 Aug 30 17:29:41.413447 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 520/993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:41 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:41.466069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:41.466686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:41.473082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.473563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.474003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.474698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.475152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.475616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.608606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:41.617647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:41.617829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9351aae5-58ea-4649-bd44-a26d246dd957 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1466 microversion: 2.1 time: 0.155375 Aug 30 17:29:41.618264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:41.618366 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 474/994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:41 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:41.624613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.625088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.625519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.626380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.626998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.627769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.637438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:41.638049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:41.643913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.644390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.644822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.645519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.645961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.646377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.693981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:41.718716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:41.764225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:41.771888 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80ee8f0d-400e-4dd7-b5f5-7160cf06c49c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.158533 Aug 30 17:29:41.772472 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 521/995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:41 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:41.783303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:41.783942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:41.789005 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbb8694f-4fff-4cce-965d-28f177c856b2 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1619 microversion: 2.1 time: 0.154836 Aug 30 17:29:41.789732 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 475/996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:41 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1619 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:41.790574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.791056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.791506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.792200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:41.792649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:41.793067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:41.850683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-818194716", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f469e743-c50d-4bb3-bfe5-12c224de8f51"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:41.903730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:41.933377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:41.941794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd5a47f1-cf75-40df-ba9a-077c9d132267 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.162118 Aug 30 17:29:41.950119 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 522/997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:41 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:42.122854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:42.123280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:42.123806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:42.124257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:42.124722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:42.134326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.134808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.135246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.136005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.136458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.137468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.155466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:42.160940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:42.174170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:42.176527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:42.222294 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a04c1cee-f00a-4a9f-8d5f-3f95de703fdf tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.375486 Aug 30 17:29:42.222948 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 476/998] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:29:42.234698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62236e27-d26a-471b-b5bf-cb0aae457273 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:42.235319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62236e27-d26a-471b-b5bf-cb0aae457273 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:42.296217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62236e27-d26a-471b-b5bf-cb0aae457273 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:42.299028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:42.306085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62236e27-d26a-471b-b5bf-cb0aae457273 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1216 microversion: 2.1 time: 0.075194 Aug 30 17:29:42.306659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 523/999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:42 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:42.434380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:42.434989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:42.441126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.441605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.442063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.442746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.443197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.443718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.581264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:42.591218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5902cdf-1b2d-4876-b2f8-9b84f9ad18ec tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.160938 Aug 30 17:29:42.591906 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 477/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:42 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:42.793191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:42.793836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:42.799868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.800241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.800677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.801454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.801877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.802307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.962945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:42.963677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:42.970132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.970859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.971293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:42.972046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:42.972492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:42.972912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.152438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:43.161627 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c75d0d5a-b45c-4f14-8e0e-9e171795c80d tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.202531 Aug 30 17:29:43.167880 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 478/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:42 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:43.186053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:43.188340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-plugged", "status": "completed", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:43.193804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ecdb3c59-ad6f-4282-b0a7-c1102c6e3cc0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.404472 Aug 30 17:29:43.194845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 524/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:42 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:43.199266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:43.199922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:43.200348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.212148 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] Creating event network-vif-plugged:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:29:43.216890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9375bc6c-9e9a-444b-8fa8-6e2af9196823 req-1aa57dee-0782-40da-b0d4-25257f0b0931 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Aug 30 17:29:43.217478 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 479/1003] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:43.326151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:43.326764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:43.333543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:43.334020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:43.334445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.335221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:43.335636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:43.336083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.398473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:43.406614 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-890d7c81-7baf-41e8-b8d8-d1e92fca678a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1268 microversion: 2.1 time: 0.084340 Aug 30 17:29:43.407186 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 525/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:43 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1268 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:43.614582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:43.616177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:43.623579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:43.624065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:43.624663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.625358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:43.625803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:43.626421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:43.765925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:43.774907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-295aeaa4-5df9-495f-8c3e-2d100e63206e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.164995 Aug 30 17:29:43.775510 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 480/1005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:43 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:44.182855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:44.183638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:44.189778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.190335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.190835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.191624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.192140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.192632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.214434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:44.215328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:44.221633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.222038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.222530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.223267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.223802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.224403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.331870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:44.341409 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8fdfc78e-75d2-4273-8e70-b22fd39c447a tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.163046 Aug 30 17:29:44.342153 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 526/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:44 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:44.418341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:44.428194 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc07022b-3e80-4e08-b0f4-cb7954c106bf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1378 microversion: 2.1 time: 0.217826 Aug 30 17:29:44.428962 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 481/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:44 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1378 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:44.429288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:44.430089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:44.436394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.437173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.437701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.438491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.439039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.439632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.457800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:44.503837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:44.511517 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f477a024-d93f-48db-bc6d-d6bd002d0551 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1274 microversion: 2.1 time: 0.086742 Aug 30 17:29:44.512118 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 527/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:44 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:44.796420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:44.797534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:44.805630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.806347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.806962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:44.809249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:44.809711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:44.810145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.052828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:45.069962 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61378d57-ddb0-4fbf-9abd-4d9418f32c3f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.276364 Aug 30 17:29:45.074994 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 482/1009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:44 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:45.247458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b843620e-f9b8-4233-b4e5-33a005a2c77a", "name": "network-vif-plugged", "status": "completed", "tag": "fc7e65db-2b93-4534-9dca-751e0e58e45e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:45.257910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.258729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.259373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.273804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] Creating event network-vif-plugged:fc7e65db-2b93-4534-9dca-751e0e58e45e for instance b843620e-f9b8-4233-b4e5-33a005a2c77a on n-h1-852771-11 Aug 30 17:29:45.284204 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5c7f6624-3d40-4bf1-aaf5-171d8f8656e5 req-b4cd127f-fc78-49ea-9680-905bbbc83d40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044218 Aug 30 17:29:45.284817 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 528/1010] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:45.363003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:45.363657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:45.371452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.372212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.373159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.373866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.374340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.374767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.452136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:45.453027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:45.459251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.459859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.460688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.461610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.462051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.462477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.596148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:45.605028 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41a47181-99d9-47ef-ba99-eb30aa03a5f9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1528 microversion: 2.1 time: 0.158017 Aug 30 17:29:45.605709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 529/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:45 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1528 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:45.610217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:45.610898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:45.618647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.619215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.619795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.620589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.621138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.621885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.636916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:45.646813 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e32eb5b7-3afd-48cc-aaa8-80d32f7be010 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.287902 Aug 30 17:29:45.647560 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 483/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:45 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:45.654029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:45.655086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:45.665491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.666109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.666629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.667448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.668022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.668669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.762163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:45.770719 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a81380c-29be-4307-a1d2-d654cdf1e15e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.163919 Aug 30 17:29:45.771303 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 530/1013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:45 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:45.777526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca", "tag": "2970acd1-66f6-44fa-92bf-23c1ce24f45e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:45.789759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:45.790236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:45.790877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:45.802565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] Creating event network-changed:2970acd1-66f6-44fa-92bf-23c1ce24f45e for instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca on n-h2-852771-11 Aug 30 17:29:45.808514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-523d2465-ba33-4e7f-9774-fad8fac5fc4c req-6f879c5f-a5a4-4602-820b-ef5f34c250e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035823 Aug 30 17:29:45.809262 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 531/1014] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:45.949607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:45.957381 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fadc090-7f89-43c9-8729-94f7852c5831 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1528 microversion: 2.1 time: 0.308640 Aug 30 17:29:45.958155 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 484/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:45 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:45.978676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e6f1651-5ab5-4e7c-b95e-7261ea849d6b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:45.995920 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e6f1651-5ab5-4e7c-b95e-7261ea849d6b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/29fb62f7-2f80-4d99-abac-79d5b1c5e115" status: 202 len: 0 microversion: 2.1 time: 0.021712 Aug 30 17:29:45.996507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 532/1016] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:45 2022] DELETE /compute/v2.1/flavors/29fb62f7-2f80-4d99-abac-79d5b1c5e115 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:29:46.004191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c1b71dd-0f45-4355-8b43-3f732024517b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.026585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c1b71dd-0f45-4355-8b43-3f732024517b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.025936 Aug 30 17:29:46.027182 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 485/1017] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:29:45 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:46.047045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:46.049648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.056180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.056644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.057086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.057795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.058253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.058679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.095661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.096433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.104271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.104780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.105210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.105904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.106411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.106824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.151786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.158594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Old instance type tempest-test_resize_flavor_-886412508, new instance type m1.heat {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 17:29:46.166448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:46.166870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:46.167340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:46.167780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:46.168186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:46.280993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f4cf1d6a-9837-424b-a56e-81896f2c8a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064/action" status: 202 len: 0 microversion: 2.1 time: 0.237737 Aug 30 17:29:46.281326 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 533/1018] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:29:46 2022] POST /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:29:46.289790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.290250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.296814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.297302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.297725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.298422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.298872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.299293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.333650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.348012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aff994c4-5d0e-44f9-92e9-606386d1ac46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.254511 Aug 30 17:29:46.349127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 486/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:46 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:46.446123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.456406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-781a2489-a224-4008-ab33-3681176d8379 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1537 microversion: 2.1 time: 0.170696 Aug 30 17:29:46.457004 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 534/1020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:46 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:46.668194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.668784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.674764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.675242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.675705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.676399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.676845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.677269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.794899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.795796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.802049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.802791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.803585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.804543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.805192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.805809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.817109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.825228 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9faaafc-7f99-4f59-8482-4c3086626240 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1352 microversion: 2.1 time: 0.160924 Aug 30 17:29:46.839622 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 487/1021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:46 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:46.957524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.966446 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3d74bf9-8886-4f66-8650-bafafd239cb8 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.175447 Aug 30 17:29:46.967028 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 535/1022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:46 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:47.370200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:47.370804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:47.376881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.377361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.377789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.378474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.378921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.379343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.478958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:47.479867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:47.487355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.487850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.488310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.489482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.489651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.490114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.524961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:47.534141 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21c30c45-5569-43e8-af0a-6d6f6ede8459 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.168589 Aug 30 17:29:47.539929 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 488/1023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:47 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:47.635895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:47.643676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7bd975ed-cfd9-4b03-af88-57aa6661bbbd tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1537 microversion: 2.1 time: 0.169026 Aug 30 17:29:47.644454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 536/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:47 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:47.846232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:47.846989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:47.854829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.855323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.855784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.856489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.856938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.857347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.874416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:47.986089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:47.986707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:47.993942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.994431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.994867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.995589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.996040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.996462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.074132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:48.082352 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e0308be-3f7f-4449-bd57-7530d3c57cdc tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1543 microversion: 2.1 time: 0.240057 Aug 30 17:29:48.082947 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 489/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:47 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1543 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:48.104233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:48.104765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:48.110870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.111687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.112297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.113228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.113974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.114553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.135954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:48.145028 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5325285e-3382-47e4-a025-0a1459ebe48e tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.162738 Aug 30 17:29:48.145632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 537/1026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:47 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:48.208296 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70664bff-a24d-4912-91a0-f0c71d0cdeea tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108985 Aug 30 17:29:48.208999 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 490/1027] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:29:48 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:29:48.558340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:48.559124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:48.566455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.567005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.567587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.568717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.569300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.569783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.665926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:48.666931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:48.673965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.674521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.675021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.675901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.676359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.677100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.796093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:48.809830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af6584cf-96db-4a8a-b8e7-34c53d76fa4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.256269 Aug 30 17:29:48.810967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 538/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:48 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:48.826027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:48.835939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a4d85ed-4815-44f5-b549-4341f6295e5f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1537 microversion: 2.1 time: 0.174678 Aug 30 17:29:48.836533 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 491/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:48 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1537 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:49.171227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:49.171993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:49.178291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.179379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.180181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.181141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.181669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.182166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.340314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843620e-f9b8-4233-b4e5-33a005a2c77a", "tag": "fc7e65db-2b93-4534-9dca-751e0e58e45e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:49.361240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.361721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.362150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.371181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:49.374886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] Creating event network-changed:fc7e65db-2b93-4534-9dca-751e0e58e45e for instance b843620e-f9b8-4233-b4e5-33a005a2c77a on n-h1-852771-11 Aug 30 17:29:49.378961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b70b2b34-4b48-4c6f-a694-fcdb40b8a2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.213783 Aug 30 17:29:49.379931 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 539/1030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:49 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:49.392888 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2230ed17-9b94-4e23-a8f2-ddd620574399 req-b0be0356-3b6f-4dd7-82b2-1671e42ce318 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043515 Aug 30 17:29:49.393522 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 492/1031] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:49.830249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:49.830867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:49.838592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.839080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.839769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.840641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.841111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.841525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.862051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:49.864127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:49.875556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.877560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.884907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:49.886206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:49.886701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:49.887324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.016969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:50.027287 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a2b016c-a38e-4247-92ac-80289c7f8c68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.200919 Aug 30 17:29:50.029102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 540/1032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:49 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:50.034337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:50.035061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:50.043540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.044398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.045070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.046010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.046656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.047293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.051292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:50.062138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1494d6b3-c822-4935-a86a-071d6657c993 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.206684 Aug 30 17:29:50.062981 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 493/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:49 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:50.085368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:29:50.165676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60921f13-b228-40e1-9495-7100a17833a8 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 204 len: 0 microversion: 2.1 time: 0.135028 Aug 30 17:29:50.166480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 541/1034] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:50 2022] DELETE /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:29:50.175510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:50.176692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:50.183150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.183701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.184141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.184863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.185315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.185742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.328332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:50.337326 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1090b099-a1ed-4fb0-97c5-2d3dd172f4e4 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1714 microversion: 2.1 time: 0.166587 Aug 30 17:29:50.337910 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 494/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:50 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:50.400464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:50.401168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:50.407265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.407785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.408222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.408917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.409366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.409785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.552253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:50.560689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3068a9af-fdec-4495-9587-61486b0cf683 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.164646 Aug 30 17:29:50.561264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 542/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:50 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:51.051265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:51.051843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:51.058458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.058932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.059357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.060067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.060531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.060946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.086160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:51.087066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:51.094980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.096299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.096820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.097751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.098366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.098937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.121103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:51.203420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:51.212340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f678d1f5-ea2f-4ac8-9fc8-7a182bc090dd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.165023 Aug 30 17:29:51.220625 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 495/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:51 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:51.230710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca", "name": "network-vif-plugged", "status": "completed", "tag": "2970acd1-66f6-44fa-92bf-23c1ce24f45e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:51.243172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.244831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.244831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.245019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:51.252966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29eb7594-f41f-4e3d-ba3a-a8a6ee1e9855 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.172295 Aug 30 17:29:51.253963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 543/1038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:51 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:51.258244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] Creating event network-vif-plugged:2970acd1-66f6-44fa-92bf-23c1ce24f45e for instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca on n-h2-852771-11 Aug 30 17:29:51.265931 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-be831726-b2b1-422a-b0f0-e9ee7b7f878d req-3acfdab0-924e-4662-8a3c-269baec03aff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Aug 30 17:29:51.267830 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 496/1039] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:51.358175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:51.358780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:51.364932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.365412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.366145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.366815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.367267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.367711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.498058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:51.506131 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d25164fb-d092-4728-8256-b1df1dfd9972 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1714 microversion: 2.1 time: 0.151849 Aug 30 17:29:51.507216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 544/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:51 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:51.582299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:51.582992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:51.590099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.590574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.590996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.591730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.592173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.592587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.721443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:51.729884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87241b43-b870-4d65-bfd1-14d92248907f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.151839 Aug 30 17:29:51.730452 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 497/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:51 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:52.233929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:52.234527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:52.242015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.242527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.242964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.243711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.244161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.244583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.280251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:52.281004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:52.283602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:52.284323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:52.291381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.291887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.292317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.293006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.293620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.294190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.305766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:52.380734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:52.390844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-658dcfe4-f5b3-4a5e-8c7c-326435f62fb5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.160847 Aug 30 17:29:52.391435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 545/1042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:52 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:52.528423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:52.528989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:52.529157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:52.535671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.536169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.536567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-68a1dc25-3dcd-4ce5-9be1-96a8e00012de tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.266330 Aug 30 17:29:52.536768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.537737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.538206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.538638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.548066 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 498/1043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:52 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:52.677882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:52.687161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a58b7a36-010f-490f-bd75-5ae82404367e tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1714 microversion: 2.1 time: 0.162899 Aug 30 17:29:52.687789 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 546/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:52 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:52.751313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:52.752136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:52.760729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.761229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.761669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.763471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.763471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.763471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.184180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:53.192496 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72dcc487-afe0-48e7-83bb-427195c8ca88 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1316 microversion: 2.1 time: 0.445074 Aug 30 17:29:53.193160 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 499/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:52 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:53.412207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:53.413707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:53.420551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.421027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.421455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.422136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.422603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.423050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.556530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:53.558605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:53.559300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:53.565818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.566388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.566957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.567780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.568394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.569045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.580081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-077aff47-2789-4940-8901-0e5d6f0b6ab7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.171567 Aug 30 17:29:53.580906 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 547/1046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:53 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:53.586542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df2aa2e-0a18-4113-9020-2af16249315f", "name": "network-vif-deleted", "tag": "4c724896-da2a-45d6-81de-9ce9b17d287d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:53.602795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.603285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.603791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.619351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] Creating event network-vif-deleted:4c724896-da2a-45d6-81de-9ce9b17d287d for instance 9df2aa2e-0a18-4113-9020-2af16249315f on n-h1-852771-11 Aug 30 17:29:53.625111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-07529b2c-3fe6-42b4-9316-14901a2176dc req-2cc260f6-e97d-4d9b-8268-97a1e3b7f455 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043072 Aug 30 17:29:53.639288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 548/1047] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:53.708757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:53.710164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:53.717097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.717581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.718015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.718962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.719510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.721470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.769193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.769780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.770290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.770819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lazy-loading 'fault' on Instance uuid 9df2aa2e-0a18-4113-9020-2af16249315f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:29:53.783536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:53.801925 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ada0230f-03f6-46dc-9bda-bdb399aa4088 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.243627 Aug 30 17:29:53.802823 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 500/1048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:53 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:53.826281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a51e58ea5a14f9bb24a9aa9145dd831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ac0ee255c4bd1b475e0535d3be030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:53.836672 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2a889aa-a71e-4738-b70e-e2c04c5299cc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 200 len: 1354 microversion: 2.1 time: 0.131854 Aug 30 17:29:53.841380 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 549/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:53 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 1354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:54.213271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:54.213913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:54.220070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.220798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.221230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.221925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.222377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.222798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.364575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:54.373777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6543f176-2f84-488f-8593-edb7e7b8f77c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1465 microversion: 2.1 time: 0.164469 Aug 30 17:29:54.374363 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 501/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:54.394692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:54.395316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:54.402261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.402746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.403172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.403886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.404332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.404749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.550515 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dddf6865-9386-4447-8725-90703f5465ff tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1618 microversion: 2.1 time: 0.159272 Aug 30 17:29:54.551370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 550/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1618 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:54.607000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:54.608240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:54.614661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1311888502", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f469e743-c50d-4bb3-bfe5-12c224de8f51"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:54.615430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.617469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.619079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.627546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.628482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.629147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.683924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:29:54.778561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:54.786302 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-420bc958-7ddc-4919-808f-d55de9710b01 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.183167 Aug 30 17:29:54.786879 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 502/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:54.824505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:54.825151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:54.831509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.832038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.832477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.833232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.833747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.834179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.914038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:29:54.914565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:29:54.915283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:29:54.915784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:29:54.916319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:29:54.925349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.925833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.926295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.927020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.927494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.927922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.947795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:29:54.953208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Getting quotas for user b5a7777450394d349220daa222347ec3 and project 580c9f4e00b844efa3be8dfb510c2caa. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:29:54.967024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:29:54.969435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:29:54.973342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:54.981258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44052d8e-c82c-4218-922a-33d19a85e630 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.160565 Aug 30 17:29:54.995717 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 503/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:55.001041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.001846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.008101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.008579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.009010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.009704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.010148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.010570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.024872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f HTTP/1.1 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:29:55.026518 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.027957 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9df2aa2e-0a18-4113-9020-2af16249315f'} Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:55.028801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.030098 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.031543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:55.031635 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aecedb27-6080-4436-8674-a6b12290b27a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.416728 Aug 30 17:29:55.031729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6317e8fd-0e6d-4f23-9cea-bb2450af9142 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 404 len: 111 microversion: 2.1 time: 0.030906 Aug 30 17:29:55.031812 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 551/1054] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:29:55.031900 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 504/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:29:55.037214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.038429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.039212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-008271d4-f5c1-4a9c-96f8-9d0d2fe693fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.040058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-008271d4-f5c1-4a9c-96f8-9d0d2fe693fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.044565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.045050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.045487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.046193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.046649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.047983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.065084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 HTTP/1.1 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:55.067108 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.068516 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4bf9533d-17d8-4ce7-a6e9-c836b390ff62'} Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:55.069953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.071688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.074652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:55.074652 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-678f54ef-0ea1-437d-9b50-018969a31031 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 404 len: 111 microversion: 2.1 time: 0.035953 Aug 30 17:29:55.074652 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 552/1056] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:55 2022] DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:29:55.078459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.079071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.086467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.086952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.087387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.088138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.088593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.089017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.097120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-008271d4-f5c1-4a9c-96f8-9d0d2fe693fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:55.104448 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.105220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-008271d4-f5c1-4a9c-96f8-9d0d2fe693fe tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1217 microversion: 2.1 time: 0.070339 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 HTTP/1.1 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:55.105983 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.107323 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4bf9533d-17d8-4ce7-a6e9-c836b390ff62'} Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:55.108095 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:55.109302 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.110586 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 505/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:55.112160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:55.113229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d902f5d-26db-4ad3-a481-f72a45de4e98 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 404 len: 111 microversion: 2.1 time: 0.038438 Aug 30 17:29:55.113947 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 553/1058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:29:55.124435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c39383e-e44c-4660-bcc3-794ebd5a4cbc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '.version_select at 0x7f2d9938a820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.148403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c39383e-e44c-4660-bcc3-794ebd5a4cbc tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913373108" status: 202 len: 0 microversion: 2.1 time: 0.028845 Aug 30 17:29:55.152188 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 506/1059] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913373108 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:29:55.791761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d700cd29-d693-4141-8835-5b4400e81bfd tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.795424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:55.808029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.808787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.815698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.816203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.816646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.817402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.817851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.818280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.819889 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d700cd29-d693-4141-8835-5b4400e81bfd tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/226248007" status: 202 len: 0 microversion: 2.1 time: 0.031283 Aug 30 17:29:55.820479 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 554/1060] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:29:55 2022] DELETE /compute/v2.1/flavors/226248007 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:29:55.828461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aef08dae-2d01-4cae-9997-e730ffd87367 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.849339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aef08dae-2d01-4cae-9997-e730ffd87367 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.024294 Aug 30 17:29:55.851664 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 555/1061] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:55.873500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcc8becc-aefe-4e35-864b-b0677ee8d334 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.894056 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcc8becc-aefe-4e35-864b-b0677ee8d334 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2030959982" status: 202 len: 0 microversion: 2.1 time: 0.026290 Aug 30 17:29:55.894745 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 556/1062] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:29:55 2022] DELETE /compute/v2.1/flavors/2030959982 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:29:55.902648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-980270d7-16ae-486a-b29b-3e1687e86654 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.922830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-980270d7-16ae-486a-b29b-3e1687e86654 tempest-ServersWithSpecificFlavorTestJSON-427185997 tempest-ServersWithSpecificFlavorTestJSON-427185997-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023582 Aug 30 17:29:55.923422 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 557/1063] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:55.949939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.950569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:55.957263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.958037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.958475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.959187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:55.960474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:55.960912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.976591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.976748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f HTTP/1.1 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:55.978600 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.980077 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9df2aa2e-0a18-4113-9020-2af16249315f'} Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:55.980878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:55.982303 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:55.984110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:55.984110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea59a57e-381b-4afc-9b0e-f6e7ea9f7bdd tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 404 len: 111 microversion: 2.1 time: 0.034405 Aug 30 17:29:55.984110 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 558/1064] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:55 2022] DELETE /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:29:55.985849 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-60a59f74-78d6-411e-bf3e-b67436c19597 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.182444 Aug 30 17:29:55.987179 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 507/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:55.992818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:55.993758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 9df2aa2e-0a18-4113-9020-2af16249315f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.006521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.006800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:56.007009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.007444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.008211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.008828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.008959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.009534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.017494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.018144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.019100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.020448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.021132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.021873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.025863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f HTTP/1.1 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:56.027757 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:56.029108 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9df2aa2e-0a18-4113-9020-2af16249315f'} Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:56.031812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. Aug 30 17:29:56.033280 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.034366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 9df2aa2e-0a18-4113-9020-2af16249315f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:56.034366 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f98f59d-875d-41cc-bed6-7899b3593bd0 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f" status: 404 len: 111 microversion: 2.1 time: 0.044206 Aug 30 17:29:56.034366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 559/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/servers/9df2aa2e-0a18-4113-9020-2af16249315f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:29:56.040258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:56.040892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.047717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.048517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.048980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.049692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.050146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.050624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.065577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 HTTP/1.1 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:56.067136 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.068784 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4bf9533d-17d8-4ce7-a6e9-c836b390ff62'} Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:56.069570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.070824 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.073121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:56.073121 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2eb3647d-0404-411c-9486-acd257476b18 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 404 len: 111 microversion: 2.1 time: 0.032703 Aug 30 17:29:56.073121 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 560/1067] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:29:56 2022] DELETE /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:29:56.078241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:56.078980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] [instance: 4bf9533d-17d8-4ce7-a6e9-c836b390ff62] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.085386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.086210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.086658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.087366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.087851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.088282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.104609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] HTTP exception thrown: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Request method failure captured: Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 HTTP/1.1 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhT0-cVvK_MnNIpZSVcmJE0V_EzWUAI5yYiX8YATX5_-eLiijKS67rAn8RJcXIGkGWKAeF40F1hiXKUWm1SCwCPqK0smRmE-eICWltJVzzuxzIcYCcuK4KeLGfYecJjG1DMU8d63gQlZRkc6sOE8aSkw4DjN6OX7pUMq3eH1R-ayRE Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:29:56.106197 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/240ac0ee255c4bd1b475e0535d3be030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_240ac0ee255c4bd1b475e0535d3be030"}]}] Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 240ac0ee255c4bd1b475e0535d3be030 Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455 Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0a51e58ea5a14f9bb24a9aa9145dd831 Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-971217455-project Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.107720 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4bf9533d-17d8-4ce7-a6e9-c836b390ff62'} Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:29:56.108444 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. Aug 30 17:29:56.109648 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:29:56.110802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] Returning 404 to user: Instance 4bf9533d-17d8-4ce7-a6e9-c836b390ff62 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:29:56.110802 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91baf042-b62e-4439-b047-8d681991a341 tempest-ServersWithSpecificFlavorTestJSON-971217455 tempest-ServersWithSpecificFlavorTestJSON-971217455-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62" status: 404 len: 111 microversion: 2.1 time: 0.033856 Aug 30 17:29:56.110802 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 561/1068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:56 2022] GET /compute/v2.1/servers/4bf9533d-17d8-4ce7-a6e9-c836b390ff62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:29:56.127867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:56.128530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.135086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.135622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.136064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.136785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.137240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.137666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.166095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:56.173903 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cbd40bf9-40bf-45f3-bf09-f2e4167fdc4b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.173168 Aug 30 17:29:56.174475 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 508/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:55 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:56.231546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:56.239625 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03c82d7b-4833-4a70-a627-5ac38f04e776 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1269 microversion: 2.1 time: 0.115810 Aug 30 17:29:56.240209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 562/1070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:56 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:57.013298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:57.014087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:57.020299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.020929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.021370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.022884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.023543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.023976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.198309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:57.199442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:57.206898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.207417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.207911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.208625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.209059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.210037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.246479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:57.259723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-535c0cc7-7edd-4e34-b0f2-be09efea49c5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.253397 Aug 30 17:29:57.291841 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 509/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:57 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:57.300229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:57.300844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:57.314617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.320737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.321484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.323189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.323983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.324607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.344420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:57.629736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:57.633304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:57.638786 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0508b31-f162-445e-8e62-cc1845fecd1d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.345713 Aug 30 17:29:57.639381 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 510/1072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:57 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:57.643518 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-858d8b62-a749-4200-b532-0cafdd68c5f1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.451591 Aug 30 17:29:57.659986 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 563/1073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:57 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:58.192506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b897a-e043-4d2e-834e-ed8780fa2765", "tag": "beb85f66-2105-40d1-89bf-4d79a1acd9ee"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:58.215513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:58.223445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.224174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.224863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.241444 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] Creating event network-changed:beb85f66-2105-40d1-89bf-4d79a1acd9ee for instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 on n-h1-852771-11 Aug 30 17:29:58.247320 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-63e03c3a-dde3-48f1-8b09-ce6b362b6aca req-9979ae4f-3118-44d2-9c93-5759e191b443 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069864 Aug 30 17:29:58.248869 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 511/1074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:58.286282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:58.286899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:58.300382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.301268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.301980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.303010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.304615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.305223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.588300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:58.598880 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52b3affe-9ed2-47c7-80c4-33012e668d8b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.316586 Aug 30 17:29:58.599458 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 564/1075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:58 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:58.672410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:58.673723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:58.674008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:58.677298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:58.690218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.691118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.691776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.692128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.692841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.695003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.695916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.697904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.698337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.699153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.700297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.700526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.985488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:58.996363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d8ba95d-d213-4cba-9dd3-9fc97654111f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.334167 Aug 30 17:29:58.996965 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 512/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:58 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:59.030374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:59.049312 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6ad9eea-ce22-485a-ab74-180f4cc51905 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.379352 Aug 30 17:29:59.049312 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 565/1077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:58 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:59.629718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:59.630523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:59.640520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:59.641295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:59.642106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:59.643421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:59.644104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:59.644731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.018284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:00.019578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:00.041047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.041569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.042020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.042843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.043313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.043793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.070098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:00.088635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb6d3097-1ae5-4e6a-8d49-b2c26d840739 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.464696 Aug 30 17:30:00.095709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 513/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:59 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:00.117413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:00.123016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:00.145541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.153066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.154164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.155087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.156153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.156733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.336560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:00.373292 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2fd6e27f-50a6-4b35-a243-63e14993d756 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.358980 Aug 30 17:30:00.373889 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 566/1079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:00 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:00.550475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:00.561084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66610021-834c-4473-9b67-cc39dee35dfa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.463982 Aug 30 17:30:00.572456 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 514/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:00 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:01.118067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:01.118691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:01.131823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.132332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.133362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.134500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.136397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.137697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.302439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d616fe31-00ed-4775-9036-2a77eccfb617"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:01.305701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:01.313606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.314377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.315023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.316838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.317484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.318085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.346224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:01.359372 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ba1bb55-11c7-4e7e-a911-2ea08e13ac19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.246997 Aug 30 17:30:01.360993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 567/1081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:01 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:01.397831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:01.399017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:01.406590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.407653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.408361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.410690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.411756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.413139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.650242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:01.663236 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9a7f973-d452-403b-8230-d9226d851e8c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.269681 Aug 30 17:30:01.671246 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 568/1082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:01 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:01.671246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:01.671246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:01.676350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.676852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.677294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.678517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.679226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.679699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.685253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:01.715095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9357eaf0-ab63-4b16-a2dc-085dd2f05671 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "POST /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416544 Aug 30 17:30:01.716035 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 515/1083] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:30:01 2022] POST /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:01.901304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:01.910790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13ad7d4e-1e53-4b43-99a4-e6de7e6017aa tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.244718 Aug 30 17:30:01.928023 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 569/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:01 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:01.947757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "473f72cd-8066-4f68-8b8d-48dbab71302e"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:01.950464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:01.957922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.957922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.957922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.958468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.958997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.960811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.298571 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c493d81-d540-4ffa-83cd-2dbeaf705b87 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "POST /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356222 Aug 30 17:30:02.299566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 516/1085] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:30:01 2022] POST /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:02.382714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:02.383512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:02.393525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.394355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.394796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.395528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.395986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.396966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.689324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:02.690615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:02.708644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.709377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.710317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.711231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.712023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.712865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.734261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:02.747087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9f626e4-915a-41aa-930d-7d6905580817 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.365196 Aug 30 17:30:02.764044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 570/1086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:02 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:02.824982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b897a-e043-4d2e-834e-ed8780fa2765", "name": "network-vif-plugged", "status": "completed", "tag": "beb85f66-2105-40d1-89bf-4d79a1acd9ee"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:02.854934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.855632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.856282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.886052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] Creating event network-vif-plugged:beb85f66-2105-40d1-89bf-4d79a1acd9ee for instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 on n-h1-852771-11 Aug 30 17:30:02.897081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-deb7f53e-9511-4c31-aafd-01edef4872a2 req-57d2628b-a6e7-4194-b8d4-3044899a7156 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078535 Aug 30 17:30:02.899822 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 571/1087] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:02.935369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:02.936435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:02.955093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.955784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.956393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.957878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.959022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.959672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.976639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:02.992622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ac0062d-3ac6-4f0f-bc3c-3eb88c885a54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.308035 Aug 30 17:30:03.003522 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 517/1088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:02 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:03.453294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:03.463748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-61072062-e2e8-4f27-84df-a73c15660d3c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.532228 Aug 30 17:30:03.464450 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 572/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:02 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:03.770267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:03.771708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:03.779696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:03.780505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:03.781139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:03.782032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:03.782676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:03.783159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:03.950231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:03.964095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92aa6613-3017-4a08-b231-29765453f858 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.195143 Aug 30 17:30:03.965625 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 518/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:03 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:04.017839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:04.018715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:04.027752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.028541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.029133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.030019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.030639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.031255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.276657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:04.290008 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e20b550-00d3-478d-8564-8c48475cfbf9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1317 microversion: 2.1 time: 0.275836 Aug 30 17:30:04.290934 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 573/1091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:04 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:04.487702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:04.488525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:04.495362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.495994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.496539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.497345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.498024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.498637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.738585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:04.748282 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2533636-6661-4875-9007-8db7afb45442 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.265493 Aug 30 17:30:04.748876 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 519/1092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:04 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:04.992907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:04.993611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:04.998685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:05.001426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:05.006709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.007204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.007673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.008386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.008842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.009268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.217108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:05.231668 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8452aad-6430-48c0-a641-5466be12d0bf tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.247223 Aug 30 17:30:05.232367 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 574/1093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:04 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:05.315861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:05.317221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:05.324163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:05.327354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.328260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.328899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.329917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.330560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.331169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.606485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:05.614712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-640a930f-c045-4314-80b3-7ddd7427c2fa tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1467 microversion: 2.1 time: 0.302781 Aug 30 17:30:05.617133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 520/1094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:05 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1467 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:05.637893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:05.638477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:05.646127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.648156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.649390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.650500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.651399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.652650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.769633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:05.770688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:05.783992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.785230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.785931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.788351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.789037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.789781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.831424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99834b5a-02cb-4309-9ade-2a591e76e421 tempest-ServersOnMultiNodesTest-872884263 tempest-ServersOnMultiNodesTest-872884263-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1620 microversion: 2.1 time: 0.198006 Aug 30 17:30:05.833270 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 575/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:05 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1620 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:05.861689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:05.862587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:05.870661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.871504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.872848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.873942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.874609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.875257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.916148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:06.037917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:06.050526 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8af4459c-6c55-43c6-8cc6-e6e82a79a619 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.285307 Aug 30 17:30:06.053848 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 521/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:05 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:06.065655 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-654173db-f4fb-4bbd-a8af-b15a70ee21ad tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 204 len: 0 microversion: 2.1 time: 0.211207 Aug 30 17:30:06.066253 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 576/1097] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:05 2022] DELETE /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:06.075437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:06.076093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:06.084781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:06.085508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:06.086147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:06.087558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:06.088835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:06.089272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:06.254275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:06.255273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:06.269049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:06.269831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:06.270796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:06.273033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:06.273738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:06.274381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:06.296439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:06.305907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94890427-50c6-4829-9cc8-08157d5e8465 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1473 microversion: 2.1 time: 0.234699 Aug 30 17:30:06.308174 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 522/1098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:06 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:06.489715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:06.500236 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf12c13e-b696-4720-92b2-f2307d8550ae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.250879 Aug 30 17:30:06.501432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 577/1099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:06 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:07.077230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:07.078393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:07.090897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.091393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.093742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.095988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.096546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.096989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.259789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:07.269008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7509aeaf-40a9-4a0b-890f-4c1f435d306e tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.196299 Aug 30 17:30:07.271514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 523/1100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:07 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:07.329306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:07.329809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:07.337399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.337884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.338312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.339002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.339449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.339901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.487199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:07.497969 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58699338-d32b-4c91-984d-3d4d3e0c5707 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1473 microversion: 2.1 time: 0.172567 Aug 30 17:30:07.498554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 578/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:07 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:07.523875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:07.524570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:07.530882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.531467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.532026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.532812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.533380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.533892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.808247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:07.821500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0de9afb1-fddd-4f57-90a1-e2d9e2c0e065 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.301568 Aug 30 17:30:07.829332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 524/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:07 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:08.218153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b897a-e043-4d2e-834e-ed8780fa2765", "name": "network-vif-deleted", "tag": "beb85f66-2105-40d1-89bf-4d79a1acd9ee"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:08.239980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.245399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.246791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.277494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] Creating event network-vif-deleted:beb85f66-2105-40d1-89bf-4d79a1acd9ee for instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 on n-h1-852771-11 Aug 30 17:30:08.292052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:08.293360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:08.311764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f7b57b63-4580-4b6c-b424-0d5221284790 req-a877b1e7-7c21-4a12-a523-bde505f62302 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097313 Aug 30 17:30:08.313080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.314071 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 579/1103] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:08.314400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.315109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.316599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.317312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.317940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.330704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:08.519267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:08.520905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:08.530045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.530914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.532228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.535626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.536525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.538241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.571522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:08.581103 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6abfdc29-28a7-455a-82f3-95b61f4e7833 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.294495 Aug 30 17:30:08.592968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 525/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:08 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:08.608030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.608609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.609142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.609690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lazy-loading 'fault' on Instance uuid 6d7b897a-e043-4d2e-834e-ed8780fa2765 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:08.678034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:08.688125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ecfe4e6-e6ce-4774-9cce-fa1fd55b783b tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 200 len: 1307 microversion: 2.1 time: 0.172777 Aug 30 17:30:08.690093 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 580/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:08 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:08.843451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:08.844145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:08.855683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.856428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.856778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.857549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.858008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.858435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.024807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:09.026538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d997b1940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.031758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.032751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.033661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.034746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.035438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.036111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.037373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3176bc4a-4110-49af-af22-adf57f4e1c47 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1497 microversion: 2.1 time: 0.197351 Aug 30 17:30:09.038087 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 526/1106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:08 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:09.068780 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d982cc40-54ed-4a06-a25d-85252aef0a0e tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.206771 Aug 30 17:30:09.069628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 581/1107] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:30:08 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:09.080887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d9cdc2160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.085098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.085829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.086465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.087359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.088049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.088687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.118269 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72ba47be-94c1-4bd4-b48e-4dfa4ecd6f8c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.041095 Aug 30 17:30:09.119171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 527/1108] 10.222.0.50 () {58 vars in 1139 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:09.130553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d98aed280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.136060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.136774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.137528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.138477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.138926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.139548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.166169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f278554b-1a31-4138-a2f8-8533136d7530 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.039775 Aug 30 17:30:09.166792 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 582/1109] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:30:09.178781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d9cdc2790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.182481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.183281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.183810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.184492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.184944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.185366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.210858 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ae37f65-019e-4c1f-93b8-6a228140e65c tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036372 Aug 30 17:30:09.211574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 528/1110] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:09.222099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d989ce940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.226800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.227353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.227840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.228581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.229038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.229468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.255428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78e85ff7-7a7f-4978-aba5-2895e5d80187 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.037286 Aug 30 17:30:09.256079 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 583/1111] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:09.269199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d9cdc2ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.273999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.274964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.275665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.276641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.277311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.277966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.305864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dde64027-4af5-4d42-b072-cb00b0c8d7a6 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.040365 Aug 30 17:30:09.306623 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 529/1112] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:09.317670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d989a4dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.325748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.326251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.326684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.342294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.342792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.343232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.374183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53dcf257-bb40-48b7-8a39-17f0f0f73b02 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-852771-11" status: 200 len: 867 microversion: 2.1 time: 0.060729 Aug 30 17:30:09.374783 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 584/1113] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts/n-h2-852771-11 => generated 867 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:09.384233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Calling method '.version_select at 0x7f2d9cd6e0d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.392331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.392865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.393405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.408141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.408615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.409042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.441775 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa17f817-26fb-4198-958e-b2ffcfbf4489 tempest-HostsAdminTestJSON-1819867072 tempest-HostsAdminTestJSON-1819867072-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-852771-11" status: 200 len: 1133 microversion: 2.1 time: 0.061150 Aug 30 17:30:09.442369 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 530/1114] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/os-hosts/n-h1-852771-11 => generated 1133 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:09.605045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.606058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:09.616852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.617387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.617774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.619822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.620878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.621413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.716072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.716699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 6d7b897a-e043-4d2e-834e-ed8780fa2765] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:09.723100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.723914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.724588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.725301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.725767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.726202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.751408 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 HTTP/1.1 Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:30:09.754660 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. Aug 30 17:30:09.756801 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '6d7b897a-e043-4d2e-834e-ed8780fa2765'} Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:09.757562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. Aug 30 17:30:09.758753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:09.759937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance 6d7b897a-e043-4d2e-834e-ed8780fa2765 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:09.759937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd5d9f62-64e4-4d4b-a256-83c89da62be3 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765" status: 404 len: 111 microversion: 2.1 time: 0.045514 Aug 30 17:30:09.759937 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 531/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/servers/6d7b897a-e043-4d2e-834e-ed8780fa2765 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:09.769264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.769774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:09.778034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.778815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.779983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.780937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.781583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.782479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.795808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:09.809052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9ffff24-ac81-4a24-a81e-93559d10584f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.209368 Aug 30 17:30:09.810300 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 585/1116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:09.824885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:09.920186 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3158e03e-4884-4b04-9bb1-1aa69192fb8d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 204 len: 0 microversion: 2.1 time: 0.155848 Aug 30 17:30:09.924808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 532/1117] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:09 2022] DELETE /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:09.931941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.934499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:09.940747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.941312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.941818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.942610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.944025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.944654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.061312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:10.062185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:10.068437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.069094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.069910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.071088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.071933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.072782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.093447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:10.105596 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10bd08a2-01b9-46fc-8882-574f457a2a4c tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1471 microversion: 2.1 time: 0.178869 Aug 30 17:30:10.106504 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 586/1118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:10.304364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:10.313947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65ce2ccf-ebb2-42cf-8a7a-a9ac9814b5f0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 200 len: 1474 microversion: 2.1 time: 0.256783 Aug 30 17:30:10.314933 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 533/1119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:10 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 1474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:10.337529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2050641570"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:10.347501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:10.356990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.364757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.366288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.367260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.367901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.368401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.395107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:10.599703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2bf20ed6-2267-4869-beea-07683bdaf355 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a/action" status: 202 len: 0 microversion: 2.1 time: 0.268066 Aug 30 17:30:10.600644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 587/1120] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:30:10 2022] POST /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:30:10.612687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a2841a7-466e-490e-82f7-8e78923ebd1e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98f124c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:10.663990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a2841a7-466e-490e-82f7-8e78923ebd1e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.056606 Aug 30 17:30:10.664885 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 534/1121] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:10 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:10.831977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:10.832626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:10.851116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.860435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.861004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.861773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.862250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.862687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.130960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:11.133755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:11.133947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:11.144832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9046de4-4baa-47d9-8a10-7239c4b48a39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.318127 Aug 30 17:30:11.145994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 588/1122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:10 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:11.151389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:11.152021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:11.152451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.153165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:11.153613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:11.154030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.377093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:11.387842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b50273d7-398b-4513-ae6a-86d2cfa7bda0 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1471 microversion: 2.1 time: 0.263256 Aug 30 17:30:11.389615 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 535/1123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:11 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:11.680145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c16f410-95cc-4ea2-bda1-c563036ef03b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d989cec10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:11.741967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c16f410-95cc-4ea2-bda1-c563036ef03b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.066246 Aug 30 17:30:11.750506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 589/1124] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:11 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:12.168212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:12.168834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:12.183282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.183809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.187339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.190486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.199306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.200154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.235005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca", "name": "network-vif-deleted", "tag": "2970acd1-66f6-44fa-92bf-23c1ce24f45e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:12.263951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.265069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.265895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.321590 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] Creating event network-vif-deleted:2970acd1-66f6-44fa-92bf-23c1ce24f45e for instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca on n-h2-852771-11 Aug 30 17:30:12.356653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-982adda0-655b-4966-ba59-f5ea918221bf req-5b33f87f-838f-4182-a22e-fd7df9bb7c28 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140461 Aug 30 17:30:12.362656 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 590/1125] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:12.415682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:12.416819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:12.439023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.441822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.448498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.451585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.452257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.454561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.667710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:12.678332 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fe004e9-7c83-45b4-8479-eb4243544095 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 200 len: 1301 microversion: 2.1 time: 0.271277 Aug 30 17:30:12.684554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 591/1126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:12 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 1301 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:12.689946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:12.719409 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e2753f0-4ce3-4326-8897-4592ef38bf16 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.550168 Aug 30 17:30:12.723904 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 536/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:12 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:12.772106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0f454bd-1365-4a11-ae2d-f71332942958 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98913c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:12.851460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0f454bd-1365-4a11-ae2d-f71332942958 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.094756 Aug 30 17:30:12.853335 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 592/1128] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:12 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:13.688261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53277890-e752-4fb2-8017-1eb4594ac199 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Action: 'create', calling method: .version_select at 0x7f2d98d028b0>, body: {"keypair": {"name": "tempest-keypair-1257699461", "type": "ssh", "user_id": "c10e8bb1eb224853b235e79f83f82143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7WLdQDbFx4J6DnSmaA0Ut202TwOHGUI1moDKtTqdfWOl8zqJ6av+Ln5CbKVGLCQvCZYPNFkdprTvjAGDyRdzVPH61KaIRJcMwSBftMKRDKHqe9njRw3OpKgfXdiw4Utw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:13.702408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.703563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:13.705986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-53277890-e752-4fb2-8017-1eb4594ac199 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:13.706845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:13.712246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.713002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.713434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.714221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.716347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.716780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.718255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-53277890-e752-4fb2-8017-1eb4594ac199 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for user ba3ba49bb7254d96a5740716d22d417b and project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:13.736292 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca HTTP/1.1 Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:13.738461 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. Aug 30 17:30:13.741518 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca'} Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:13.742470 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. Aug 30 17:30:13.744131 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:13.746147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:13.747312 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b57b054-7868-4bf7-80b5-dcec381d9196 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca" status: 404 len: 111 microversion: 2.1 time: 0.049074 Aug 30 17:30:13.748202 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 593/1129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/servers/e8fa31a2-afd2-4f7b-b5e4-6ff7e56e3bca => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:30:13.748964 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53277890-e752-4fb2-8017-1eb4594ac199 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.224833 Aug 30 17:30:13.751618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 537/1130] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:30:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:30:13.754615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.756155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:13.758420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.758915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:13.763038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.763539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.763971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.764667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.765111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.765231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.765528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.765637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.766061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.766742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.767185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.767642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.792606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:13.898695 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e53f683-53e1-4972-91d9-4f62e84a10da tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 204 len: 0 microversion: 2.1 time: 0.144531 Aug 30 17:30:13.899811 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 538/1131] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:13 2022] DELETE /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:13.909306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dda1af46-61f7-4456-bc8a-6e84c7e19c9b tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Action: 'create', calling method: .version_select at 0x7f2d993baa60>, body: {"keypair": {"name": "tempest-keypair-1111961847", "type": "ssh", "user_id": "c10e8bb1eb224853b235e79f83f82143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIr0RVIOIfTRXPohlNEB9TNa60wiu/1cnh7uMVYdvw/V4eq5PrMavqcybUbnEe2nritLrOAlBX5CcjTa3YIL9ljG8MEhKoN/gDyrY/PMZTKmIw0QmCBgpMOkypuOmBWOg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:13.921339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:13.925507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-dda1af46-61f7-4456-bc8a-6e84c7e19c9b tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:13.930328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ce6f5fd-f4fd-4e6b-8ac9-a27863d65972 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.180938 Aug 30 17:30:13.930752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-dda1af46-61f7-4456-bc8a-6e84c7e19c9b tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for user ba3ba49bb7254d96a5740716d22d417b and project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:13.931032 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 594/1132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:13.935421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a836daa1-312a-480a-9fc3-8ab99fd9551b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98913940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.962505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dda1af46-61f7-4456-bc8a-6e84c7e19c9b tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.058061 Aug 30 17:30:13.963113 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 539/1133] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:30:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:30:13.967730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.968740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:13.975172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.976070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.976172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.976868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.977321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.977744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.988478 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a836daa1-312a-480a-9fc3-8ab99fd9551b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.056359 Aug 30 17:30:13.989196 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 595/1134] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:13.994757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59db15f5-0bcd-4898-96fe-da752aeca657 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Calling method '.version_select at 0x7f2d98913c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.003351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59db15f5-0bcd-4898-96fe-da752aeca657 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1257699461?user_id=c10e8bb1eb224853b235e79f83f82143" status: 200 len: 512 microversion: 2.10 time: 0.012028 Aug 30 17:30:14.004027 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 596/1135] 10.222.0.50 () {60 vars in 1340 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1257699461?user_id=c10e8bb1eb224853b235e79f83f82143 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:30:14.017336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fda78c5-78c4-4c48-833d-458130d5e182 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Action: 'create', calling method: .version_select at 0x7f2d98913820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1657581533", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML2SX8XYHk5ZPxvosZ3Nu1wHXnSOJESe2PIK/SKts3m4BkFV3rqHI0gIm5mZ5JJE90Vsoo44y4IKl5sRQ/vyr0A510VnOa0lmYn6a7dTE/JBvEZapkzt12vXQvkrOcdEA=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:14.033017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5fda78c5-78c4-4c48-833d-458130d5e182 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:14.039001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5fda78c5-78c4-4c48-833d-458130d5e182 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Getting quotas for user ba3ba49bb7254d96a5740716d22d417b and project d1b9f6d951e44e7bb1994c74d4e9ecf0. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:14.065591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fda78c5-78c4-4c48-833d-458130d5e182 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.051712 Aug 30 17:30:14.066259 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 597/1136] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:30:14 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 17:30:14.076424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9d29e173-5404-492a-b379-e88e5f2254b8 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Calling method '.version_select at 0x7f2d98971430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.080159 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-9d29e173-5404-492a-b379-e88e5f2254b8 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:30:14.087082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9d29e173-5404-492a-b379-e88e5f2254b8 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=c10e8bb1eb224853b235e79f83f82143" status: 200 len: 726 microversion: 2.10 time: 0.014140 Aug 30 17:30:14.087674 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 598/1137] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 30 17:30:14 2022] GET /compute/v2.1/os-keypairs?user_id=c10e8bb1eb224853b235e79f83f82143 => generated 726 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:30:14.098019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3516e38b-05c3-4d02-b3ba-7e7de6bd6706 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Calling method '.version_select at 0x7f2d989cb8b0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.118272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3516e38b-05c3-4d02-b3ba-7e7de6bd6706 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1657581533" status: 204 len: 0 microversion: 2.10 time: 0.023807 Aug 30 17:30:14.118851 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 599/1138] 10.222.0.50 () {60 vars in 1325 bytes} [Tue Aug 30 17:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1657581533 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:30:14.120898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:14.127428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f419ee5d-215c-4ee2-9e93-e5b10383d798 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Calling method '.version_select at 0x7f2d98913af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.128977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1b3b9c4-a395-411b-8fb6-3dfff8c11de2 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1472 microversion: 2.1 time: 0.164866 Aug 30 17:30:14.129553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 540/1139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:14.157682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f419ee5d-215c-4ee2-9e93-e5b10383d798 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111961847?user_id=c10e8bb1eb224853b235e79f83f82143" status: 204 len: 0 microversion: 2.10 time: 0.033709 Aug 30 17:30:14.158264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 600/1140] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111961847?user_id=c10e8bb1eb224853b235e79f83f82143 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:30:14.167408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd8578b6-bc01-457b-aab0-982e5c482969 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] Calling method '.version_select at 0x7f2d9cdc2a60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.180623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:14.188446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd8578b6-bc01-457b-aab0-982e5c482969 tempest-KeyPairsV210TestJSON-110568014 tempest-KeyPairsV210TestJSON-110568014-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257699461?user_id=c10e8bb1eb224853b235e79f83f82143" status: 204 len: 0 microversion: 2.10 time: 0.024825 Aug 30 17:30:14.189020 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 541/1141] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257699461?user_id=c10e8bb1eb224853b235e79f83f82143 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:30:14.952958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.953751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:14.962667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:14.963149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:14.963791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:14.964546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:14.965149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:14.965716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:15.007038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bef4be6c-d34f-45ac-b747-6ac63de9cb2c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9938a790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:15.060133 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bef4be6c-d34f-45ac-b747-6ac63de9cb2c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.059277 Aug 30 17:30:15.061247 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 542/1142] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:14 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:15.120337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:15.129860 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de57fd0d-b388-47fb-9f54-169eca9f9543 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.180900 Aug 30 17:30:15.131226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 601/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:14 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:15.151859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:15.152685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:15.161535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:15.162402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:15.163192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:15.164303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:15.165086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:15.165709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:15.309545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de5d84-d461-4587-984e-3561d9cd735a", "name": "network-vif-plugged", "status": "completed", "tag": "6d010187-aee8-4991-9d8f-4e07e234c2b8"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:15.322241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:15.322960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:15.323512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:15.339936 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] Creating event network-vif-plugged:6d010187-aee8-4991-9d8f-4e07e234c2b8 for instance c5de5d84-d461-4587-984e-3561d9cd735a on n-h2-852771-11 Aug 30 17:30:15.346139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-32dd61b1-4001-4cd2-9cfe-b2b95311aca4 req-711e5502-8aa2-4510-96fe-ea460f7c6896 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041349 Aug 30 17:30:15.347433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 602/1144] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:15.396931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:15.408779 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b5d82e5-bc67-49e5-83a5-610441cdb417 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1472 microversion: 2.1 time: 0.262695 Aug 30 17:30:15.409414 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 543/1145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:15 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:16.077997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12548927-1796-417e-b011-e37f5361fb7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d989e5e50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:16.142357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12548927-1796-417e-b011-e37f5361fb7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.070350 Aug 30 17:30:16.143248 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 603/1146] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:16 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:16.152382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:16.153899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:16.164662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:16.165152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:16.165582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.166278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:16.167159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:16.167809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.430292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:16.431389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:16.441700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:16.445401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:16.446068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.447010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:16.450633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:16.451289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.497907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:16.509091 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79f05d1a-4622-4d8e-b873-b9a8a800ab81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.359692 Aug 30 17:30:16.537218 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 544/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:16 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:16.543095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20018f1-2178-4858-ad44-5e78e34a07f5", "name": "network-vif-deleted", "tag": "b127ffbf-7ecd-4f36-946d-1f106d1eba0f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:16.569873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:16.570745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:16.571393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.579830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:16.591958 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f396409-3bbf-4f4a-9a63-9d8703074c1a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1430 microversion: 2.1 time: 0.165591 Aug 30 17:30:16.600677 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] Creating event network-vif-deleted:b127ffbf-7ecd-4f36-946d-1f106d1eba0f for instance b20018f1-2178-4858-ad44-5e78e34a07f5 on n-h2-852771-11 Aug 30 17:30:16.602057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 604/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:16 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1430 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:16.608484 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5b13c8e8-6775-47b0-b61a-4096020d42b8 req-cc242e66-19ea-4b17-a779-952710d8ba5c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069660 Aug 30 17:30:16.609380 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 545/1149] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:17.158715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8efa57ee-c0f7-421c-9d43-e0a759906fc6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98971790>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:17.248408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8efa57ee-c0f7-421c-9d43-e0a759906fc6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.094072 Aug 30 17:30:17.249316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 605/1150] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:17 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:17.534234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:17.535143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:17.544467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.545350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.546065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.547166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.548046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.548707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.624093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:17.624886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:17.632855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.633542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.634152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.635021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.635699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.636279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.685212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.685743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.686177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.686872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lazy-loading 'fault' on Instance uuid b20018f1-2178-4858-ad44-5e78e34a07f5 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:17.743876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:17.755933 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d72492f-6792-4b5a-bc1d-d84079d1bec4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 200 len: 1306 microversion: 2.1 time: 0.136925 Aug 30 17:30:17.756594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 606/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:17 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:17.807683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:17.808345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:17.817502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.817995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.823259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.824140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.828228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.828686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.027007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:18.031924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:18.060927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c301fc0b-d435-47aa-b3d7-a149238962cb tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.533817 Aug 30 17:30:18.066569 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72bdd4bf-f1bb-4bfc-a7d2-216477c84148 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1815 microversion: 2.1 time: 0.266839 Aug 30 17:30:18.067779 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 607/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:17 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1815 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:18.073767 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 546/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:17 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:18.097378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:18.112675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.113619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.114744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.117650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.118291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.119828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.187124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6343d8b0-c4bb-48e1-a6d1-2c0606ad657e tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.102431 Aug 30 17:30:18.195452 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 608/1154] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:30:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:18.264901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82aed7f0-eb2a-49ae-b170-5be4360f6759 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9891d940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:18.371857 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82aed7f0-eb2a-49ae-b170-5be4360f6759 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.111909 Aug 30 17:30:18.380374 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 609/1155] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:18 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:18.549613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "364eb933-1e38-4441-a973-397872e950d0"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:18.558600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:18.573386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.573930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.574391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.575135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.575651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.576118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.779279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:18.780270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: b20018f1-2178-4858-ad44-5e78e34a07f5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:18.793655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.795534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.797598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.812232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.853237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.857174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.908276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 HTTP/1.1 Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:18.910280 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. Aug 30 17:30:18.914272 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b20018f1-2178-4858-ad44-5e78e34a07f5'} Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:18.916846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. Aug 30 17:30:18.920981 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:18.926164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance b20018f1-2178-4858-ad44-5e78e34a07f5 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:18.926164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3e0f0c9-91a4-42ba-b7c9-83fda911f822 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5" status: 404 len: 111 microversion: 2.1 time: 0.138105 Aug 30 17:30:18.926164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 610/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:18 2022] GET /compute/v2.1/servers/b20018f1-2178-4858-ad44-5e78e34a07f5 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:18.926164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:18.926164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:18.930654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.931172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.931663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.932399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.932861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.933318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.944059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] HTTP exception thrown: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Request method failure captured: Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments/d616fe31-00ed-4775-9036-2a77eccfb617 HTTP/1.1 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 74 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDki82fzh1grE4gwnKDKW1NwiMnaZSHLFMCv99Tz7HcQwHhezSU5GwQgfJRgvtgML5LXOEILHF5N83i_HHEbwLsL3JXr5TnjW6IUk61-Z_dDRPX-Jb2ndUjfiRovC78SxhGyS9ASDK-YF6ohWhqD7O1gEmkWBpFK23-5Cixum__ExoS0 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: eb5f516a12384c64acc368bdf1dde88f Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:30:19.003920 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb5f516a12384c64acc368bdf1dde88f"}]}] Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: eb5f516a12384c64acc368bdf1dde88f Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesAdminNegativeTest-1165267875-project-admin Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 85e45e4dd96c46b5978f580f5b5799aa Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesAdminNegativeTest-1165267875-project-admin Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: {"volumeAttachment": {"volumeId": "364eb933-1e38-4441-a973-397872e950d0"}} Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:30:19.006044 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': 'd5cdc1ca-74b9-4656-9fa4-c02f1d43b84d', 'id': 'd616fe31-00ed-4775-9036-2a77eccfb617', 'body': {'volumeAttachment': {'volumeId': '364eb933-1e38-4441-a973-397872e950d0'}}} Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:30:19.007047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. (HTTP 404) (Request-ID: req-568a775e-c771-4a92-9db2-2259040134f9) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:30:19.008260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:19.009596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. Aug 30 17:30:19.010852 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:19.014131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Returning 400 to user: Volume 364eb933-1e38-4441-a973-397872e950d0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:19.014131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d6226008-4d90-4ad1-9f23-9ebd3bdcac84 tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments/d616fe31-00ed-4775-9036-2a77eccfb617" status: 400 len: 107 microversion: 2.1 time: 0.846432 Aug 30 17:30:19.014536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:19.014712 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 547/1157] 10.222.0.50 () {60 vars in 1433 bytes} [Tue Aug 30 17:30:18 2022] PUT /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments/d616fe31-00ed-4775-9036-2a77eccfb617 => generated 107 bytes in 848 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:30:19.087239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.088237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:19.113608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.115866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.116514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.120208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.120859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.123237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.210119 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c5f0460-cc9f-4897-8e8a-b3e8d7a90128 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 204 len: 0 microversion: 2.1 time: 0.291371 Aug 30 17:30:19.216111 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 611/1158] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:18 2022] DELETE /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:19.231841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.233381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:19.248109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.248926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.249378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.250156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.250776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.251378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.287056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:19.309159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:19.588107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:19.596255 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0522bb3-311c-4772-b010-951e93df6756 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.517465 Aug 30 17:30:19.606434 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 548/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:19 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:19.624909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.625199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:19.639087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b305b5b-431d-42ba-adf4-fd1dadfb0987 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 204 len: 0 microversion: 2.1 time: 0.416008 Aug 30 17:30:19.645024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 612/1160] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:19 2022] DELETE /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:19.657682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca157e41-a5ad-488d-b0b4-eca401943cb3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d989cef70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.660445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.662433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.663001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.666120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.666715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.668605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.750050 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca157e41-a5ad-488d-b0b4-eca401943cb3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.102518 Aug 30 17:30:19.750818 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 613/1161] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:19 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:19.771812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.781723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:19.799336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.799855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.800290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.800990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.801437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.801891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.820079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:19.963305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lazy-loading 'services' on Instance uuid d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:20.112626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:20.126008 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd7a751a-a282-4957-8e36-71b0d8797921 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1475 microversion: 2.1 time: 0.373763 Aug 30 17:30:20.127050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 614/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:19 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1475 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:20.134121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.137247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:20.145494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.149340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.149969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.151110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.151862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.152443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.210035 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-16bb0071-3872-4053-b148-a77e6b8c2d78 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments/d616fe31-00ed-4775-9036-2a77eccfb617" status: 202 len: 0 microversion: 2.1 time: 0.601377 Aug 30 17:30:20.213939 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 549/1163] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:30:19 2022] DELETE /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments/d616fe31-00ed-4775-9036-2a77eccfb617 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:30:20.236235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91309b19-7f3f-4dea-b9b0-69dbce70c48d tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104466 Aug 30 17:30:20.236737 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 615/1164] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:20 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:20.237479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.246914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:20.250470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.251155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:20.260051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.260997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.261648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.263610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.264286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.264950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.268181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.269194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.269831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.271362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.272213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.274770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.342944 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9fa752e7-098e-46a8-a1bf-7f28eea179b1 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124162 Aug 30 17:30:20.343583 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 550/1165] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:20 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:20.489253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lazy-loading 'services' on Instance uuid a5515e53-fea6-4869-9cda-21a7c6d7cd30 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:20.628091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.629287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:20.644565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.647273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.648045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.650361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.652093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.655921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.724962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb363d37-eee6-4ac0-a4b9-a7fd4832ed48 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments/473f72cd-8066-4f68-8b8d-48dbab71302e" status: 202 len: 0 microversion: 2.1 time: 0.476206 Aug 30 17:30:20.726458 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 616/1166] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:30:20 2022] DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments/473f72cd-8066-4f68-8b8d-48dbab71302e => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:30:20.796110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f7e2981-5c46-4a37-9f24-a7ad7d9d83be tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d988a3af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.920373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f7e2981-5c46-4a37-9f24-a7ad7d9d83be tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.155111 Aug 30 17:30:20.920952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 617/1167] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:20 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:21.148996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:21.151085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:21.171937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.172432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.172870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.178709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.179215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.179721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.439166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:21.451161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-761491d7-9838-4e72-802c-e6662085a321 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1475 microversion: 2.1 time: 0.306923 Aug 30 17:30:21.466353 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 618/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:21 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:21.477318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:21.482538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:21.491040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.492723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.493331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.494284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.494969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.495961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.557254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d61f06ce-9f78-4d87-9a33-a507be63f423 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088881 Aug 30 17:30:21.562486 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 619/1169] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:21 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:21.593415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:21.607648 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12eea8c6-7948-48d9-81cb-719b8bdcb2a3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1542 microversion: 2.1 time: 0.983556 Aug 30 17:30:21.608732 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 551/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:20 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1542 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:21.771593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066c2865-00c0-494d-bf0a-f7647db04977", "device": "/dev/xvdb"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:21.775230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:21.781709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.782434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.783046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.784522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:21.785141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:21.785749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.936049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c07abf4-7559-42c7-8334-7069d1376038 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cd02ee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:22.015985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c07abf4-7559-42c7-8334-7069d1376038 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.083331 Aug 30 17:30:22.017158 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 552/1171] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:21 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:22.485126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:22.486485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:22.512587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:22.513687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:22.514243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:22.515074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:22.515964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:22.516503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.642436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:23.661815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b921ad8-dadd-4d83-8918-5fc7b9c601ef tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1475 microversion: 2.1 time: 1.185011 Aug 30 17:30:23.662921 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 553/1172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:22 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1475 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:23.670094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:23.673137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:23.684769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.685261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.685702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.686722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.687180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.687919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.745719 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adbb704c-810d-4806-a7f5-4cac5e6cc1fd tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081426 Aug 30 17:30:23.746653 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 554/1173] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:23 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:23.759251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:23.760307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:23.766949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.767777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.768450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.769389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.770064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.771881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.938534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:24.046953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:24.855384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:24.870002 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ad552b2-2f57-4487-92e5-788ec426f464 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1541 microversion: 2.1 time: 1.122021 Aug 30 17:30:24.874424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 555/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:23 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1541 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:24.887120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49801fca-4343-4f3a-bd6f-f2984ad7c61b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cce43a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:25.032950 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49801fca-4343-4f3a-bd6f-f2984ad7c61b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.157097 Aug 30 17:30:25.033777 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 556/1175] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:24 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:25.051848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a512e56-05de-4a89-a168-6d78ba55f28d", "name": "network-vif-deleted", "tag": "a11be65a-7537-4f92-8f02-f501ec9de2ad"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:25.087016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.088489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.092037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.126844 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] Creating event network-vif-deleted:a11be65a-7537-4f92-8f02-f501ec9de2ad for instance 3a512e56-05de-4a89-a168-6d78ba55f28d on n-h1-852771-11 Aug 30 17:30:25.137563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7863685b-1d7e-4985-876a-d74aa8fad3d5 req-6075d295-be8f-4334-a4e8-d431829523a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092484 Aug 30 17:30:25.139433 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 557/1176] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:25.151561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:25.165827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:25.189985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.190770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.200271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.201253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.201729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.212200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.316445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.317129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.317587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.318042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lazy-loading 'fault' on Instance uuid d844b1b6-9083-45c5-95cf-7e21bad87b9c {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:25.440447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:25.455172 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-147c13f5-61af-4222-a6b2-968a8ec40895 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 200 len: 1309 microversion: 2.1 time: 0.310036 Aug 30 17:30:25.456308 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 558/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:25 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:25.472182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:25.487093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:25.502823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.505346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.506411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.507615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.508304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.509505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.569144 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f02889e2-c5c2-4236-b314-fa736ff075ae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109491 Aug 30 17:30:25.570709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 559/1178] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:25 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:25.894169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:25.895105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:25.906515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.910526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.912617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.913683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.915899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.916824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.452190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:26.465740 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1363a052-3d27-428a-a3ba-dbad688d5f81 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1541 microversion: 2.1 time: 0.575501 Aug 30 17:30:26.494456 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 560/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:25 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1541 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:26.503732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c129d241-8300-4698-85d2-3977bbbd6e46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cdc2820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:26.587085 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c129d241-8300-4698-85d2-3977bbbd6e46 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.088883 Aug 30 17:30:26.588835 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 561/1180] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:26 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:26.603062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:26.603715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: d844b1b6-9083-45c5-95cf-7e21bad87b9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:26.636792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.637397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.638510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.639273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.643759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.644434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.710491 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c HTTP/1.1 Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:30:26.716924 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. Aug 30 17:30:26.718555 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd844b1b6-9083-45c5-95cf-7e21bad87b9c'} Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:26.719465 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. Aug 30 17:30:26.720950 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.726752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance d844b1b6-9083-45c5-95cf-7e21bad87b9c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:26.727890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a704ca51-2bd0-4966-a014-b5ff9af9d25d tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c" status: 404 len: 111 microversion: 2.1 time: 0.137393 Aug 30 17:30:26.732764 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 562/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:26 2022] GET /compute/v2.1/servers/d844b1b6-9083-45c5-95cf-7e21bad87b9c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:26.746106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:26.752756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:26.770892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.772007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.773375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.775197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.775696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.777285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.880894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c20cde98-3a99-4bb4-b2c2-61d3828c4881 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143527 Aug 30 17:30:26.886084 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 563/1182] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:26 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:26.890904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:26.903607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 3a512e56-05de-4a89-a168-6d78ba55f28d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:26.909852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.910338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.911326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.912556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.912933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.913363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.941082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d HTTP/1.1 Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:30:26.945221 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. Aug 30 17:30:26.946618 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3a512e56-05de-4a89-a168-6d78ba55f28d'} Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:26.947361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. Aug 30 17:30:26.948605 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:26.949731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance 3a512e56-05de-4a89-a168-6d78ba55f28d could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:26.949731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df80eed3-3b6d-41db-b454-16a0960f39c1 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d" status: 404 len: 111 microversion: 2.1 time: 0.059628 Aug 30 17:30:26.949731 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 564/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:26 2022] GET /compute/v2.1/servers/3a512e56-05de-4a89-a168-6d78ba55f28d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:26.976140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dcefcd18-47b9-407f-b4f4-a97bae945cb9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:27.035326 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dcefcd18-47b9-407f-b4f4-a97bae945cb9 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/7bc9954a-752c-4bbf-96ee-4f82dca857fd" status: 204 len: 0 microversion: 2.1 time: 0.079867 Aug 30 17:30:27.037030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 565/1184] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:30:26 2022] DELETE /compute/v2.1/os-server-groups/7bc9954a-752c-4bbf-96ee-4f82dca857fd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:27.053356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:27.054672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:27.071625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.072488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.073166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.074125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.074798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.075448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.128758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:27.359082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85df619d-12f8-4fd1-986a-37e969d80f30 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 204 len: 0 microversion: 2.1 time: 0.315857 Aug 30 17:30:27.365976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 566/1185] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:27 2022] DELETE /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:27.380014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d844b1b6-9083-45c5-95cf-7e21bad87b9c", "name": "network-vif-deleted", "tag": "79cb5d7d-8589-416f-8076-0e597bf5a8d0"}, {"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-unplugged", "status": "completed", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}, {"name": "network-changed", "server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:27.399651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.400730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.401388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.429753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:27.449138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Creating event network-vif-deleted:79cb5d7d-8589-416f-8076-0e597bf5a8d0 for instance d844b1b6-9083-45c5-95cf-7e21bad87b9c on n-h2-852771-11 Aug 30 17:30:27.449649 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Creating event network-vif-unplugged:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h1-852771-11 Aug 30 17:30:27.450147 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Creating event network-changed:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h1-852771-11 Aug 30 17:30:27.472744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:30:27.502872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d0cc9ed6-19a0-4024-a6cb-2594e2d9cf71 req-0bb3b5be-1a5b-43c9-8656-5a8763c7bf55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.135117 Aug 30 17:30:27.504371 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 567/1186] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:27.513869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:27.514921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:27.523650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.524656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.525476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.526755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.528314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.529048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.567944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:27.733067 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0fdf5feb-4b70-41e6-a98a-9f649d02dfd6 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 204 len: 0 microversion: 2.1 time: 0.217707 Aug 30 17:30:27.736042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 568/1187] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:27 2022] DELETE /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:27.749985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:27.753286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:27.763064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.764451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.766906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.769950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:27.773758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:27.776603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:28.117724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:28.129786 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4805664c-897d-4ea6-ba6a-81b003c55a4c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1473 microversion: 2.1 time: 0.386731 Aug 30 17:30:28.130391 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 569/1188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:27 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:28.140730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b38e5d23-ab56-4f8c-8ccd-76c7e78d728a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98d02430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:28.141231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:28.204284 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b38e5d23-ab56-4f8c-8ccd-76c7e78d728a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.069589 Aug 30 17:30:28.205216 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 570/1189] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:28 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:28.221465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:28.224094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:28.241499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:28.242237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:28.247069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:28.248317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:28.248437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:28.249003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:28.972148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:28.999907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb8fe6d2-efa2-4394-b5f4-c4a73e4a233a tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 200 len: 1473 microversion: 2.1 time: 0.791320 Aug 30 17:30:29.007873 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 571/1190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:28 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 1473 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:29.013245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:29.041160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:29.061472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.079715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.080401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:29.085221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.085709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.086143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:29.245432 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-814db683-983a-439c-a6df-8063d9eff4a9 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236330 Aug 30 17:30:29.263364 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 572/1191] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:29 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:29.286245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:29.286944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:29.327716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.330752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.331200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:29.332129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.342350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.344188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:30.072143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:30.082512 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f784ea26-74b1-419d-b696-b90a822dc316 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1470 microversion: 2.1 time: 0.817876 Aug 30 17:30:30.087388 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 573/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:29 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1470 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:30.096968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-859f25ce-deb5-4d1e-bdfc-f5d58e86402a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cddb9d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:30.272423 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-859f25ce-deb5-4d1e-bdfc-f5d58e86402a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.183534 Aug 30 17:30:30.273127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 574/1193] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:30 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:30.297265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:30.308489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:30.363018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:30.378527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:30.378961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:30.380486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:30.381882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:30.385069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:31.779362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:31.876131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:32.221935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:32.265851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-854708c4-b6d0-4419-a393-a97292c16bbc tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 200 len: 1473 microversion: 2.1 time: 1.969854 Aug 30 17:30:32.285835 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 575/1194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:30 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 1473 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:32.303000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:32.327294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:32.362082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.368352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.376141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.378364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.380105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.439636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.680930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.688477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.693952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.698955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.699806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.704388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.858253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:32.870234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:33.398841 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ac19753-3ec8-4a1b-8134-07d100169c0b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064/action" status: 202 len: 0 microversion: 2.1 time: 1.110688 Aug 30 17:30:33.403798 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 576/1195] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:30:32 2022] POST /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:30:33.427071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:33.446538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:33.501549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:33.502308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:33.503957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:33.507705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:33.508427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:33.512230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:33.677661 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d85bf24f-a8f7-4d77-8b4f-5152b8024619 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.272357 Aug 30 17:30:33.679068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 577/1196] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:33 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d/os-volume_attachments => generated 25 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:30:33.716951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b90a385-c597-4045-8051-eaff633c048c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc381f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:33.857741 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b90a385-c597-4045-8051-eaff633c048c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.177232 Aug 30 17:30:33.869632 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 578/1197] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:33 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:33.959987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847aa5c3-3996-466d-acab-f7319e82318b", "name": "network-vif-deleted", "tag": "0df21985-7e53-4ea0-a50b-cb0bbbbc24d5"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:34.088907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.089321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.089758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.153725 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] Creating event network-vif-deleted:0df21985-7e53-4ea0-a50b-cb0bbbbc24d5 for instance 847aa5c3-3996-466d-acab-f7319e82318b on n-h2-852771-11 Aug 30 17:30:34.180021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f82702bf-6cde-4210-812e-26026eee9bf6 req-9f7352bb-88bf-47e5-a1b2-87df4b056bb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306287 Aug 30 17:30:34.181705 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 579/1198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:34.198744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:34.203931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:34.210901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:34.226435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.227228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.227917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.228989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.229777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.235653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.360236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.361061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.362423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.365458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lazy-loading 'fault' on Instance uuid 95e414bb-ae04-4825-9c15-eadea2d0af60 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:34.603040 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bcb598fd-1ee2-4301-a93e-cd8d114d98a3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.815264 Aug 30 17:30:34.605603 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 620/1199] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:30:21 2022] POST /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 194 bytes in 12839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:34.639248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:34.641535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:34.665111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.668045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.669089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.672624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.676252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.678237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.758601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:34.778798 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9a1007d-d528-417b-a2b3-bc658c323d04 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 200 len: 1308 microversion: 2.1 time: 0.594366 Aug 30 17:30:34.805584 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 580/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:34 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:34.825667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e414bb-ae04-4825-9c15-eadea2d0af60", "name": "network-vif-deleted", "tag": "c1b941bb-ed7a-4fdf-95de-0b3b287b2301"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:34.859815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:34.862230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:34.865573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.898032 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] Creating event network-vif-deleted:c1b941bb-ed7a-4fdf-95de-0b3b287b2301 for instance 95e414bb-ae04-4825-9c15-eadea2d0af60 on n-h2-852771-11 Aug 30 17:30:34.913095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6d8f5829-585c-4b76-90e8-e6a512cd85f2 req-67ae5667-42e9-4808-a0af-51caa6a6f8ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105914 Aug 30 17:30:34.915778 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 581/1201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:34.926912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1121348258", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "92268812-2d89-475b-a754-68d4d19df53f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:35.065066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] validate_networks() for [('92268812-2d89-475b-a754-68d4d19df53f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:30:36.969440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:36.978637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94741e4d-0e6d-4468-939d-232295cb2472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1469 microversion: 2.1 time: 2.370965 Aug 30 17:30:36.985988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 621/1202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:34 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1469 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:37.001558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:37.008248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:37.039856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.040689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.041312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.044150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.044800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.045863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.117622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:37.345770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52701c67-a533-472b-9371-dcdbfb2bcfa7 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 204 len: 0 microversion: 2.1 time: 0.355943 Aug 30 17:30:37.346862 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 622/1203] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:36 2022] DELETE /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:37.362988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73a48294-5377-4493-9d05-3cae76a40857 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9882a5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:37.479832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73a48294-5377-4493-9d05-3cae76a40857 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.123841 Aug 30 17:30:37.482040 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 623/1204] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:37 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:37.495750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:37.498806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 95e414bb-ae04-4825-9c15-eadea2d0af60] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:37.518657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.519382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.520783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.522674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.529337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.530011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.587758 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 HTTP/1.1 Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:37.599995 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. Aug 30 17:30:37.601612 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '95e414bb-ae04-4825-9c15-eadea2d0af60'} Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:37.602561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. Aug 30 17:30:37.607054 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:37.612125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance 95e414bb-ae04-4825-9c15-eadea2d0af60 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:37.612125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92b300f4-5982-4e1a-9b9c-ebe39c317a76 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60" status: 404 len: 111 microversion: 2.1 time: 0.116877 Aug 30 17:30:37.612125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 624/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:37 2022] GET /compute/v2.1/servers/95e414bb-ae04-4825-9c15-eadea2d0af60 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:37.622353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-plugged", "status": "completed", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:37.657118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.657614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.668315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.690492 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Creating event network-vif-plugged:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h1-852771-11 Aug 30 17:30:37.710154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:30:37.743572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a8a1bba0-5840-44b7-b249-1d138b3f9ab6 req-360796fc-0408-4516-bdb4-dbbbc36b455b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134722 Aug 30 17:30:37.745285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 625/1206] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:37.763672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:37.765910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:37.782248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.783333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.784098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:37.785622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:37.786617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:37.787571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:38.199031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:38.209826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8af036d-0c48-4734-8fd7-ab9bb32bc1d5 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1667 microversion: 2.1 time: 0.462981 Aug 30 17:30:38.225296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 626/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:37 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1667 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:38.230514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:38.246011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: 847aa5c3-3996-466d-acab-f7319e82318b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:38.267786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:38.275269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:38.283005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:38.286208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:38.287948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:38.290914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:38.311000 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b HTTP/1.1 Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:38.322038 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. Aug 30 17:30:38.323549 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '847aa5c3-3996-466d-acab-f7319e82318b'} Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:38.324316 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. Aug 30 17:30:38.325525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:38.335617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance 847aa5c3-3996-466d-acab-f7319e82318b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:38.336030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ca52532-9d5a-467c-8e2c-44bf4cb3b51f tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b" status: 404 len: 111 microversion: 2.1 time: 0.108805 Aug 30 17:30:38.337435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 627/1208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:38 2022] GET /compute/v2.1/servers/847aa5c3-3996-466d-acab-f7319e82318b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:38.349708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:38.353117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:38.387836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:38.388743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:38.389439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:38.392493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:38.396140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:38.399635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:38.749345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:38.775848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e1b3f44c-a7e9-47e2-81b5-eb933c16468c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1469 microversion: 2.1 time: 0.433671 Aug 30 17:30:38.783601 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 628/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:38 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:38.813114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50b63571-1a5d-4d18-aece-89067b093bd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:38.947874 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50b63571-1a5d-4d18-aece-89067b093bd4 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/b324eccc-1358-4ed4-8dea-2d5a19cfe003" status: 204 len: 0 microversion: 2.1 time: 0.162707 Aug 30 17:30:38.949358 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 629/1210] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:30:38 2022] DELETE /compute/v2.1/os-server-groups/b324eccc-1358-4ed4-8dea-2d5a19cfe003 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:38.993689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23a00e83-f8fb-408b-b41e-43c85834da32 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9882ac10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:39.126970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23a00e83-f8fb-408b-b41e-43c85834da32 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.175017 Aug 30 17:30:39.141142 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 630/1211] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:38 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:39.150766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:39.153703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:39.183697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.184481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.185080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.185965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.187296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.188836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.252857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:39.580947 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-922feb81-4b3e-4701-94bd-b7df27a7d937 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 204 len: 0 microversion: 2.1 time: 0.430761 Aug 30 17:30:39.591797 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 631/1212] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:39 2022] DELETE /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:39.620376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:39.621669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:39.641263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.641762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.647743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.648522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.653176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.655043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.663782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:30:39.665562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:30:39.666412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:30:39.667330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:30:39.668251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:30:39.715613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.718377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.720233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.722772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:39.725263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:39.729123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:39.803391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for project c7af706e5f574c11b8ee4691053b836d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:39.854026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Getting quotas for user 613b6b57b6b94a74ba11d34d1b84f529 and project c7af706e5f574c11b8ee4691053b836d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:39.944909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:30:39.968810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:30:40.106062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:40.119227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe5f30a8-cef5-475c-b9a3-c1b0dfd0a125 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1667 microversion: 2.1 time: 0.521974 Aug 30 17:30:40.133957 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 632/1213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:39 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1667 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:40.139300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:40.139985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:40.147803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:40.148301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:40.149103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:40.151216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:40.152006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:40.152520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:40.237338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0fcf90cf-8ce5-42db-930d-d42093c6e66c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.319967 Aug 30 17:30:40.244661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 582/1214] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 5325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:30:40.256565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:40.257082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:40.279595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:40.279595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:40.279595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:40.279595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:40.280033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:40.280033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:40.662260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:40.674451 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cabab209-5469-4396-ac19-e6948daca395 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1473 microversion: 2.1 time: 0.539243 Aug 30 17:30:40.699636 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 633/1215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:40 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:40.758583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f15be519-6d2f-4bb7-b940-4efc8f65a24c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d988455e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:40.929017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f15be519-6d2f-4bb7-b940-4efc8f65a24c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.227828 Aug 30 17:30:40.930301 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 634/1216] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:40 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:40.939856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11fcc7fc-68e0-4a61-bfa8-9a570598c0cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:40.949469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11fcc7fc-68e0-4a61-bfa8-9a570598c0cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:41.461877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11fcc7fc-68e0-4a61-bfa8-9a570598c0cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:41.470716 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11fcc7fc-68e0-4a61-bfa8-9a570598c0cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1218 microversion: 2.1 time: 0.539264 Aug 30 17:30:41.478703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 635/1217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:40 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1218 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:41.500426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:41.512322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:41.545161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:41.561455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:41.562359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:41.580480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:41.601562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:41.603426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:42.211332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:42.244819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ff61f8ee-3484-4da5-8c9c-35e5b34b315f tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1667 microversion: 2.1 time: 0.762409 Aug 30 17:30:42.245927 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 636/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:41 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1667 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:42.270406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:42.272174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:42.297305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:42.298259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:42.324138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:42.325365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:42.327392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:42.327872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:42.568766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:42.605402 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31818b3c-ef3f-4183-af6d-1c239cab854c tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1469 microversion: 2.1 time: 2.362085 Aug 30 17:30:42.609477 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 583/1219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:40 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1469 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:42.639230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32e65348-a2d0-488d-b78a-2c234504fc22 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc38820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:43.031904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:43.041630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d46b535c-78a1-4799-bfad-fbe66d53d815 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1473 microversion: 2.1 time: 0.792386 Aug 30 17:30:43.042215 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 637/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:42 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1473 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:43.052445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:43.072484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:43.078827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.079639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.080240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.081124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.082240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.091555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.163756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32e65348-a2d0-488d-b78a-2c234504fc22 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.552619 Aug 30 17:30:43.176328 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 584/1221] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:42 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:43.219266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b843620e-f9b8-4233-b4e5-33a005a2c77a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc7e65db-2b93-4534-9dca-751e0e58e45e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:43.237714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.256132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.256634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.281907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:43.319056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] Creating event network-vif-unplugged:fc7e65db-2b93-4534-9dca-751e0e58e45e for instance b843620e-f9b8-4233-b4e5-33a005a2c77a on n-h1-852771-11 Aug 30 17:30:43.336990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-dd8c18f9-478a-4a7b-8296-60484ba96f40 req-63626c8b-1f7c-4717-ba80-f6f86b8a5c46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118016 Aug 30 17:30:43.343725 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 585/1222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:43.355098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:43.360302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:43.361746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:43.370863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87aa4dd2-e0fb-472b-83c6-d3c469ae400d tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1270 microversion: 2.1 time: 0.322709 Aug 30 17:30:43.383715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 638/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:43 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1270 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:43.394955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f469e743-c50d-4bb3-bfe5-12c224de8f51", "name": "network-vif-deleted", "tag": "fe8f1ab1-2040-4da8-8fc8-62d5ad4de583"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:43.405803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.406312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.406754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.413333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.414181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.414823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.428314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.429194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.429806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.451185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:43.456810 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] Creating event network-vif-deleted:fe8f1ab1-2040-4da8-8fc8-62d5ad4de583 for instance f469e743-c50d-4bb3-bfe5-12c224de8f51 on n-h1-852771-11 Aug 30 17:30:43.468440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b3cf0924-68e0-4db5-9374-5d7e880bebc5 req-89e7b16d-25a3-4b12-93cc-035b245e3d79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084003 Aug 30 17:30:43.469597 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 639/1224] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:43.635724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:43.637468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:43.653835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.654335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.654781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:43.655553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:43.655973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:43.656585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:44.392037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:44.408430 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4f899a2f-6a37-4bda-bf85-6076de66c6a2 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1469 microversion: 2.1 time: 0.776767 Aug 30 17:30:44.408976 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 640/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:43 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1469 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:44.438791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:44.439511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:44.457029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:44.457809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:44.458287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:44.459001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:44.460117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:44.462406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:44.545230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:44.545984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:44.546586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:44.547204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lazy-loading 'fault' on Instance uuid f469e743-c50d-4bb3-bfe5-12c224de8f51 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:44.554007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:44.573457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3cc99eff-b1c9-4da6-b498-46cf9eb4ca5b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1667 microversion: 2.1 time: 1.226680 Aug 30 17:30:44.576812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 586/1226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:43 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1667 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:44.595325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ab63675-c6d6-4759-a287-efeab6682b05 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cd07790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:44.659690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a7777450394d349220daa222347ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580c9f4e00b844efa3be8dfb510c2caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:44.677923 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88c29bd0-1eeb-4311-9009-1f0746213b54 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 200 len: 1436 microversion: 2.1 time: 0.259130 Aug 30 17:30:44.684221 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 641/1227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:44 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 1436 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:44.689141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:44.705101 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ab63675-c6d6-4759-a287-efeab6682b05 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.125384 Aug 30 17:30:44.707408 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 587/1228] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:44 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:44.712438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:44.723535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:44.724151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:44.724597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:44.727824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:44.728367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:44.728894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:45.246927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:45.264738 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e50fed46-2f1e-4fb9-ac10-8d82e87abc24 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1276 microversion: 2.1 time: 0.579212 Aug 30 17:30:45.265632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 642/1229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:44 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1276 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:45.438553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:45.441945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:45.461366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:45.464282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:45.465838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:45.470139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:45.473672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:45.474639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:45.599421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:45.600368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:45.614524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:45.623930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:45.624397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:45.625161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:45.625644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:45.626083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:45.914689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:45.927325 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-050542c3-719f-470a-ba25-6f4d320643a0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1599 microversion: 2.1 time: 0.332125 Aug 30 17:30:45.939140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 643/1230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:45 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1599 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:45.965826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:45.969320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] [instance: f469e743-c50d-4bb3-bfe5-12c224de8f51] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:46.011077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.012251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.014888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.015292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.016089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.016771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.056146 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] HTTP exception thrown: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Request method failure captured: Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 HTTP/1.1 Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkh_EKZ51KgAGqgV0TrfQaR3f1gfOen9eqA6l9iDnjVlT9i93PlvsCP0z3YYgVyeBGzvSOTVIc1j-tWURQAq_jnFctK25wYqkHMiqYfe97tFfLmmV6_0jq_59k_wN3Ehfgzm4jMHgEsthaSCCn6vXsXNI2xSd9dxlCWDOSYSotgolTw Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:46.060208 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/580c9f4e00b844efa3be8dfb510c2caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_580c9f4e00b844efa3be8dfb510c2caa"}]}] Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 580c9f4e00b844efa3be8dfb510c2caa Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1849664289 Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b5a7777450394d349220daa222347ec3 Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersOnMultiNodesTest-1849664289-project Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. Aug 30 17:30:46.061577 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f469e743-c50d-4bb3-bfe5-12c224de8f51'} Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:46.062364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. Aug 30 17:30:46.063704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:46.069696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] Returning 404 to user: Instance f469e743-c50d-4bb3-bfe5-12c224de8f51 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:46.070818 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-528dfd68-e050-453a-b918-522fb3906b19 tempest-ServersOnMultiNodesTest-1849664289 tempest-ServersOnMultiNodesTest-1849664289-project] 10.222.0.50 "GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51" status: 404 len: 111 microversion: 2.1 time: 0.130068 Aug 30 17:30:46.071679 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 644/1231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:45 2022] GET /compute/v2.1/servers/f469e743-c50d-4bb3-bfe5-12c224de8f51 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:46.077678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3cefaa6a-1923-4be1-b2f8-9d9c7039992a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9882ae50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:46.233913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3cefaa6a-1923-4be1-b2f8-9d9c7039992a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1414 microversion: 2.1 time: 0.160973 Aug 30 17:30:46.243028 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 645/1232] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:46 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:46.271415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:46.278826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:46.304922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.305596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.307189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.308120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.308923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.310894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.438971 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f8d6d31-a6dc-499a-913b-3061135b6273 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199544 Aug 30 17:30:46.450875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 646/1233] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:46 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments => generated 25 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:30:46.466850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:46.469760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:46.482312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.483143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.483808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.484723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:46.485509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:46.486124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:46.967716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:46.977242 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea480b8a-2e1f-45f6-84a4-d3aa1060838e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.524890 Aug 30 17:30:46.994202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:46.995565 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 647/1234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:46 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:47.000593 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04299cc9-14d2-4375-b077-b2f043a26bf9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1469 microversion: 2.1 time: 1.571376 Aug 30 17:30:47.000593 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 588/1235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:45 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1469 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:47.004068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.006663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:47.010725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.023434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.025280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.026918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.031549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.032238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.032783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.052475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:47.093888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.098990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.099765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.101895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.107491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3faf4af-8689-489a-a635-209783b8a3c7 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106079 Aug 30 17:30:47.108009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.108474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.109216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 648/1236] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:30:46 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:30:47.124146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-unplugged", "status": "completed", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:47.162380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.164547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.167022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.199659 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Creating event network-vif-unplugged:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:30:47.229264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:30:47.262025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-46b47b37-92a3-4ddf-9856-343770afc8a1 req-b6981be3-dc60-4046-8bf1-8ca2aea2aba1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140823 Aug 30 17:30:47.266153 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 649/1237] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:47.275066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed9fa913-48f4-4e6a-b794-45ece685d55a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9885f4c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.340382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:47.355790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed9fa913-48f4-4e6a-b794-45ece685d55a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1423 microversion: 2.1 time: 0.088116 Aug 30 17:30:47.367909 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 650/1238] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:47 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:47.374115 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-021f3f04-14fb-4633-b624-3a933ed8198b tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1599 microversion: 2.1 time: 0.370072 Aug 30 17:30:47.375361 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 589/1239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:46 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1599 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:47.377595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.379871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:47.395874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b4f8374-3986-4e92-8ac7-968a37fff0d5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cce41f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.405293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.416127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.416907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.417834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.418460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.419076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.452763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b4f8374-3986-4e92-8ac7-968a37fff0d5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 200 len: 1423 microversion: 2.1 time: 0.073869 Aug 30 17:30:47.453991 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 590/1240] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:30:47 2022] GET /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:47.467242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adb91bf4-b8b8-4d48-91de-854cbc0a3dea tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc693a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.469139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:47.595600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e34b8a19-f0a1-4608-aa79-97057fb387d2 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 204 len: 0 microversion: 2.1 time: 0.225869 Aug 30 17:30:47.596232 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 651/1241] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:47 2022] DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:47.611192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:47.611958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:47.645793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.648129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.648645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:47.649412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:47.649886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:47.655969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.408444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:48.443118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-148cdbc2-c267-4ff7-a8f2-2349a5af6057 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1680 microversion: 2.1 time: 0.838333 Aug 30 17:30:48.459433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 652/1242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:47 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1680 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:48.476665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b843620e-f9b8-4233-b4e5-33a005a2c77a", "name": "network-vif-deleted", "tag": "fc7e65db-2b93-4534-9dca-751e0e58e45e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:48.497138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adb91bf4-b8b8-4d48-91de-854cbc0a3dea tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 204 len: 0 microversion: 2.1 time: 1.033701 Aug 30 17:30:48.498943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 591/1243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:47 2022] DELETE /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:48.505681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729e2828-b94e-4617-948f-2697517bf1b8", "tag": "c80aed5d-3ea0-4e9a-9081-8b983cfa4964"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:48.510786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.511212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.511661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.520335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.521179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.521918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.539366 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] Creating event network-vif-deleted:fc7e65db-2b93-4534-9dca-751e0e58e45e for instance b843620e-f9b8-4233-b4e5-33a005a2c77a on n-h1-852771-11 Aug 30 17:30:48.547948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] Creating event network-changed:c80aed5d-3ea0-4e9a-9081-8b983cfa4964 for instance 729e2828-b94e-4617-948f-2697517bf1b8 on n-h2-852771-11 Aug 30 17:30:48.555700 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0ac918e3-4f6a-46dc-81b4-c2d64e435217 req-bdf46d0f-cbb3-452a-a454-050e4f466402 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092743 Aug 30 17:30:48.558412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 653/1244] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:48.561451 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3aec6474-2f32-4d1f-b549-65169e190cd7 req-4a075cdf-6c9f-49e9-830d-cb967d3793ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058197 Aug 30 17:30:48.562291 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 592/1245] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:48.572890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:48.574530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:48.575603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:48.578363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:48.594515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.595462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.598268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.598864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.599984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.600300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.601380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.603061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:48.604141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.604486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:48.605223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.605853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:48.998599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:49.007315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f2d1431-25b5-45a2-90d5-fc181b77ccbb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.447264 Aug 30 17:30:49.009903 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 654/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:48 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:49.027058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:49.027773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:49.044734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.045929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.048030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.049364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.051557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.052666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.112172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.114669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.115228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.116587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lazy-loading 'fault' on Instance uuid b843620e-f9b8-4233-b4e5-33a005a2c77a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:30:49.240681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e124bb201348b8adc5db7d060b5a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bd4eea15f44593b4213e27a90bc197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:49.255904 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3f919f6-16b1-4312-9896-091bfbb13b58 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 200 len: 1316 microversion: 2.1 time: 0.238282 Aug 30 17:30:49.267628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 655/1247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:49 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:49.288128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:49.288775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:49.304446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.304946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.306608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.307361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.309217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.309677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.371305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:30:49.454858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:49.538054 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-995a3da1-4e41-4c46-b7ba-fd390b73987b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 204 len: 0 microversion: 2.1 time: 0.278981 Aug 30 17:30:49.541754 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 656/1248] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:49 2022] DELETE /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:30:49.549149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:49.550434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:49.563226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:49.577292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.584297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.585050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.585855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:49.586316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:49.587416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:49.595282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:49.612159 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d6abf924-d767-4841-a49d-27750a72a5b1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1535 microversion: 2.1 time: 1.044315 Aug 30 17:30:49.617271 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 593/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:48 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1535 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:49.731175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-20251499", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "761babee-31fe-4fa1-8591-541df7f3d7a0"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:49.771033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:49.820143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:49.832796 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67002862-0805-48fb-8200-6bcd57afe816 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1680 microversion: 2.1 time: 0.289519 Aug 30 17:30:49.833432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 657/1250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:49 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:49.864667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] validate_networks() for [('761babee-31fe-4fa1-8591-541df7f3d7a0', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:30:49.902227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:50.030094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:50.030700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:50.038760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.039183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.039646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.040609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.041273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.041918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.312438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:50.340591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c2c2ed9-7f3a-4188-9ed4-9c5487a15ede tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.312991 Aug 30 17:30:50.357535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 658/1251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:50 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:50.369658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:50.370282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] [instance: b843620e-f9b8-4233-b4e5-33a005a2c77a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:50.391510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.392083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.392587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.396169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.397693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.398136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.435177 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] HTTP exception thrown: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Request method failure captured: Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a HTTP/1.1 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkj4jRVdMoCUw5VSdxjb2v7Pf5fZ1yrPq9YZ_4ajqVmWYIxf4rnqSRnslYjeeGhAiGFbyZrTkoEkz9p7cUA5iLw19srWCScmGjBPNJq4pI7Svdr9m45WKfomjaedBwx-OBVgJ7tg_sdK3Ek-l7JIIWVpzSZwqwbsXDT09Y0dGie0XbY Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 96bd4eea15f44593b4213e27a90bc197 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestFqdnHostnames-635061440 Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:50.442933 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96bd4eea15f44593b4213e27a90bc197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96bd4eea15f44593b4213e27a90bc197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96bd4eea15f44593b4213e27a90bc197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96bd4eea15f44593b4213e27a90bc197"}]}] Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestFqdnHostnames-635061440 Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 96bd4eea15f44593b4213e27a90bc197 Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-635061440 Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestFqdnHostnames-635061440-project Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 69e124bb201348b8adc5db7d060b5a3b Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestFqdnHostnames-635061440-project Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. Aug 30 17:30:50.444361 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b843620e-f9b8-4233-b4e5-33a005a2c77a'} Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:50.445123 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. Aug 30 17:30:50.446323 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:50.447434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Returning 404 to user: Instance b843620e-f9b8-4233-b4e5-33a005a2c77a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:50.447434 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04151439-0c56-44c0-952a-91e658bb18d0 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a" status: 404 len: 111 microversion: 2.1 time: 0.087001 Aug 30 17:30:50.453647 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 659/1252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:50 2022] GET /compute/v2.1/servers/b843620e-f9b8-4233-b4e5-33a005a2c77a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:50.474401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ae7dddf-d002-4f84-b3dd-7a6421b03d20 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] Calling method '.version_select at 0x7f2d9885f430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:50.521578 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ae7dddf-d002-4f84-b3dd-7a6421b03d20 tempest-ServersTestFqdnHostnames-635061440 tempest-ServersTestFqdnHostnames-635061440-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056851449" status: 202 len: 0 microversion: 2.1 time: 0.060105 Aug 30 17:30:50.522801 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 660/1253] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:30:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056851449 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:30:50.845298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:30:50.845761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:30:50.846251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:30:50.847462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:30:50.848045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:30:50.868291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.869328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.870703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.875506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:50.876221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:50.876823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:50.906056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:50.918202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for user e9055e63b6e44751844a7274c1979566 and project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:50.948908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:30:50.959768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:30:51.024554 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d3b50da-4026-4e6f-be99-c31520604248 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297827 Aug 30 17:30:51.025200 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 594/1254] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:30:51.037672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:51.060782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:51.064152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:51.064990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:51.080410 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Creating event network-changed:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:30:51.094019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:30:51.106909 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9f57004e-fb77-441a-974b-3507f74ed647 req-3f9dbec4-adb5-468b-ba07-ca4a83e810a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078647 Aug 30 17:30:51.108313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 595/1255] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:51.114491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:51.115540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:51.124895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:51.125816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:51.126409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:51.127334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:51.128884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:51.129493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:51.145906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-244604327", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "217d0c94-8215-478d-a8e4-3bc0b700061c"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:51.270301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] validate_networks() for [('217d0c94-8215-478d-a8e4-3bc0b700061c', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:30:51.467071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:52.730090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:52.747274 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7cd9851-d795-4175-99d1-126d77ebf4e8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1535 microversion: 2.1 time: 1.636283 Aug 30 17:30:52.751703 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 596/1256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:51 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1535 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:52.768286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:52.769708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:52.790810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:52.793435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:52.794634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:52.796887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:52.798696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:52.800673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.057836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c3aa4984048889e8d5ca4d93ed785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a9a816d75f4ea4a7cde9aab3938a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:53.068854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fd65063c-bf5c-4fd0-b773-5a4e8ce863f5 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 200 len: 1613 microversion: 2.1 time: 0.315735 Aug 30 17:30:53.069453 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 597/1257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:52 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 1613 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:53.111202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:53.113087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:53.149159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.152407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.153149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.154129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.157946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.158813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.555117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:30:53.556154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:30:53.557600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:30:53.558306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:30:53.558941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:30:53.574337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.575220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.575929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.576963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.578486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.585715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.642137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:53.660769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for user 859d8e930c434d519e4208e58246b471 and project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:53.706874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:30:53.713815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:30:53.915126 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0032d937-4fc0-4a41-b5f9-75e047d49c47 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.338961 Aug 30 17:30:53.920725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 661/1258] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3345 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:30:53.925989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:53.953797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:53.969795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.970908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.971955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:53.973152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:53.974466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:53.974838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:54.337011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:54.351108 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e903038-2f31-42b9-9093-fc6e1ecee332 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.428754 Aug 30 17:30:54.351807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 662/1259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:53 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:54.360351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:54.363272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:54.379958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:54.381626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:54.382036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:54.385000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:54.385507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:54.388255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:54.848671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:54.861411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80c797f8-5541-4df7-8655-a921de6f07b7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1535 microversion: 2.1 time: 0.507297 Aug 30 17:30:54.862893 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 663/1260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:54 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1535 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:54.870170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:54.871245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:54.998081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:55.010588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:55.014072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:55.019855 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac1bb2d9-320b-4a7b-94fc-d413102201f8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1261 microversion: 2.25 time: 0.153498 Aug 30 17:30:55.022434 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 664/1261] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:30:54 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:30:55.039955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:55.045250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:55.057986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.058537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.058989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.064239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.065679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.066377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.079725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:55.090138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-977ba4ff-f18a-49be-a3e9-ec589625ec56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1258 microversion: 2.1 time: 2.016738 Aug 30 17:30:55.099529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 598/1262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:53 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1258 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:55.111044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729e2828-b94e-4617-948f-2697517bf1b8", "name": "network-vif-plugged", "status": "completed", "tag": "c80aed5d-3ea0-4e9a-9081-8b983cfa4964"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:55.126213 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] HTTP exception thrown: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Request method failure captured: Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 HTTP/1.1 Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkiJ92DwPhDHU7nziud70io9uz_9ZZwfx3VOz7qCBU0S-ehfdOSkk7unn5JVxSMg3B_hbE-cUOO31ICRJ8G-7AErQDqsknC89dFW85mWYBm7vclIOugd9fszmsd8_UbdzDUAA3izJ-cyqHbt17AyfkNXNF0gLx4dNlWbv80KOduUIKE Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:30:55.131245 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a9a816d75f4ea4a7cde9aab3938a0c"}]}] Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d76c3aa4984048889e8d5ca4d93ed785 Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:30:55.132958 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a5515e53-fea6-4869-9cda-21a7c6d7cd30'} Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:55.133893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:30:55.135364 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:30:55.143025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Returning 404 to user: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:55.145613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1cb902f-e71f-46f6-8806-36253739e018 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 404 len: 111 microversion: 2.1 time: 0.121942 Aug 30 17:30:55.147701 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 665/1263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:55 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:55.151684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.155332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.155981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.160158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5515e53-fea6-4869-9cda-21a7c6d7cd30", "name": "network-vif-deleted", "tag": "93f1d1cb-660e-413e-b6ae-2505b1587313"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:55.187114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.197967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] Creating event network-vif-plugged:c80aed5d-3ea0-4e9a-9081-8b983cfa4964 for instance 729e2828-b94e-4617-948f-2697517bf1b8 on n-h2-852771-11 Aug 30 17:30:55.198810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.200092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.213799 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4488b862-b453-4b6f-88c7-e3c8d0ed9252 req-7fe3be12-40a2-4d78-8eec-f7cac3b4abf1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112728 Aug 30 17:30:55.218317 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 599/1264] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:55.236904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-540e8e09-ae54-4910-a612-bc23fee7f704 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '.version_select at 0x7f2d9cddbca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:55.249725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] Creating event network-vif-deleted:93f1d1cb-660e-413e-b6ae-2505b1587313 for instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 on n-h1-852771-11 Aug 30 17:30:55.262727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-94b15eb1-bb1f-4e1e-9bc4-ae83063c5d21 req-75bf2441-f675-4f79-af57-8361c6703a4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112423 Aug 30 17:30:55.271900 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 666/1265] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:55.296455 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-540e8e09-ae54-4910-a612-bc23fee7f704 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643085243" status: 202 len: 0 microversion: 2.1 time: 0.076859 Aug 30 17:30:55.299134 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 600/1266] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:30:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643085243 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:30:55.374916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:55.376691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:55.392134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.392660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.393107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.398255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.398754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.399202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.683757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:55.694525 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd973995-a829-4f1e-8afa-9929679c19d8 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.324421 Aug 30 17:30:55.696569 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 667/1267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:55 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:55.888843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:55.889586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:55.898190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.906240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.908710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:55.909815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:55.911221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:55.912217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.055040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:56.056537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:56.076212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.079668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.081546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.092797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.099215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.101028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.320167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.328938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.331660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.333099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e143e2e0-5a2c-4107-a5d1-5682ce120455 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1313 microversion: 2.25 time: 0.290061 Aug 30 17:30:56.333720 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 668/1268] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:30:56 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:30:56.340766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:56.341460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:56.353378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.353882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.354382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.355130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.355641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.356283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.430829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.442566 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04a08430-4059-40e3-8c54-409e6c84cdac tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1264 microversion: 2.1 time: 0.107212 Aug 30 17:30:56.443310 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 669/1269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:56 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1264 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:56.714250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.717181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:56.717798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:56.726161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f7ec2e2-bfd9-4cb2-8bc1-1d5a6887a5a7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1528 microversion: 2.1 time: 0.842450 Aug 30 17:30:56.727979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.731825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.732488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.733400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.734009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.734599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.745733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 601/1270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:55 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1528 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:56.753933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:56.755010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:56.761959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.763073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.764216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.765087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:56.766869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:56.767527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:56.953081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:56.978231 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4cf60b24-1b6b-415a-bec2-f9030a244b1c tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1318 microversion: 2.1 time: 0.264498 Aug 30 17:30:56.995997 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 670/1271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:56 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:57.316196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de5d84-d461-4587-984e-3561d9cd735a", "name": "network-vif-deleted", "tag": "6d010187-aee8-4991-9d8f-4e07e234c2b8"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:57.327588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.328459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.329106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.342592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] Creating event network-vif-deleted:6d010187-aee8-4991-9d8f-4e07e234c2b8 for instance c5de5d84-d461-4587-984e-3561d9cd735a on n-h2-852771-11 Aug 30 17:30:57.355496 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4d05ead6-1a87-497d-b561-361d58662a89 req-8b35858a-c15d-44d5-9344-ba0e1529ce98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042903 Aug 30 17:30:57.356666 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 671/1272] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:57.362562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:57.363610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:57.370636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.371452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.372139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.373674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.374385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.375035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.463657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:57.473952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:57.476709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:57.478570 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e425cd94-ff65-4172-bd6e-24844764fa8d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1319 microversion: 2.25 time: 0.119908 Aug 30 17:30:57.493831 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 672/1273] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:30:57 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1319 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:30:57.500071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-plugged", "status": "completed", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:57.522223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.523021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.523894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.536610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:57.544051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] Creating event network-vif-plugged:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:30:57.551421 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-dd93a406-c207-4dce-90ea-2eda4ababee4 req-42b6c1ff-0a70-44c7-9a74-3c9445580de5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065567 Aug 30 17:30:57.552649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 673/1274] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:57.555862 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc6de457-9f79-44f2-a8d6-48dea76d3028 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1528 microversion: 2.1 time: 0.804462 Aug 30 17:30:57.560518 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 602/1275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:56 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1528 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:57.561869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:57.562962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:57.571063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.571867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.573531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.574408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:57.575026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:57.575668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:57.589460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f7a9088-4b01-417f-bf57-faa81c75f8fc tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:57.612924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5f7a9088-4b01-417f-bf57-faa81c75f8fc tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] HTTP exception thrown: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f7a9088-4b01-417f-bf57-faa81c75f8fc tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Request method failure captured: Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/flavors/29fb62f7-2f80-4d99-abac-79d5b1c5e115 HTTP/1.1 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhgxAOLFktz_bdPay8Dy2QERPz8xgE4TSVShFg7lRD11HbHUYmmIV82M2LXWfeSJ7lMwKMbDqohXxBHcpQPFBJ3fVfnpopgXcFm_AROqtVb74Tk9Gx3BMTIKvS28y0dDjxBYPKh7ywDXTU7QEJkyXxk3KSxxGBkcPf_cAumeBa_zQY Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3eac69eb4d6248dca7cd2e4b5eda6894 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-MigrationsAdminTest-1310142836 Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:30:57.631360 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3eac69eb4d6248dca7cd2e4b5eda6894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3eac69eb4d6248dca7cd2e4b5eda6894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3eac69eb4d6248dca7cd2e4b5eda6894"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3eac69eb4d6248dca7cd2e4b5eda6894"}]}] Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-MigrationsAdminTest-1310142836 Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3eac69eb4d6248dca7cd2e4b5eda6894 Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-MigrationsAdminTest-1310142836 Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-MigrationsAdminTest-1310142836-project-admin Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 43cf6f2d2713464d8d47151e01e3f339 Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-MigrationsAdminTest-1310142836-project-admin Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: exception: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. Aug 30 17:30:57.633155 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '29fb62f7-2f80-4d99-abac-79d5b1c5e115'} Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:57.638411 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. Aug 30 17:30:57.639965 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:30:57.641332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f7a9088-4b01-417f-bf57-faa81c75f8fc tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Returning 404 to user: Flavor 29fb62f7-2f80-4d99-abac-79d5b1c5e115 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:30:57.641332 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f7a9088-4b01-417f-bf57-faa81c75f8fc tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/29fb62f7-2f80-4d99-abac-79d5b1c5e115" status: 404 len: 109 microversion: 2.1 time: 0.054620 Aug 30 17:30:57.641332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 603/1276] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:30:57 2022] DELETE /compute/v2.1/flavors/29fb62f7-2f80-4d99-abac-79d5b1c5e115 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:30:57.695216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:57.704666 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87459295-61d5-4ff0-867d-a9029dd9766d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1264 microversion: 2.1 time: 0.150046 Aug 30 17:30:57.716709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 674/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:57 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:57.805381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1426862929", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:57.866631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:30:57.999765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:58.000771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:58.007202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.008112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.008553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:58.009265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.009719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.010763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:58.314625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:58.332031 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91ba0995-d278-4261-8cf8-a61901088fae tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1508 microversion: 2.1 time: 0.335977 Aug 30 17:30:58.333496 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 675/1278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:57 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:58.507933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:58.510948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:58.527978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.528488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.528936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:58.536249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.537337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.538072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:58.807839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:58.823375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:58.826175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:58.828352 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e8caf8b-209b-47d1-a296-0ea38768ff77 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1319 microversion: 2.25 time: 0.331308 Aug 30 17:30:58.847874 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 676/1279] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:30:58 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:30:58.859752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:58.863426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:58.889508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.890005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.894082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:58.894973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:58.895457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:58.897841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:59.107790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:59.117980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d77101ef-14ce-45bc-a9e7-5fb0e88c3396 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1264 microversion: 2.1 time: 0.267739 Aug 30 17:30:59.131880 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 677/1280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:58 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:59.305361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:30:59.305795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:30:59.306092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:30:59.306500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:30:59.306911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:30:59.329196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:59.329691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:59.330295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:59.332209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:59.332716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:59.335708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:59.382003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:30:59.390760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Getting quotas for user 976b33387d4c4e0b82cc73c4caf91346 and project 8309c74c20234daf928cb7048270089f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:30:59.426374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:30:59.431681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:30:59.529908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f1433c7-31e3-431c-a8a1-fed8be080019 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728317 Aug 30 17:30:59.531939 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 604/1281] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:30:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:30:59.553309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83fe432a-d6a8-4d2e-abe4-7c486fac314a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:59.553997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83fe432a-d6a8-4d2e-abe4-7c486fac314a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:59.690625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83fe432a-d6a8-4d2e-abe4-7c486fac314a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:59.699294 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83fe432a-d6a8-4d2e-abe4-7c486fac314a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1213 microversion: 2.1 time: 0.161056 Aug 30 17:30:59.710665 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 678/1282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:59 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:59.856879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:59.858563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:59.897421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:59.898088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:59.898548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:59.911359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:59.911874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:59.912316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:00.139037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:00.147659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:00.235259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:00.255252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:00.282290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:00.289785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1bf7c02b-6d17-4596-9ef0-ad450c3bc973 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1319 microversion: 2.25 time: 0.437260 Aug 30 17:31:00.294997 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 605/1283] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:30:59 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:00.744591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:00.746371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:00.753220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:00.755098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:00.756042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:00.757883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:00.759154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:00.761655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:00.765829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:00.771129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:00.773223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:00.774301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:00.776039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:00.776705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:01.133024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:01.158127 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec5701a3-80a8-49ef-b005-780998b4a124 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1209 microversion: 2.1 time: 0.429002 Aug 30 17:31:01.161913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 606/1284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:00 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1209 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:01.212493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2bc38952-1e5c-4bbd-a3fc-1c5cd42c4e0b"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:01.215751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:01.234553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:01.235597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:01.236142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:01.237789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:01.239430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:01.240005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:01.330862 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] HTTP exception thrown: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Request method failure captured: Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8/os-volume_attachments/9e949ae7-53b7-4309-8ebe-18863d8594dc HTTP/1.1 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 74 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDki82fzh1grE4gwnKDKW1NwiMnaZSHLFMCv99Tz7HcQwHhezSU5GwQgfJRgvtgML5LXOEILHF5N83i_HHEbwLsL3JXr5TnjW6IUk61-Z_dDRPX-Jb2ndUjfiRovC78SxhGyS9ASDK-YF6ohWhqD7O1gEmkWBpFK23-5Cixum__ExoS0 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: eb5f516a12384c64acc368bdf1dde88f Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:31:01.333683 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb5f516a12384c64acc368bdf1dde88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb5f516a12384c64acc368bdf1dde88f"}]}] Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: eb5f516a12384c64acc368bdf1dde88f Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1165267875 Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesAdminNegativeTest-1165267875-project-admin Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 85e45e4dd96c46b5978f580f5b5799aa Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesAdminNegativeTest-1165267875-project-admin Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: {"volumeAttachment": {"volumeId": "2bc38952-1e5c-4bbd-a3fc-1c5cd42c4e0b"}} Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:31:01.335402 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '729e2828-b94e-4617-948f-2697517bf1b8', 'id': '9e949ae7-53b7-4309-8ebe-18863d8594dc', 'body': {'volumeAttachment': {'volumeId': '2bc38952-1e5c-4bbd-a3fc-1c5cd42c4e0b'}}} Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:31:01.336916 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. (HTTP 404) (Request-ID: req-dd870888-63b7-4c79-b8d2-2234b15194eb) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:31:01.338377 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:01.340085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. Aug 30 17:31:01.341641 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:01.345597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] Returning 404 to user: Volume 9e949ae7-53b7-4309-8ebe-18863d8594dc could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:01.347358 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0a9caee-dd30-4154-9536-953b2337586b tempest-VolumesAdminNegativeTest-1165267875 tempest-VolumesAdminNegativeTest-1165267875-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8/os-volume_attachments/9e949ae7-53b7-4309-8ebe-18863d8594dc" status: 404 len: 109 microversion: 2.1 time: 0.139196 Aug 30 17:31:01.348162 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 607/1285] 10.222.0.50 () {60 vars in 1433 bytes} [Tue Aug 30 17:31:01 2022] PUT /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8/os-volume_attachments/9e949ae7-53b7-4309-8ebe-18863d8594dc => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:31:01.358886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:01.359862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:01.370428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:01.370924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:01.371361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:01.372123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:01.372885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:01.374202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:01.436721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:01.440727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:01.459341 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3a651dc-e28f-4d71-85f9-17a95b02fd6a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 1.324171 Aug 30 17:31:01.460017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 679/1286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:00 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:02.079678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:02.090968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:02.092500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:02.093670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a5dbf52-10bb-4dc9-9c77-bb64005fdf00 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.744166 Aug 30 17:31:02.108705 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 608/1287] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:01 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:02.205466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:02.207887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:02.218945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.219596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.220120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:02.221672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.222260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.223172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:02.482456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:02.484611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:02.499963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.501677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.502457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:02.505170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.508250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.508921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:02.638774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:02.652073 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae2fb663-6712-4d96-a1b9-8907965a374a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1271 microversion: 2.1 time: 0.455309 Aug 30 17:31:02.653734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 680/1288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:02 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1271 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:02.935528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:02.936600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:02.952782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.953535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.954153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:02.955117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:02.955825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:02.956416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:03.310162 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59188c91-13e7-4e8a-bd93-a7a809f80392 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1861 microversion: 2.1 time: 0.378472 Aug 30 17:31:03.331816 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 681/1289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:02 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1861 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:03.337824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:03.338670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:03.353590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:03.354319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:03.363379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:03.364459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:03.364929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:03.365356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:03.600398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:04.017230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:04.031938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9466ea08-0569-4ff3-9f6d-d509e34f0d8e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 1.550969 Aug 30 17:31:04.033152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 609/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:02 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:04.338137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1317528-acd4-4a58-9780-79a5d0d92664", "tag": "67c0fad2-56c7-47e5-8499-3ba4325fe61e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:04.345140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:04.345544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:04.358253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:04.364122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:04.369727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-142a4fda-bafa-4f64-9cb1-f2a703759e30 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 1.036450 Aug 30 17:31:04.378450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.379171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.379768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.389392 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 682/1291] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:03 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:04.410629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:04.415931 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] Creating event network-changed:67c0fad2-56c7-47e5-8499-3ba4325fe61e for instance b1317528-acd4-4a58-9780-79a5d0d92664 on n-h1-852771-11 Aug 30 17:31:04.419258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:04.435506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.439652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.440517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.441786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.445978 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6323afdd-418d-4d57-aa45-1b6b99a959a9 req-7e10ef6c-ca31-4bdd-be88-adf32346fcfa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411291 Aug 30 17:31:04.446602 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 610/1292] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:04.446894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.447638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.473817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:04.474414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:04.499653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.500055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.500493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.501201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.501649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.502131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.530850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lazy-loading 'flavor' on Instance uuid 2afbaf50-34c4-41d7-9bca-5e8c16386de1 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:04.569936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] HTTP exception thrown: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Request method failure captured: Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 HTTP/1.1 Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkiJ92DwPhDHU7nziud70io9uz_9ZZwfx3VOz7qCBU0S-ehfdOSkk7unn5JVxSMg3B_hbE-cUOO31ICRJ8G-7AErQDqsknC89dFW85mWYBm7vclIOugd9fszmsd8_UbdzDUAA3izJ-cyqHbt17AyfkNXNF0gLx4dNlWbv80KOduUIKE Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:31:04.571686 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a9a816d75f4ea4a7cde9aab3938a0c"}]}] Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d76c3aa4984048889e8d5ca4d93ed785 Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:04.573172 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a5515e53-fea6-4869-9cda-21a7c6d7cd30'} Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:04.573940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:04.575629 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:04.577234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Returning 404 to user: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:04.577234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a865dccc-1670-4740-99cb-3695e6cf2a82 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 404 len: 111 microversion: 2.1 time: 0.121748 Aug 30 17:31:04.579021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Going to try to live migrate instance to n-h1-852771-11 {{(pid=122124) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:31:04.586709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 611/1293] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:31:04 2022] DELETE /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:31:04.600536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:04.601161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:04.629760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.630245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.630679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.637466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:04.638373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:04.638803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:04.659648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:05.074810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:05.088368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0fb48040-e933-4344-ba23-ab879ae510d1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1271 microversion: 2.1 time: 0.493968 Aug 30 17:31:05.114132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 612/1294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:04 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1271 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:05.126225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:05.137947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] [instance: a5515e53-fea6-4869-9cda-21a7c6d7cd30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:05.160988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:05.162473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:05.164319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:05.165281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:05.168956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:05.171744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:05.222871 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] HTTP exception thrown: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Request method failure captured: Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 HTTP/1.1 Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkiJ92DwPhDHU7nziud70io9uz_9ZZwfx3VOz7qCBU0S-ehfdOSkk7unn5JVxSMg3B_hbE-cUOO31ICRJ8G-7AErQDqsknC89dFW85mWYBm7vclIOugd9fszmsd8_UbdzDUAA3izJ-cyqHbt17AyfkNXNF0gLx4dNlWbv80KOduUIKE Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:31:05.226594 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a9a816d75f4ea4a7cde9aab3938a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a9a816d75f4ea4a7cde9aab3938a0c"}]}] Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 56a9a816d75f4ea4a7cde9aab3938a0c Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1698683509 Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d76c3aa4984048889e8d5ca4d93ed785 Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1698683509-project Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:05.228224 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a5515e53-fea6-4869-9cda-21a7c6d7cd30'} Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:05.229127 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. Aug 30 17:31:05.230595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:05.235109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] Returning 404 to user: Instance a5515e53-fea6-4869-9cda-21a7c6d7cd30 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:05.237161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5afa1910-cb5c-48d1-bc22-209925936c31 tempest-AttachSCSIVolumeTestJSON-1698683509 tempest-AttachSCSIVolumeTestJSON-1698683509-project] 10.222.0.50 "GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30" status: 404 len: 111 microversion: 2.1 time: 0.121050 Aug 30 17:31:05.239310 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 613/1295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:05 2022] GET /compute/v2.1/servers/a5515e53-fea6-4869-9cda-21a7c6d7cd30 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:31:05.256660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:05.259068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:05.281454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:05.284715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:05.285169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:05.285981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:05.291022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:05.292056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:06.510625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:06.530892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86ce9a50-864f-495f-a366-0ec7d99dfa2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 1.284644 Aug 30 17:31:06.534913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 614/1296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:05 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:06.546362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:06.547309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:06.566640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:06.567634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:06.569694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:06.570790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:06.571818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:06.572436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:07.578199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:07.588986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:07.594109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:07.605647 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e42aef51-74ff-420c-889a-73b81256ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 1.068424 Aug 30 17:31:07.630468 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 615/1297] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:06 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:07.636046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:07.636935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:07.643250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:07.644212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:07.644817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:07.645701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:07.646309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:07.646886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:08.906899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:08.927537 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c149fb0-e7f0-4ccf-926f-43634e99640d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 1.294951 Aug 30 17:31:08.942064 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 616/1298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:07 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:08.959992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:08.960775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:08.969598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:08.970959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:08.971644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:08.974568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:08.975206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:08.976171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.009420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:31:09.138421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b93e9c1-dff3-4478-bb9a-8a1e0a8d95fb tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 204 len: 0 microversion: 2.1 time: 0.190816 Aug 30 17:31:09.142247 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 617/1299] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:31:08 2022] DELETE /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:31:09.149948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2f303c-c54d-4932-bf97-de42b5d5bd41", "tag": "c37faeb8-2d36-4136-9715-a28dc7c62936"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:09.163337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.166144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a2e810d8-f432-465b-831a-8cd667e23a63 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/action" status: 202 len: 0 microversion: 2.1 time: 4.765129 Aug 30 17:31:09.166957 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 683/1300] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:04 2022] POST /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/action => generated 0 bytes in 4777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:09.176839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:09.178332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:09.181103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.181615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.201599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.202109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.202612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.205994 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] Creating event network-changed:c37faeb8-2d36-4136-9715-a28dc7c62936 for instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 on n-h2-852771-11 Aug 30 17:31:09.206664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.207191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.207758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.223061 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ec7191b7-86b5-4ddb-b386-bac9730c0270 req-56bacbb3-ff06-414d-9ffc-2e06d6942f42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081730 Aug 30 17:31:09.223849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 618/1301] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:09.362319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:09.411745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=12 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:09.444099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:09.457970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bde0b834-be94-4918-99b9-d60398f74b43 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 0.286581 Aug 30 17:31:09.459366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 684/1302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:09 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:09.465672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:09.467384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:09.475029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.476198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.476982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.478230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.478926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.479918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.598128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1613143124", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "277b9d29-1f5b-4c95-b7ac-de9596b8c54f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:09.694970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:09.708314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] validate_networks() for [('277b9d29-1f5b-4c95-b7ac-de9596b8c54f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:31:09.718989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:09.728827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:09.730274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:09.731752 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed9b2c65-ab24-43b4-a0f4-71a164d05893 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.270637 Aug 30 17:31:09.732570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 685/1303] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:09 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:09.738234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:09.739110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:09.746011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.746731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.747348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.748242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.748857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.749442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.918549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:09.929379 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5162f39-5c07-418c-a0aa-a6a82a09f8ea tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1514 microversion: 2.1 time: 0.195755 Aug 30 17:31:09.930223 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 686/1304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:09 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:09.951348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:09.952552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:09.961895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.962963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.963600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:09.965226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:09.965920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:09.966847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:10.172943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:10.186921 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c24cd7b6-c7a7-48f9-b4d3-a58479ceed1e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.255377 Aug 30 17:31:10.202513 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 687/1305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:09 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:10.206706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:10.210306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:10.219528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:10.220428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:10.221720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:10.222956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:10.224131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:10.224897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:10.641977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:10.654958 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d6a84d04-b12f-4c1c-a7cd-98fe52058e28 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 0.455919 Aug 30 17:31:10.656292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 688/1306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:10 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:10.672769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:10.674332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:10.704532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:10.706622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:10.707234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:10.708011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:10.708802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:10.709777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.093515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:11.102133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca79f79c-99e3-408a-a10f-803b0b9cc13a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 0.444534 Aug 30 17:31:11.102724 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 689/1307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:10 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:11.113834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:11.114703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:11.132417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.132915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.133349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.134062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.134527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.134940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.529187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:31:11.529998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:31:11.534368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:31:11.534885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:31:11.535311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:31:11.545738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.546518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.547123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.548137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.550146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.551017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.588703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Getting quotas for project e9ee730c6f9c4871bf4500f33d22270a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:31:11.596359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Getting quotas for user 7e9432d2aef74db082bdeeb06b721703 and project e9ee730c6f9c4871bf4500f33d22270a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:31:11.614565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:31:11.617120 n-d-852771-11 devstack@n-api.service[122123]: WARNING nova.utils [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1613143124 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-161314312 Aug 30 17:31:11.618357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:31:11.685450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:11.708924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:11.710545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:11.712222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60d18851-d680-40cf-a22c-ca74281055a4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.603438 Aug 30 17:31:11.716577 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 690/1308] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:11 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:11.722442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:11.723337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:11.736424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec80e6cc-d345-4599-9b97-68ac605da77b tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498188 Aug 30 17:31:11.740769 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 619/1309] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:31:11.741377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.742082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.742631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.743508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.745500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.747758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.761995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:11.762896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:11.777139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.777948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.778647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:11.785288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:11.790505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:11.792315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.196175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:12.212595 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c6681377-65b1-43b0-9216-f1107fbf5047 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1514 microversion: 2.1 time: 0.493144 Aug 30 17:31:12.215462 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 691/1310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:11 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:12.226550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:12.228771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:12.249537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.250038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.250480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.251187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.255882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.256373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.535929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:12.546279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cbc532b6-6003-4426-a64f-6386b2a58502 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 0.327669 Aug 30 17:31:12.546898 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 692/1311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:12 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:12.571146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-616730e3-591b-4718-b851-1d1692979a46 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:12.572432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-616730e3-591b-4718-b851-1d1692979a46 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:12.680487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-616730e3-591b-4718-b851-1d1692979a46 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:12.700770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-616730e3-591b-4718-b851-1d1692979a46 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1232 microversion: 2.1 time: 0.152818 Aug 30 17:31:12.707896 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 693/1312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:12 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1232 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:12.713393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:12.727674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.728465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.729140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.744769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] Creating event network-changed:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:31:12.751181 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-94ef8976-a5df-49a7-9a50-9c242a73a91c req-7a77de00-5ebe-498c-9b37-67fc9713368f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041445 Aug 30 17:31:12.759916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 694/1313] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:12.766747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:12.767891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:12.775766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:12.777907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.778756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.779391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.780529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.781249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.781865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.895000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:12.919756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8970d2af-d2bc-4768-a0ef-c523e1f8b543 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 1.177365 Aug 30 17:31:12.920674 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 620/1314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:11 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:12.927292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:12.931327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:12.947694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.956105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.957068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:12.957973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:12.958585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:12.960686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:13.045740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:13.057748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-766440c5-eb5d-4d90-8d9b-4bf6fb921d7c tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 0.296082 Aug 30 17:31:13.071280 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 695/1315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:12 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:13.235815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:13.236836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:13.244442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:13.245331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:13.246014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:13.247038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:13.248151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:13.248863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:13.258473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:13.453110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:13.464064 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99980a51-9449-44af-b875-fae464d38913 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1514 microversion: 2.1 time: 0.231988 Aug 30 17:31:13.479752 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 696/1316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:13 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:13.566970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:13.567998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:13.575675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:13.576503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:13.577132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:13.578052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:13.578850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:13.579788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.024160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:14.035090 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0d5b39b-73ab-4e26-ac2f-4fb3186e00c6 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 0.470346 Aug 30 17:31:14.049721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 697/1317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:13 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:14.056642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:14.057552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:14.070067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.070677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.075764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.076679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.077996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.078356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.219560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:14.228695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e85b6581-caf3-4078-b0d9-ab02bd69d160 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1290 microversion: 2.1 time: 0.177459 Aug 30 17:31:14.247183 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 698/1318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:14 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1290 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:14.567442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1317528-acd4-4a58-9780-79a5d0d92664", "name": "network-vif-plugged", "status": "completed", "tag": "67c0fad2-56c7-47e5-8499-3ba4325fe61e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:14.585829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.586728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.587529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.605227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] Creating event network-vif-plugged:67c0fad2-56c7-47e5-8499-3ba4325fe61e for instance b1317528-acd4-4a58-9780-79a5d0d92664 on n-h1-852771-11 Aug 30 17:31:14.612424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-76d35cce-b36f-41c8-8d36-1a3f4d8b7a7b req-5a57816f-c618-4d59-82d2-d4d0786e1dc6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376696 Aug 30 17:31:14.614582 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 699/1319] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:14.621628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:14.622666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:14.632082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.632984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.634152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.635238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.635980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.636715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.650638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:14.663018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:14.671291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:14.672959 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-671e8b8c-03ea-48c2-9be2-0ec90bc0b4e6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 1.751102 Aug 30 17:31:14.691519 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 621/1320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:12 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:14.700137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:14.701103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:14.712443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.713266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.713931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.714943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:14.715623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:14.716377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:14.997457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:15.016407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d69a5c34-9e4f-43c3-a9b0-29f48c47bd31 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.390100 Aug 30 17:31:15.017575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 700/1321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:14 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:15.040134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:15.041492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:15.047843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.049124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.049875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:15.051076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.051730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.052343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:15.455022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:15.472360 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-88f76e2b-6762-4322-9925-f9d8afeb84a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1306 microversion: 2.1 time: 0.779130 Aug 30 17:31:15.492888 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 622/1322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:14 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1306 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:15.507315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:15.508348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:15.533886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.535151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.537066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:15.541015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.541815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.542355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:15.792340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:15.805241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef04e4c0-2a7f-4c4e-b401-c4cbefbfb718 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 200 len: 1514 microversion: 2.1 time: 0.769973 Aug 30 17:31:15.811766 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 701/1323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:15 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 1514 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:15.820612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:15.824353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:15.840912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.843936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.846131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:15.850125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:15.850944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:15.854630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.236170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:16.253720 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6370a17e-cf55-45fe-8294-9d1c215a409c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.438693 Aug 30 17:31:16.256094 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 702/1324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:15 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:16.264702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:16.268491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:16.281651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.285058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.286142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.287763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.289899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.293034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.349694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:16.358214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-029c11be-abec-4e78-a891-ecdeba21ab4a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 0.863084 Aug 30 17:31:16.358815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 623/1325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:15 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:16.374197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:16.374813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:16.407360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.408739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.409490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.410927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.418132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.420789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.812065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:16.821926 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d2a54aa-b01e-412b-a396-1149ac1fbf60 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.462064 Aug 30 17:31:16.842541 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 624/1326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:16 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:16.849789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729e2828-b94e-4617-948f-2697517bf1b8", "name": "network-vif-deleted", "tag": "c80aed5d-3ea0-4e9a-9081-8b983cfa4964"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:16.879418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.887400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.888169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.915536 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] Creating event network-vif-deleted:c80aed5d-3ea0-4e9a-9081-8b983cfa4964 for instance 729e2828-b94e-4617-948f-2697517bf1b8 on n-h2-852771-11 Aug 30 17:31:16.928898 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3ae5b65f-5892-4f70-9c2b-e377ac36aba9 req-4f078884-3a80-4ef2-90d3-a223eb795386 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084507 Aug 30 17:31:16.935883 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 625/1327] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:16.942267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:16.948768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:16.961987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.969051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.969794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:16.970892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:16.971869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:16.972583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.257707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:17.273113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:17.274797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:17.276523 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d57127f6-129c-4bf2-8880-865966e76ac9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 1.019292 Aug 30 17:31:17.285521 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 703/1328] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:16 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:17.302458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:17.303085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: 729e2828-b94e-4617-948f-2697517bf1b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:17.310514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.310994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.311645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.313422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.324578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.326327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.354507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] HTTP exception thrown: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Request method failure captured: Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 HTTP/1.1 Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkixBI72uCx4wJ4_gprvpqDIbelo1CHi7r03KYxaAx_dDLZmy8kTsWhXtQDHpw0e1csnsI3zo7PlugiD5JAKzcLwKhOmnQ-VAta48jcLAr0yzttcbnMrFCh0TZjC9GwwqCDzx8xq6z8roe1Gxp0ZU9-xWVmgrIi4Vtx397Bc5RAku0U Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c7af706e5f574c11b8ee4691053b836d Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:17.356992 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c7af706e5f574c11b8ee4691053b836d"}]}] Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c7af706e5f574c11b8ee4691053b836d Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesAdminNegativeTest-1168327257-project Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 613b6b57b6b94a74ba11d34d1b84f529 Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesAdminNegativeTest-1168327257-project Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. Aug 30 17:31:17.358604 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '729e2828-b94e-4617-948f-2697517bf1b8'} Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:17.359618 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. Aug 30 17:31:17.361873 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:17.378747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Returning 404 to user: Instance 729e2828-b94e-4617-948f-2697517bf1b8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:17.379957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-800ded73-74b3-482a-9000-1fada04270d4 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8" status: 404 len: 111 microversion: 2.1 time: 0.093210 Aug 30 17:31:17.380744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 704/1329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:17 2022] GET /compute/v2.1/servers/729e2828-b94e-4617-948f-2697517bf1b8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:31:17.394302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:17.395134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:17.410693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.419099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.420358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.421343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.421994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.422618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.759529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:17.775893 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ee0f92c-3404-40c8-84e2-237678a53254 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1487 microversion: 2.1 time: 0.838239 Aug 30 17:31:17.776496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 626/1330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:16 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1487 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:17.784515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:17.792380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:17.810054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.818196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.818997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:17.820289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:17.820912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:17.821491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.085876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:18.093826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e72668c9-7cd2-4a63-8ef1-2c68c403fd73 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.711309 Aug 30 17:31:18.095050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 705/1331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:17 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:18.101937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:18.102717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:18.114818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.115741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.116398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.118551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.119964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.120630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.163369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lazy-loading 'flavor' on Instance uuid b1317528-acd4-4a58-9780-79a5d0d92664 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:18.291165 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d39e319-41bc-42cb-b6ba-fe37495e8519 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664/action" status: 202 len: 0 microversion: 2.1 time: 0.193951 Aug 30 17:31:18.293170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 706/1332] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:18 2022] POST /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:18.299683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:18.300708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:18.307803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.308877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.309633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.310999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.311943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.312682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.731680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:18.745960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-49368b04-ca1b-4ff1-b56b-db12ecbd65d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.451304 Aug 30 17:31:18.761126 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 707/1333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:18 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:18.771754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:18.772480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:18.804009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.804935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.807491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.810074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:18.837183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:18.839348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:18.971336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:18.986994 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0cc30df9-6ee7-44fd-b14c-4516c911929f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 1.208429 Aug 30 17:31:18.989317 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 627/1334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:17 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:18.999449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:19.000459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:19.018661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.019424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.020049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.021355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.021986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.027768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.431581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:19.459839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c897610-3a3e-4c2e-8117-894bd9f4eb1a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1495 microversion: 2.1 time: 0.695551 Aug 30 17:31:19.461476 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 708/1335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:18 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1495 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:19.475214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:19.478137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:19.489729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:19.494946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.497497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.499705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.513631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.515116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.515799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.520883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:19.523629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:19.525103 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e096fb2-9c34-4f05-b5e8-a6a9ae0cb629 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.534600 Aug 30 17:31:19.525679 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 628/1336] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:18 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:19.652761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba5c0d0-bb43-4408-b3d9-a2539324b17a", "tag": "5e02187b-a601-44e4-844b-4af910af5599"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:19.665635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.666108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.666532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.695637 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] Creating event network-changed:5e02187b-a601-44e4-844b-4af910af5599 for instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a on n-h2-852771-11 Aug 30 17:31:19.705949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-cc170dcd-204e-490e-9f27-ad31fce92553 req-0ddc057a-d06e-440e-975a-41bce7ae29e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177164 Aug 30 17:31:19.716464 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 629/1337] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:19.754906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-plugged", "status": "completed", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:19.797306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.798938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.799380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.824458 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] Creating event network-vif-plugged:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:31:19.862439 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4c2febc1-e590-4817-8120-dbbdf915bf01 req-1c80cbcd-9dd4-4b2e-bebe-dc92316bb508 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138551 Aug 30 17:31:19.867679 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 630/1338] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:19.880225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:19.880848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:19.899974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.901191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.901819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.902798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:19.903572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:19.904203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:19.916579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:20.200395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:20.216704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfb50d73-9869-467a-8265-71a1351b7f55 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.750808 Aug 30 17:31:20.219727 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 709/1339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:19 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:20.240184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:20.241883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:20.254621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.255526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.256196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.258046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.258755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.259405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.517357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:20.528864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c744c066-4096-44bc-bfb2-89f0b3c2ad3c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.659852 Aug 30 17:31:20.540812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 631/1340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:19 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:20.540812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:20.540812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:20.558558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.559038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.559461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.560208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.560651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.561066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.837947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:20.846610 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6c1be62-ae76-4016-9b1c-7a5916bfb524 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1313 microversion: 2.1 time: 0.621556 Aug 30 17:31:20.852887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 710/1341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:20 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:20.867590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:20.867590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:20.894153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.896263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.897449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.900453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:20.901122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:20.903711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:20.951394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:20.965173 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-719306e9-197e-4e02-8080-7ef8261d90a3 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 200 len: 1478 microversion: 2.1 time: 0.429858 Aug 30 17:31:20.965767 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 632/1342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:20 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 1478 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:20.989929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-706936956"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:21.003497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:21.025139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.025139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.025578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.026280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.026725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.027144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.458882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3af2c171-59eb-4905-b076-e185cf5b6a80 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664/action" status: 202 len: 0 microversion: 2.1 time: 0.459220 Aug 30 17:31:21.459992 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 633/1343] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:20 2022] POST /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:31:21.468523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:21.469235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:21.489578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.489970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.490410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.491121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.491597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.492246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.506840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:21.548662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:21.554287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:21.562304 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f0b0596-9425-4459-a37a-597c2ebd613c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.704293 Aug 30 17:31:21.564721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 711/1344] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:20 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:21.578872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-61253322-34a4-4c69-80b7-7d28674686a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98983280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:21.595696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:21.641652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:21.668480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-61253322-34a4-4c69-80b7-7d28674686a2 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.101479 Aug 30 17:31:21.675954 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 712/1345] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:21 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:21.685763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:21.687916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:21.699104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.706780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.707578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.710518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:21.711184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:21.711837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:21.768280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:21.941081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:21.960640 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a477a27-3785-41db-a90b-ad6a136b3bd3 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.499179 Aug 30 17:31:21.965883 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 634/1346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:21 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:21.973120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:21.984809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:21.998505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.002700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.003531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.004729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.008172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.009210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.397202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:22.411285 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35968640-a32f-4be5-bdc6-2c5ece6a25cd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.740638 Aug 30 17:31:22.411908 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 713/1347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:21 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:22.439877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2f303c-c54d-4932-bf97-de42b5d5bd41", "name": "network-vif-plugged", "status": "completed", "tag": "c37faeb8-2d36-4136-9715-a28dc7c62936"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:22.448928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:22.465127 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cbfe5f68-8826-4078-ac65-e0f57f570c58 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1461 microversion: 2.1 time: 0.496887 Aug 30 17:31:22.468116 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 635/1348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:21 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1461 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:22.471899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.472931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.474971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.492903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:22.493826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:22.504928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.507163 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] Creating event network-vif-plugged:c37faeb8-2d36-4136-9715-a28dc7c62936 for instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 on n-h2-852771-11 Aug 30 17:31:22.507533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.508213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.510006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.512695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.513228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.523993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d28bcee8-6301-4295-862d-1cecfd4bfe3f req-d5526ac1-3e12-4c46-a302-dd8f221dd69d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108849 Aug 30 17:31:22.525213 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 714/1349] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:22.596402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:22.597151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:22.617031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.617521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.618095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.618817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:22.619280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:22.626483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:22.691818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:22.971528 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb3cd598-5d11-4d54-95a9-ab16ae20d26b tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1614 microversion: 2.1 time: 0.482733 Aug 30 17:31:22.973349 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 636/1350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:22 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1614 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:22.988904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c819c0f-6666-4b97-bca2-0248b129d4b9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc6eca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:23.106859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:23.140075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:23.144218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c819c0f-6666-4b97-bca2-0248b129d4b9 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.165828 Aug 30 17:31:23.145187 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 637/1351] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:22 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:23.153123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:23.153312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:23.154312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:23.154433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2423c636-e127-4c22-a6cd-3c12ac99db1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1361 microversion: 2.25 time: 0.566089 Aug 30 17:31:23.156853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 715/1352] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:22 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1361 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:31:23.163731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:23.164565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:23.190619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.193140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.194029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.196686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.201483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.202360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.202948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.206106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.206548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.211616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.212166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.215653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.388117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '43cf6f2d2713464d8d47151e01e3f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eac69eb4d6248dca7cd2e4b5eda6894', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:23.388861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] flavor_id is None. Assuming migration. {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 17:31:23.389322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 17:31:23.680602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:23.693811 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c61510e-6acc-4966-8547-e3930c6f87d9 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.546516 Aug 30 17:31:23.695909 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 638/1353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:23 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:23.711375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:23.712145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:23.735471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.740228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.740872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.741764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:23.742444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:23.743038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:23.822947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:31:24.037756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26a09699-4ba3-4168-a591-67cbc636867a tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 204 len: 0 microversion: 2.1 time: 0.319221 Aug 30 17:31:24.039439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 639/1354] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:31:23 2022] DELETE /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:31:24.045929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.047110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:24.055431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.056361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.057005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.057923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.058583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.059211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.146890 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8c240647-f48e-4077-8f9b-b53ef78df4bf tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6/action" status: 202 len: 0 microversion: 2.1 time: 0.987716 Aug 30 17:31:24.150458 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 716/1355] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:23 2022] POST /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:24.164810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.164926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:24.179859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.180367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.180872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.181531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.181981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.182412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.490726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:24.503377 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4afc96d3-e4bf-43d6-a2f5-fef621d9a200 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.462452 Aug 30 17:31:24.506163 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 640/1356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:24.519363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.520830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:24.531445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.532305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.532983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.533910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.534718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.535556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.810141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:24.819006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:24.822632 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2619c5d3-6bf8-4146-bea5-c5c6ca71698b tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1682 microversion: 2.1 time: 0.669755 Aug 30 17:31:24.835507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 717/1357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1682 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:24.835887 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1ad9d40-e588-4b20-8361-c1ce0527a0ef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1470 microversion: 2.1 time: 0.321379 Aug 30 17:31:24.835887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 641/1358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:24.839138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.840291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:24.850899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58c8a560-e876-44aa-a6e8-24d2d99d81d1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98983820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.870656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.871097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.871578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.872342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.872782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.873209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.924006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58c8a560-e876-44aa-a6e8-24d2d99d81d1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.097654 Aug 30 17:31:24.924740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 718/1359] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:24.939228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:24.940061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:24.957002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.957820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.958373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:24.959241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:24.960862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:24.962216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:25.164605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:25.177833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:25.179287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:25.181170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-347a49a2-2b22-4509-8f36-fed50f5f5257 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1556 microversion: 2.25 time: 0.346290 Aug 30 17:31:25.185094 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 642/1360] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1556 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:25.304109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-371926760", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "5cbe98ac-21be-43d9-bb02-1945a3517c1d"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:25.312143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:25.321350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce6e04ba-2543-4a85-a8ac-4411a76ba383 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.388909 Aug 30 17:31:25.323818 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 719/1361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:24 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:25.425893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] validate_networks() for [('5cbe98ac-21be-43d9-bb02-1945a3517c1d', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:31:25.630361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:25.631141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:25.644406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:25.652699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:25.660110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:25.661019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:25.668100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:25.670932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:25.984698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c2f303c-c54d-4932-bf97-de42b5d5bd41 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:26.156555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bbaa3537-4666-4beb-84a8-70f1d13da293 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 2050 microversion: 2.25 time: 0.829724 Aug 30 17:31:26.159088 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 720/1362] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:25 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 2050 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:26.164621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1317528-acd4-4a58-9780-79a5d0d92664", "name": "network-vif-plugged", "status": "completed", "tag": "67c0fad2-56c7-47e5-8499-3ba4325fe61e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:26.196930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:26.198657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:26.199402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:26.220135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] Creating event network-vif-plugged:67c0fad2-56c7-47e5-8499-3ba4325fe61e for instance b1317528-acd4-4a58-9780-79a5d0d92664 on n-h1-852771-11 Aug 30 17:31:26.226570 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1f903e8d-bac7-476b-ba05-b3b91da7d82a req-a2e185c3-a070-49a9-9857-96872ef8d2ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065869 Aug 30 17:31:26.227433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 721/1363] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:26.234211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:26.234918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:26.243641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:26.245574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:26.246558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:26.253162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:26.254003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:26.254708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:26.748070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:26.763647 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7cd66476-e9d3-4012-8183-24d8efe6cb06 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.534328 Aug 30 17:31:26.772602 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 722/1364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:26 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:26.789242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:26.792722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:26.827212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:26.828363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:26.832899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:26.838045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:26.839624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:26.841385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.162165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:31:27.162728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:31:27.163060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:31:27.163471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:31:27.163910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:31:27.182893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.184678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.185157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.186123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.186510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.196237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.233551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:31:27.244063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for user dadf1246d7264e3ba4f840a27b1f4aad and project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:31:27.278924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:27.302028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:31:27.311185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:31:27.431335 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4bf3baac-90b6-4da3-937a-be6ff8b895fc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.244757 Aug 30 17:31:27.435570 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 643/1365] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:31:27.448520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:27.449626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:27.468273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.469044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.470248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.473987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.474864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.478014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.653897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:27.665957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9842fd2-fb72-43cc-b965-5fe38f28aa16 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1682 microversion: 2.1 time: 0.891857 Aug 30 17:31:27.666566 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 723/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:26 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1682 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:27.671647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04205657-e270-4b21-9155-3ce85d1e48b7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98aa9160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:27.761034 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04205657-e270-4b21-9155-3ce85d1e48b7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.093231 Aug 30 17:31:27.761641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 724/1367] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:27 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:27.774190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:27.783939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:27.794329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:27.796868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.797370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.798457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.799189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.799737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.800065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.808123 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-309dadf3-275d-4d44-91ad-03e19abfd6a8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1470 microversion: 2.1 time: 0.370326 Aug 30 17:31:27.824644 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 644/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:27 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:27.831458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:27.832363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:27.841396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.842170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.842769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:27.844846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:27.845668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:27.846269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.075015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c2f303c-c54d-4932-bf97-de42b5d5bd41 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:28.146820 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a2be9d9-2bb8-4e72-933c-cebe2a6b4ed2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 2050 microversion: 2.25 time: 0.383536 Aug 30 17:31:28.153564 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 725/1369] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:27 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 2050 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:28.176923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0736a7d8-ce1c-45a2-9ab5-6e2264f69f00 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:28.179959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0736a7d8-ce1c-45a2-9ab5-6e2264f69f00 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:28.329403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:28.344212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e8d8fdd2-fbdd-49e6-88db-ac8b94fe26c2 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.516672 Aug 30 17:31:28.346351 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 645/1370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:27 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:28.371769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:28.376448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:28.392431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.394052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.394761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.399694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.401556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.402861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.440035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:28.502178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0736a7d8-ce1c-45a2-9ab5-6e2264f69f00 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:28.531370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0736a7d8-ce1c-45a2-9ab5-6e2264f69f00 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1217 microversion: 2.1 time: 0.375999 Aug 30 17:31:28.534219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 726/1371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:28 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1217 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:28.542851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:28.558164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.563230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.564169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.565300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.565960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.567162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.632279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08ad7821-0374-411f-8991-46f44f9171d1 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.096680 Aug 30 17:31:28.639649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 727/1372] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 30 17:31:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:31:28.655228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": "auto"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:28.659655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:28.668951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.670189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.671450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.672412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:28.673097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:28.673696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:28.741416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'flavor' on Instance uuid 6c2f303c-c54d-4932-bf97-de42b5d5bd41 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:28.776718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Going to try to live migrate instance to n-h1-852771-11 {{(pid=122124) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:31:29.144535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:29.159935 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e06b4923-646d-495c-9807-bc7ed50d418c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.811330 Aug 30 17:31:29.163019 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 646/1373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:28 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:29.171879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:29.179331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:29.205698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:29.206480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:29.207109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:29.208393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:29.209674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:29.213861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:29.649214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b6b57b6b94a74ba11d34d1b84f529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af706e5f574c11b8ee4691053b836d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:29.666524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f334e629-b006-4a04-a118-6831b74b38cf tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 200 len: 1614 microversion: 2.1 time: 0.496013 Aug 30 17:31:29.669140 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 647/1374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:29 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 1614 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:29.689204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b70c5176-29c0-4793-bc15-589729fb15ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cb6fd30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:29.885062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b70c5176-29c0-4793-bc15-589729fb15ba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.207466 Aug 30 17:31:29.887786 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 648/1375] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:29 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:29.908239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:29.909257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:29.945142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:29.949637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:29.950301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:29.957191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:29.959999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:29.960633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:30.790996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:30.814537 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2fb94bc-c280-4409-8726-b148a60def3b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1470 microversion: 2.1 time: 0.924272 Aug 30 17:31:30.820314 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 649/1376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:29 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1470 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:30.835810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:30.840619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:30.855103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:30.855905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:30.870128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:30.871890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:30.874504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:30.875165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:31.631093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:31.642359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6dc84b6-6953-4933-8508-acaacce7e142 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.817430 Aug 30 17:31:31.657921 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 650/1377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:30 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:31.665505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d", "name": "network-vif-deleted", "tag": "d91a0cb9-3531-4beb-8356-4f5fbf5225be"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:31.689261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:31.689728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:31.690150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:31.738588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] Creating event network-vif-deleted:d91a0cb9-3531-4beb-8356-4f5fbf5225be for instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d on n-h1-852771-11 Aug 30 17:31:31.745299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7df269c9-c0fb-4ca4-bfa7-fbc86dd82349 req-1eb49316-83a3-4e96-aed5-89c6e907d0ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086035 Aug 30 17:31:31.748536 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 651/1378] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:31.759717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:31.762743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:31.769783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:31.770519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:31.771148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:31.772061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:31.772667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:31.773246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:31.970123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:31.984687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adbbcac8-8510-4779-92ba-79ebacd40424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1275 microversion: 2.1 time: 0.234899 Aug 30 17:31:32.001072 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 652/1379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:31 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1275 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:32.013103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.014221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:32.038105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.038851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.039639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.040575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.041259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.042684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.181812 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b84058d1-6098-468f-88d5-c2c179170041 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41/action" status: 202 len: 0 microversion: 2.25 time: 3.539003 Aug 30 17:31:32.182615 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 728/1380] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:31:28 2022] POST /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41/action => generated 0 bytes in 3541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:31:32.192044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba5c0d0-bb43-4408-b3d9-a2539324b17a", "name": "network-vif-plugged", "status": "completed", "tag": "5e02187b-a601-44e4-844b-4af910af5599"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:32.210838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.211760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.212596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.237997 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] Creating event network-vif-plugged:5e02187b-a601-44e4-844b-4af910af5599 for instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a on n-h2-852771-11 Aug 30 17:31:32.251900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7c76163f-2dbc-46af-b575-517e25ee51b8 req-e84cc390-9d78-4d22-a0de-1b4e1550001b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062736 Aug 30 17:31:32.253557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 729/1381] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:32.260701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.276186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] [instance: d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:32.291231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.294708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.295555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.298876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.299748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.300416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.335895 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] HTTP exception thrown: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Request method failure captured: Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d HTTP/1.1 Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkixBI72uCx4wJ4_gprvpqDIbelo1CHi7r03KYxaAx_dDLZmy8kTsWhXtQDHpw0e1csnsI3zo7PlugiD5JAKzcLwKhOmnQ-VAta48jcLAr0yzttcbnMrFCh0TZjC9GwwqCDzx8xq6z8roe1Gxp0ZU9-xWVmgrIi4Vtx397Bc5RAku0U Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c7af706e5f574c11b8ee4691053b836d Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:32.342072 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c7af706e5f574c11b8ee4691053b836d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c7af706e5f574c11b8ee4691053b836d"}]}] Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c7af706e5f574c11b8ee4691053b836d Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1168327257 Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesAdminNegativeTest-1168327257-project Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 613b6b57b6b94a74ba11d34d1b84f529 Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesAdminNegativeTest-1168327257-project Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. Aug 30 17:31:32.343547 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'd5cdc1ca-74b9-4656-9fa4-c02f1d43b84d'} Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:32.345042 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. Aug 30 17:31:32.346539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:32.352745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Returning 404 to user: Instance d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:32.354938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1b0425c-e772-4bce-8418-33c99995554e tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d" status: 404 len: 111 microversion: 2.1 time: 0.100051 Aug 30 17:31:32.357503 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 730/1382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/servers/d5cdc1ca-74b9-4656-9fa4-c02f1d43b84d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:31:32.369712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3840f893-f356-4543-b7b7-deb8994cdb9b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9a3b7b80>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.485949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3840f893-f356-4543-b7b7-deb8994cdb9b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.124079 Aug 30 17:31:32.488250 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 731/1383] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:32.498709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.500237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:32.514278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.515401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:32.516148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.517325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.520226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.520822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.522144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.530242 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed5277a7-4a81-4e8c-9606-ebb45ae89c0c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.527217 Aug 30 17:31:32.533269 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 653/1384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:32.545953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.547904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:32.558467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.559324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.559986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.561008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:32.561727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:32.562347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:32.866952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:32.879260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:32.882918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:32.884293 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4cbb54cf-7960-4445-a3a7-3d42b0d4adc7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.348790 Aug 30 17:31:32.910870 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 654/1385] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:32.917345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5be3a04e-a30e-43a9-8d79-facf2591b4e3 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] Calling method '.version_select at 0x7f2d9cb6f670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:32.993660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5be3a04e-a30e-43a9-8d79-facf2591b4e3 tempest-VolumesAdminNegativeTest-1168327257 tempest-VolumesAdminNegativeTest-1168327257-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188296336" status: 202 len: 0 microversion: 2.1 time: 0.079472 Aug 30 17:31:32.995958 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 655/1386] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188296336 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:33.025702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:33.032144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:33.063683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.064325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.064782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.072097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.072596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.073035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.135684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:33.149982 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58b77b21-0857-4aeb-8273-fef9eb0eb262 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.660356 Aug 30 17:31:33.160134 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 732/1387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:33.172308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:33.179033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:33.195906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.199329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.201584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.202578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.204290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.209753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.216932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:33.308205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:33.322877 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0b1412fa-a989-40f7-a086-c425a4dd247e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1332 microversion: 2.1 time: 0.320858 Aug 30 17:31:33.336743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 656/1388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:32 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:33.396018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:33.416283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc8883f1-6900-495b-867f-ea3dc5e82d89 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1275 microversion: 2.1 time: 0.242954 Aug 30 17:31:33.417820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 733/1389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:33 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:33.502577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27b754f3-66ba-4070-a87c-7e235559a1fe tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cb98f70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:33.554548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:33.555463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:33.570228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.572387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.573414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.576135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.589027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.589882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27b754f3-66ba-4070-a87c-7e235559a1fe tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.091880 Aug 30 17:31:33.591450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.598645 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 657/1390] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:33 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:33.764674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "name": "network-vif-unplugged", "status": "completed", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}, {"name": "network-changed", "server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:33.789672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.792531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.794856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.830199 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Creating event network-vif-unplugged:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h2-852771-11 Aug 30 17:31:33.833999 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] Creating event network-changed:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h2-852771-11 Aug 30 17:31:33.851138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ea5a8798-4693-45ee-bf45-504b54cebe6a req-cdf4fed2-660c-40e8-88ab-03481f8e7f16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.090273 Aug 30 17:31:33.851613 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 658/1391] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:31:33.918523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:33.919289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:33.934697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.935898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.938653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:33.939689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:33.940434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:33.941031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.167970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.179836 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45a090ca-2f76-4319-8b19-222211665e62 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.629025 Aug 30 17:31:34.184135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 734/1392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:33 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:34.203274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:34.205714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:34.206487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.223725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.224693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.225427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.226024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.226170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.227118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.227870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.228256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb4904b3-ab33-4acf-907e-3faa9dc9e815 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.318298 Aug 30 17:31:34.228548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.229462 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 659/1393] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:33 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:31:34.349546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:34.350447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:34.366567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.367048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.367567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.368281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.368721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.369133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.661281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.670338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b4d4f3d-05a1-4771-9f9a-bc73e257a335 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1536 microversion: 2.1 time: 0.324773 Aug 30 17:31:34.685080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 660/1394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:34 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1536 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:34.688275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:34.689161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:34.698422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.699746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.702880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.704787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:34.705429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:34.706033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:34.988671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:34.997983 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-255dc61d-2f63-4de6-85ae-e4c0b3e11a1d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.323518 Aug 30 17:31:35.011808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 661/1395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:34 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:35.019293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7237cda-df1f-4151-8193-57f0f2668766 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc699d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:35.064509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:35.077345 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d136775-657d-4a2a-bab8-ddbe8bf32d85 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.880261 Aug 30 17:31:35.090862 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 735/1396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:34 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:35.090862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01fd4843-92ad-4b18-8476-7900dad81b84 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'create', calling method: .version_select at 0x7f2d98983f70>, body: {"pool": "9d91e91d-ceae-4a13-8796-14f36688b03f"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:35.092991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7237cda-df1f-4151-8193-57f0f2668766 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.075635 Aug 30 17:31:35.107255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 662/1397] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:35 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:35.209210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:35.210997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:35.270943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:35.271486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:35.271947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:35.280395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:35.282250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:35.283720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:35.873914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:35.886011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d64b0da2-90b7-4d0d-99b2-c11b8ce0bcf5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.681282 Aug 30 17:31:35.887565 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 663/1398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:35 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:35.894066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:35.899725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:35.909315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:35.910089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:35.910997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:35.912346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:35.913295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:35.914678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:36.324092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:36.336824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:36.338685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:36.340882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b39045b-3fd1-4396-ac34-22c668b4ada5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.451962 Aug 30 17:31:36.371529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 664/1399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:35 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:36.381874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:36.382883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:36.392265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:36.393990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:36.394606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:36.395731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:36.396351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:36.396938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:36.602793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:36.616963 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f00934b-8808-49b2-b36f-033bad77ca2b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.244155 Aug 30 17:31:36.618126 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 665/1400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:36 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:36.661602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:36.666725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:36.684603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:36.692214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:36.693033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:36.694098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:36.696185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:36.698123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:36.968619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:36.989156 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a84733a6-2d8b-4e7c-a8af-5886f6282926 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.368915 Aug 30 17:31:36.991249 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 666/1401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:36 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:37.017727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-694c6c86-b2c5-445e-9393-b96749514ca1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc5a790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:37.088754 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-694c6c86-b2c5-445e-9393-b96749514ca1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.090643 Aug 30 17:31:37.091628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 667/1402] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:36 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:37.097734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95a51d3-bee7-4607-9481-7572fbecb5f8", "tag": "5f484586-2596-4299-ae84-21ccd7390204"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:37.116906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.117533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.118072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.129840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] Creating event network-changed:5f484586-2596-4299-ae84-21ccd7390204 for instance f95a51d3-bee7-4607-9481-7572fbecb5f8 on n-h2-852771-11 Aug 30 17:31:37.136364 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-aed35861-e9aa-4f51-93bd-7acc76ae9a8f req-6767e954-25a2-416b-96d8-618c1a92b75d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042588 Aug 30 17:31:37.137099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 668/1403] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:37.142940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:37.144138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:37.150494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.151435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.152023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.152916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.153579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.154137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.216754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:37.277807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:37.364740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:37.373590 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3918b5cc-0ff3-44a2-98a4-0bcfc51ae3d8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.235271 Aug 30 17:31:37.374166 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 669/1404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:37 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:37.388525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:37.389490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:37.397360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.397926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.398421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.399197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.399742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.400230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.404987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:37.588083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:37.603246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:37.609110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:37.611135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-39e2cb02-879c-4735-924b-48611a8eb554 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.226386 Aug 30 17:31:37.612396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 670/1405] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:37 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:31:37.640944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:37.641750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:37.651230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.651986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.652824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.654055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:37.654631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:37.655216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:37.869910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:37.883007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04d31e3e-400f-48ab-aeb8-fab8384d231f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.247619 Aug 30 17:31:37.884701 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 671/1406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:37 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:38.014662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:38.015386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:38.037587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.039149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.039320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:38.040497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.041079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.041650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:38.412594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:38.429393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-641bef72-fb3b-41f1-a2db-a33f510af327 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.415883 Aug 30 17:31:38.431597 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 672/1407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:38 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:38.461350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fa59de1-507d-418b-97a3-7b817b355006 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc00670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:38.508318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:38.567117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fa59de1-507d-418b-97a3-7b817b355006 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.127169 Aug 30 17:31:38.567798 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 673/1408] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:38 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:38.581502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:38.582713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:38.592311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:38.599443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.601986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.605160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:38.606102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.615370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.616025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:38.913863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:38.929745 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1183f98-32a6-4ef1-9e30-4fd6e36489f9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.360659 Aug 30 17:31:38.930995 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 674/1409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:38 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:38.939183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:38.941577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:38.954438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.955330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.955797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:38.956909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:38.957425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:38.957849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.174781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:39.185603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:39.187607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:39.189920 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d844afcc-6189-4a95-8b77-154036f133dd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.257389 Aug 30 17:31:39.203513 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 675/1410] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:38 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:39.210961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:39.211490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:39.220682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.221678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.222124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.223506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.224134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.224708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.416215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:39.429495 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-39643687-426b-4805-aea3-deaf1fafbf5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.237496 Aug 30 17:31:39.450020 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 676/1411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:39 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:39.459669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01fd4843-92ad-4b18-8476-7900dad81b84 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.380266 Aug 30 17:31:39.467985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 736/1412] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:31:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:39.476279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:39.476898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:39.487037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.489438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.494019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.496483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.515145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.517735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.713006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b527ce0d-cfd6-4ac9-ac24-af63f4d0e9a6 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Calling method '.version_select at 0x7f2d9cc69a60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:39.749444 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b527ce0d-cfd6-4ac9-ac24-af63f4d0e9a6 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b527ce0d-cfd6-4ac9-ac24-af63f4d0e9a6 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605/metadata/os_distro HTTP/1.1 Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:31:39.758559 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'image_id': '7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605', 'id': 'os_distro'} Aug 30 17:31:39.760189 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:39.761130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605 Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:39.766167 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605 could not be found. Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:39.769529 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:31:39.772455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b527ce0d-cfd6-4ac9-ac24-af63f4d0e9a6 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:39.775643 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b527ce0d-cfd6-4ac9-ac24-af63f4d0e9a6 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "DELETE /compute/v2.1/images/7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.322210 Aug 30 17:31:39.775643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 677/1413] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 30 17:31:39 2022] DELETE /compute/v2.1/images/7dcfa0eb-d8bb-4036-bd76-1eb36a7cb605/metadata/os_distro => generated 62 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:39.775643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: .version_select at 0x7f2d9a6cc280>, body: {"addFloatingIp": {"address": "172.25.4.152"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:39.796424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:39.796424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.796424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.796424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.797546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:39.797546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:39.797546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:39.902786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:31:39.903290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquired lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:31:40.081717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:40.118317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b79b3875-0296-4d78-bf0a-4d336b990e00 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.624619 Aug 30 17:31:40.119650 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 737/1414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:39 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:40.141870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29160490-984f-4a79-8b95-f135f5e15dca tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98b1a310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:40.223991 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29160490-984f-4a79-8b95-f135f5e15dca tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.102912 Aug 30 17:31:40.233734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 738/1415] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:40 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:40.246827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dc11fa9-8ec1-43f0-b0a6-7e53fc4c60d8 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Calling method '.version_select at 0x7f2d989833a0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:40.311746 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1dc11fa9-8ec1-43f0-b0a6-7e53fc4c60d8 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dc11fa9-8ec1-43f0-b0a6-7e53fc4c60d8 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/images/d2765e4d-669f-46a5-b175-29a5d3f23a19/metadata/os_version HTTP/1.1 Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:40.315259 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'image_id': 'd2765e4d-669f-46a5-b175-29a5d3f23a19', 'id': 'os_version'} Aug 30 17:31:40.317554 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:40.318878 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d2765e4d-669f-46a5-b175-29a5d3f23a19 Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:40.320698 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d2765e4d-669f-46a5-b175-29a5d3f23a19 could not be found. Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:40.322654 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:40.329927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dc11fa9-8ec1-43f0-b0a6-7e53fc4c60d8 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:40.333979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1dc11fa9-8ec1-43f0-b0a6-7e53fc4c60d8 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "GET /compute/v2.1/images/d2765e4d-669f-46a5-b175-29a5d3f23a19/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.082319 Aug 30 17:31:40.333979 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 739/1416] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 30 17:31:40 2022] GET /compute/v2.1/images/d2765e4d-669f-46a5-b175-29a5d3f23a19/metadata/os_version => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:40.333979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:40.333979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:40.349841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:40.353081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:40.353544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:40.354268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:40.357922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:40.358346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:40.875803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:40.887118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6bbfadfa-2d86-4c67-ba0d-e7b28edb9ba8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.562164 Aug 30 17:31:40.887947 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 740/1417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:40 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:40.906829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:40.907351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:40.913612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:40.914100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:40.914529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:40.915223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:40.928291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:40.928994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:41.680319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:41.696894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:41.706242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:41.712042 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c9fa3f0-c22d-4d3b-a821-c3ace9470e22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.807468 Aug 30 17:31:41.717422 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 741/1418] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:40 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:41.745761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02f76e06-0f2d-496a-832b-fc49a7b7bc1f tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Calling method '.version_select at 0x7f2d98b33ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:41.797047 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-02f76e06-0f2d-496a-832b-fc49a7b7bc1f tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02f76e06-0f2d-496a-832b-fc49a7b7bc1f tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/images/12446d30-bbe7-4712-80f2-fc72d673f3e5/metadata HTTP/1.1 Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:41.801359 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'image_id': '12446d30-bbe7-4712-80f2-fc72d673f3e5'} Aug 30 17:31:41.803168 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:41.804208 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 12446d30-bbe7-4712-80f2-fc72d673f3e5 Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:41.805653 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12446d30-bbe7-4712-80f2-fc72d673f3e5 could not be found. Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:41.807221 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:41.810973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:41.816690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02f76e06-0f2d-496a-832b-fc49a7b7bc1f tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:41.817606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02f76e06-0f2d-496a-832b-fc49a7b7bc1f tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "GET /compute/v2.1/images/12446d30-bbe7-4712-80f2-fc72d673f3e5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.093671 Aug 30 17:31:41.825267 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 742/1419] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:31:41 2022] GET /compute/v2.1/images/12446d30-bbe7-4712-80f2-fc72d673f3e5/metadata => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:41.847362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:41.854114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:41.876343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:41.877042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:41.877208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:41.884069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:41.884815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:41.885875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:41.919336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Building network info cache for instance {{(pid=122123) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:31:42.782340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Updating instance_info_cache with network_info: [{"id": "5e02187b-a601-44e4-844b-4af910af5599", "address": "fa:16:3e:b8:75:a0", "network": {"id": "277b9d29-1f5b-4c95-b7ac-de9596b8c54f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1312264503-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9ee730c6f9c4871bf4500f33d22270a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e02187b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:31:42.798968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Releasing lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:31:42.800485 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14054c30-599c-4e02-82cd-8d7e9b43a11e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 202 len: 0 microversion: 2.1 time: 3.031274 Aug 30 17:31:42.802373 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 678/1420] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:39 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 0 bytes in 3035 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:31:42.823830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:42.824774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:42.835502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:42.836869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:42.837533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:42.838466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:42.839789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:42.840823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:42.846624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:42.866322 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b392ab1a-b9f9-4c52-91c1-ea3fb0847298 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 1.037172 Aug 30 17:31:42.875440 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 743/1421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:41 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:42.881515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7bbc1c89-1ebc-4be8-80f6-d2451c401e19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d989831f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:43.006373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7bbc1c89-1ebc-4be8-80f6-d2451c401e19 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.129309 Aug 30 17:31:43.022673 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 744/1422] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:42 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:43.035434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4be6d957-1f29-4e2e-b278-a9251501c5ed tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Action: 'update_all', calling method: .version_select at 0x7f2d98b7f820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:43.093334 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4be6d957-1f29-4e2e-b278-a9251501c5ed tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4be6d957-1f29-4e2e-b278-a9251501c5ed tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/images/4eec2a35-92e5-4ec3-9eed-588275febfe5/metadata HTTP/1.1 Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 57 Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:43.096352 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:43.098011 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'image_id': '4eec2a35-92e5-4ec3-9eed-588275febfe5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:43.099076 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4eec2a35-92e5-4ec3-9eed-588275febfe5 Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:43.100468 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4eec2a35-92e5-4ec3-9eed-588275febfe5 could not be found. Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:43.101890 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:43.103437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:43.108448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4be6d957-1f29-4e2e-b278-a9251501c5ed tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:43.111820 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4be6d957-1f29-4e2e-b278-a9251501c5ed tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "PUT /compute/v2.1/images/4eec2a35-92e5-4ec3-9eed-588275febfe5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.087815 Aug 30 17:31:43.112876 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 745/1423] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:31:43 2022] PUT /compute/v2.1/images/4eec2a35-92e5-4ec3-9eed-588275febfe5/metadata => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:43.126094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:43.127630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:43.135216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=89 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:43.138588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:43.139334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:43.140090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:43.141030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:43.141648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:43.142232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:43.236659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:43.245697 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ba685bc6-0a46-4931-ace6-2f6d4463b904 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.440651 Aug 30 17:31:43.283722 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 679/1424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:42 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:43.289156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba5c0d0-bb43-4408-b3d9-a2539324b17a", "tag": "5e02187b-a601-44e4-844b-4af910af5599"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:43.313349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:43.314263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:43.318829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:43.345942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] Creating event network-changed:5e02187b-a601-44e4-844b-4af910af5599 for instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a on n-h2-852771-11 Aug 30 17:31:43.353679 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d2c592f7-5f1b-482c-b71a-9b3ef8bbca74 req-80a884d7-b4a1-4e82-ba3e-bdd08084b71e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067339 Aug 30 17:31:43.354929 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 680/1425] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:43.385134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:43.386729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:43.399350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:43.400457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:43.401262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:43.402200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:43.402853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:43.403510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:43.690567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:43.709686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:43.713405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:43.714828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-01d55f03-e3ac-4a9a-8fce-0697abac504d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.356909 Aug 30 17:31:43.722218 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 681/1426] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:43 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:43.734628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-073ccc39-80b0-4673-b701-7b2987c36b30 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'create', calling method: .version_select at 0x7f2d987b5430>, body: {"pool": "9d91e91d-ceae-4a13-8796-14f36688b03f"} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:44.320415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:44.332136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ccea559c-0b8b-4172-8719-4dafabc5729d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 1.218012 Aug 30 17:31:44.347258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 746/1427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:43 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:44.359522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40041f78-c3bd-4251-8e80-ae29630b76d1 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Action: 'update', calling method: .version_select at 0x7f2d98f318b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:44.400748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-40041f78-c3bd-4251-8e80-ae29630b76d1 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40041f78-c3bd-4251-8e80-ae29630b76d1 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/images/506c5370-d03c-4d31-b9b0-11d669147c09/metadata/os_distro HTTP/1.1 Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 30 Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:44.404111 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: {"meta": {"os_distro": "alt"}} Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:31:44.405787 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'image_id': '506c5370-d03c-4d31-b9b0-11d669147c09', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:44.407627 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 506c5370-d03c-4d31-b9b0-11d669147c09 Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:44.408992 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 506c5370-d03c-4d31-b9b0-11d669147c09 could not be found. Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:44.414146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:44.417551 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.433819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40041f78-c3bd-4251-8e80-ae29630b76d1 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:44.437979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-40041f78-c3bd-4251-8e80-ae29630b76d1 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "PUT /compute/v2.1/images/506c5370-d03c-4d31-b9b0-11d669147c09/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.088653 Aug 30 17:31:44.444091 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 747/1428] 10.222.0.50 () {60 vars in 1310 bytes} [Tue Aug 30 17:31:44 2022] PUT /compute/v2.1/images/506c5370-d03c-4d31-b9b0-11d669147c09/metadata/os_distro => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:44.457986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:44.459576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:44.467753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:44.468661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:44.469490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:44.470731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:44.471385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:44.472034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:44.654797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:44.665150 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9860ad83-61c9-4abc-a9ce-7a13804e9aa3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.216355 Aug 30 17:31:44.684402 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 748/1429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:44 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:44.690249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-878f0e38-c7c3-4d39-bd03-ce9d7242afa5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98b7ff70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:44.751890 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-878f0e38-c7c3-4d39-bd03-ce9d7242afa5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.066206 Aug 30 17:31:44.752760 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 749/1430] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:44 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:44.758133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:44.759041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:44.769685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:44.770557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:44.771224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:44.772306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:44.773057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:44.773714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:44.936983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:44.947469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16e9c4a5-023c-4170-a453-5228c4ee9e9f tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.193141 Aug 30 17:31:44.948288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 750/1431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:44 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:44.953301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b01be33d-b8b5-40c4-97db-6786e0914c89 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Action: 'create', calling method: .version_select at 0x7f2d98b7f9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:44.977763 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b01be33d-b8b5-40c4-97db-6786e0914c89 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] HTTP exception thrown: Image not found. Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b01be33d-b8b5-40c4-97db-6786e0914c89 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Request method failure captured: Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/images/ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05/metadata HTTP/1.1 Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 57 Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkl7UVM1A7wUdCx_qxCmepR9pgf6MUBeDWzewOw1M3gjEuj7PYxT3cb87vZjT8w_S-0DWvbLzV-bhbSSmiFiHggjnTgv7Ek0hFskSQfxdU5HRblvFN2NWYlg0I_u-lLi2hhBUAlJw3S3zRqTDR3Fz3ai1R6iKHGs7ldC-3mDlHwJllk Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:44.983192 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aac31236a06b4499bf9833dfe1654dcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aac31236a06b4499bf9833dfe1654dcd"}]}] Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: aac31236a06b4499bf9833dfe1654dcd Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548 Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 21f79f914a724885a4cf0a4ecdb35c07 Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1729506548-project Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:31:44.985501 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'image_id': 'ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:44.986431 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05 Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:31:44.987864 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05 could not be found. Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:44.989036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:31:44.991769 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:44.994668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b01be33d-b8b5-40c4-97db-6786e0914c89 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:44.995595 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b01be33d-b8b5-40c4-97db-6786e0914c89 tempest-ImagesMetadataNegativeTestJSON-1729506548 tempest-ImagesMetadataNegativeTestJSON-1729506548-project] 10.222.0.50 "POST /compute/v2.1/images/ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046376 Aug 30 17:31:45.001592 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 751/1432] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 30 17:31:44 2022] POST /compute/v2.1/images/ebb48e9d-cab3-4ccb-8b26-78b72cdf3b05/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:31:45.001592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:45.001825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:45.012694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.013671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.014656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:45.015798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.016394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.016722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:45.232358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:45.247211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:45.248730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:45.249961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80582d3e-bb24-49a0-8be0-91256e141f54 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.252459 Aug 30 17:31:45.250520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 752/1433] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:44 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:45.355073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:45.355737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:45.363930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.364745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.365532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:45.366641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.367336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.368042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:45.556341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:45.566960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8aa1b126-485f-4931-84b2-d9930dfbd4cb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.215451 Aug 30 17:31:45.567991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 753/1434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:45 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:31:45.694049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:45.695005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:45.707285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.707847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.708286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:45.709098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:45.710220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:45.710664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:46.194593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:46.206724 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa15539a-acc7-4614-a2db-076ceb0f926a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.514635 Aug 30 17:31:46.209163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 754/1435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:45 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:46.215096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c56fb12-59ad-432f-a162-37774ca0f301 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98ebec10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:46.341224 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c56fb12-59ad-432f-a162-37774ca0f301 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1439 microversion: 2.1 time: 0.130669 Aug 30 17:31:46.342567 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 755/1436] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:46 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:46.365826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95a51d3-bee7-4607-9481-7572fbecb5f8", "name": "network-vif-plugged", "status": "completed", "tag": "5f484586-2596-4299-ae84-21ccd7390204"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:46.423321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:46.424608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:46.425271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:46.447002 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] Creating event network-vif-plugged:5f484586-2596-4299-ae84-21ccd7390204 for instance f95a51d3-bee7-4607-9481-7572fbecb5f8 on n-h2-852771-11 Aug 30 17:31:46.466755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f6194917-4939-4668-940e-bed30c44bb0b req-1a45b5de-1c8b-404f-b182-8bfe6322b773 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122754 Aug 30 17:31:46.468056 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 756/1437] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:46.494302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:46.496672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:46.533802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:46.534619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:46.535248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:46.537238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:46.537966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:46.545464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.029565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:47.044889 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-defacd34-eb26-472c-a2a6-d6b292d65bb8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1475 microversion: 2.1 time: 0.559622 Aug 30 17:31:47.068978 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 757/1438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:46 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:47.076106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:47.077906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:47.090320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.091333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.092079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.093767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.094672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.096220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.482301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:47.496992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:47.498436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:47.500272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4481d51d-cceb-418a-bcce-093fcea6599b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.429024 Aug 30 17:31:47.501527 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 758/1439] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:47 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:47.509784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:47.510454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:47.536802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.537306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.537746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.538456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.539120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.539326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.925397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:47.939564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f044420-0e1c-449b-87a2-3f47bd3ff183 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1718 microversion: 2.1 time: 0.433238 Aug 30 17:31:47.957838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 759/1440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:47 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:47.969634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:47.970755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:47.978395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.978798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.979431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:47.980235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:47.981127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:47.981682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.033206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:48.056484 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-073ccc39-80b0-4673-b701-7b2987c36b30 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.331922 Aug 30 17:31:48.057758 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 682/1441] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:31:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:48.064798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8726a8a4-6d55-4ce3-b18d-88c1a0ca39a1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98775af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:48.120726 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8726a8a4-6d55-4ce3-b18d-88c1a0ca39a1 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1448 microversion: 2.1 time: 0.061431 Aug 30 17:31:48.121724 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 683/1442] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:48 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1448 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:48.129024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:48.129933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:48.137025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.137553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.138289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.139175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.139672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.141024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.375547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:48.388568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9454b43-9288-411b-8363-2b1cc3b51962 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1317 microversion: 2.1 time: 0.424733 Aug 30 17:31:48.389420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 760/1443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:47 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:48.411747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: .version_select at 0x7f2d9a6cb040>, body: {"addFloatingIp": {"address": "172.25.4.228"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:48.415209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:48.441416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.442335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.443706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.445882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.446988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.447908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.531431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:31:48.532703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquired lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:31:48.602658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:48.614513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db591700-1a00-42b0-bec5-0bf12ff277c1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1474 microversion: 2.1 time: 0.491298 Aug 30 17:31:48.615132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 684/1444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:48 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:48.620208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-166d8491-cde0-434c-84fa-724fd24aaf68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d987b5dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:48.669042 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-166d8491-cde0-434c-84fa-724fd24aaf68 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 200 len: 1448 microversion: 2.1 time: 0.052594 Aug 30 17:31:48.669891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 685/1445] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:31:48 2022] GET /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 1448 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:48.675059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:48.676064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:48.682883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.683362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.683856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:48.684622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:48.685052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:48.685496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:49.083295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:49.095554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:49.097097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:49.098542 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4253089d-74d3-485e-a147-cc4bdbb2cabf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.427228 Aug 30 17:31:49.100499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 686/1446] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:48 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:49.105685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1821125f-c51c-4a32-9cad-981f8ed3e5de tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9878df70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:49.319332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f.", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:31:49.320290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Releasing lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:31:49.320844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.320844 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Request method failure captured: Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action HTTP/1.1 Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 46 Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklbknXt8H9PI0oytpeNWPu0R0xW7ripkrelggzfm6lAb-cJts2oUA-pmtEi2D82pUT5A4uvMC89k2kKS3kHn0aIqErm86dHJR10_MxJO9C1Grpv-V0xMUuLGJ-irkKGzdldSQjStXhzIRSUrUPpFCdBwCZScDB__gzt_3TyUVQm0zU Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:31:49.325375 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e9ee730c6f9c4871bf4500f33d22270a"}]}] Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7e9432d2aef74db082bdeeb06b721703 Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: {"addFloatingIp": {"address": "172.25.4.228"}} Aug 30 17:31:49.326913 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4ba5c0d0-bb43-4408-b3d9-a2539324b17a', 'body': {'addFloatingIp': {'address': '172.25.4.228'}}} Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.328374 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:31:49.329649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.330832 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.332770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] Aug 30 17:31:49.334093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:31:49.340438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Returning 400 to user: Cannot associate floating IP 172.25.4.228 (27c3bf3a-8699-464b-a12d-69b0f2f4f276) with port 5e02187b-a601-44e4-844b-4af910af5599 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 9d91e91d-ceae-4a13-8796-14f36688b03f. Aug 30 17:31:49.340438 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-a4639fd8-5d62-41a7-ad25-dbd4a5f2a1ee'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:31:49.340438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-362b6a7f-2c47-4dcf-90c5-36f98aa55e93 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 400 len: 381 microversion: 2.1 time: 0.931474 Aug 30 17:31:49.345617 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 761/1447] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:48 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 381 bytes in 941 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:31:49.354477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-unplugged", "status": "completed", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:49.371271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:49.372317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:49.373057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:49.394393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Creating event network-vif-unplugged:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h2-852771-11 Aug 30 17:31:49.401678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:31:49.417855 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-257f30f2-c617-4945-9999-b7208e0354ec req-478bc1a9-45bb-4ae9-ab1e-56ae09ca31d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070325 Aug 30 17:31:49.418951 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 762/1448] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:49.427289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:49.428026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:49.437667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:49.439205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:49.440310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:49.441241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:49.442171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:49.442716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:49.899991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1821125f-c51c-4a32-9cad-981f8ed3e5de tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 204 len: 0 microversion: 2.1 time: 0.798058 Aug 30 17:31:49.900558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 687/1449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:49 2022] DELETE /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:31:49.905236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b12ea50-c588-4906-bc38-c88c3f396d7c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '.version_select at 0x7f2d9876fe50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:50.050478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:50.059147 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d33c5e14-bbdf-4f8d-ab82-3f76f07afec0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1708 microversion: 2.1 time: 0.638731 Aug 30 17:31:50.060113 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 763/1450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:49 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1708 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:50.065610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:50.066555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:50.072998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.074329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.074844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.076077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.076535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.076955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.300447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:50.310665 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b624509-8b15-4b0b-a617-6c7511e3e887 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1507 microversion: 2.1 time: 0.249315 Aug 30 17:31:50.316144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 764/1451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:50 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:50.331101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:50.332130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:50.357389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.361200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.361665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.363215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.364647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.365408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.775336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:50.788450 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89f38810-4985-447f-a78c-3fa14c645dd9 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1474 microversion: 2.1 time: 0.470306 Aug 30 17:31:50.789048 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 765/1452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:50 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1474 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:50.802999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:50.804012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:50.812656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.813563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.814160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.815272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:50.815861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:50.816514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:50.849597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:31:51.029071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9125af93-62a3-472b-84d4-a407dd44cc2a tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 204 len: 0 microversion: 2.1 time: 0.236838 Aug 30 17:31:51.030958 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 766/1453] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:31:50 2022] DELETE /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:31:51.045766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fdcf6f3e-229b-4137-b742-54ccab9467a2 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '.version_select at 0x7f2d98b7f9d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:51.050468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdcf6f3e-229b-4137-b742-54ccab9467a2 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.050963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdcf6f3e-229b-4137-b742-54ccab9467a2 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.051580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdcf6f3e-229b-4137-b742-54ccab9467a2 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.074398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fdcf6f3e-229b-4137-b742-54ccab9467a2 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 3160 microversion: 2.1 time: 0.041857 Aug 30 17:31:51.093995 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 767/1454] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:31:51 2022] GET /compute/v2.1/os-migrations => generated 3160 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:51.104509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:51.106728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:51.120225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.120721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.121202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.121834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.122293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.122729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.396105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:51.405355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:51.412932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:51.416081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4bd96f4b-bb7e-4b0c-8206-d69c45c20f48 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.320611 Aug 30 17:31:51.419716 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 768/1455] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:51 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:51.435298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:51.436193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:51.444232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.444882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.445870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.446949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.447650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.448656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.748149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:51.765621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce4aed86-4a9c-466c-9d89-ab24fc7cefca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1507 microversion: 2.1 time: 0.337707 Aug 30 17:31:51.789414 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 769/1456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:51 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:51.794624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:51.797438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:51.810192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.810887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.811550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.813317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:51.813943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:51.814682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:51.948604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b12ea50-c588-4906-bc38-c88c3f396d7c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/27c3bf3a-8699-464b-a12d-69b0f2f4f276" status: 202 len: 0 microversion: 2.1 time: 2.046978 Aug 30 17:31:51.949393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 688/1457] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:31:49 2022] DELETE /compute/v2.1/os-floating-ips/27c3bf3a-8699-464b-a12d-69b0f2f4f276 => generated 0 bytes in 2048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:51.958391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1875224422", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "761babee-31fe-4fa1-8591-541df7f3d7a0"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:52.042849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] validate_networks() for [('761babee-31fe-4fa1-8591-541df7f3d7a0', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:31:52.151180 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65364770-31c3-44c4-936e-bae27e5bcd8d tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1861 microversion: 2.1 time: 0.359941 Aug 30 17:31:52.158524 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 770/1458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:51 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1861 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:52.164427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:52.177765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.177946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.179012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.193249 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Creating event network-changed:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h2-852771-11 Aug 30 17:31:52.199129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:31:52.211176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4b8aebfa-536b-4dee-8241-60ccedd153ec req-19121cbe-5977-4aa3-a7b4-815ee7410d86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051189 Aug 30 17:31:52.212135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 771/1459] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:52.220420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1317528-acd4-4a58-9780-79a5d0d92664", "name": "network-vif-unplugged", "status": "completed", "tag": "67c0fad2-56c7-47e5-8499-3ba4325fe61e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:52.255553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.255553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.255962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.305964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] Creating event network-vif-unplugged:67c0fad2-56c7-47e5-8499-3ba4325fe61e for instance b1317528-acd4-4a58-9780-79a5d0d92664 on n-h1-852771-11 Aug 30 17:31:52.314918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a9200b86-f82d-445c-9244-aae573d5f4a7 req-91334780-f46f-4558-81f2-ad8aedfc5440 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101334 Aug 30 17:31:52.316194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 772/1460] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:52.324313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:52.343835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:52.365888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.366492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.367023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.368274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.368406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.368915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.551413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:31:52.551877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:31:52.552348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:31:52.552753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:31:52.553158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:31:52.622655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:52.637010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.637765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.638384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.639524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.640511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.641655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.675528 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c54f036-edfc-40fe-8cad-a7c528b3bb88 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "POST /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8/action" status: 202 len: 1109 microversion: 2.1 time: 0.357434 Aug 30 17:31:52.676299 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 773/1461] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:52 2022] POST /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8/action => generated 1109 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 17:31:52.694875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:52.695584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:52.706330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.706851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.707316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:52.708075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:52.708531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:52.708982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:53.123338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:53.135656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3486e7c1-b49f-4bce-8b8e-19afe7e28558 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1472 microversion: 2.1 time: 0.444887 Aug 30 17:31:53.147505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 774/1462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:52 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1472 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:53.153231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: .version_select at 0x7f2d9a6cb0d0>, body: {"removeFloatingIp": {"address": "172.25.4.152"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:53.590561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:53.597459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:53.597952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:53.598550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:53.599543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:53.602634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:53.603413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:53.973573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:31:53.974142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:31:53.974452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:31:53.974854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:31:53.975257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:31:53.995693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:53.996246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:53.996692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:53.997434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:53.997885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:54.002406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:54.035664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:31:54.042661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Getting quotas for user e9055e63b6e44751844a7274c1979566 and project 3c170887d97a48f7b66119c56f6ac547. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:31:54.063012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:31:54.066579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:31:54.129927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-695d06d6-1dcc-42de-ab9c-72dd585f4ae5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178216 Aug 30 17:31:54.131090 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 689/1463] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:31:54.141934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:54.142806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:54.153757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:54.157649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:54.158473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:54.159450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:54.160172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:54.161033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:54.867080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:31:54.867628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquired lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:31:55.146924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7b424825-7f36-41d2-a19b-1191da51eeea tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1861 microversion: 2.1 time: 1.013262 Aug 30 17:31:55.147877 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 690/1464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:54 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1861 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:55.152454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:55.159370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:55.187421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:55.188348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:55.193876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:55.195227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:55.198656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:55.199369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:55.707809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:55.723380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:55.726434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:55.727747 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29583fc9-1a06-47e6-8d4f-427e7a0aacf5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.578896 Aug 30 17:31:55.733112 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 691/1465] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:55 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:55.748569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:55.753243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:55.764368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:55.764901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:55.765345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:55.766064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:55.766524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:55.766964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:56.372815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:56.392578 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e65823cd-73c2-4787-8925-c30f8f3ef96e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.653958 Aug 30 17:31:56.409849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 692/1466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:55 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:56.419100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:56.420117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:56.427529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:56.428290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:56.432398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:56.435395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:56.435908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:56.437760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:56.556410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:56.566178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b55506ee-3ed1-462b-90cf-dffb3f172ed5 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1266 microversion: 2.1 time: 0.154183 Aug 30 17:31:56.566762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 693/1467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:56 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:56.581672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:56.584791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:56.592085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:56.616240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:56.618788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:56.620914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:56.622284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:56.625015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:56.627298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:56.689403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:57.202056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Building network info cache for instance {{(pid=122124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:31:57.212118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:31:57.540574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:57.552993 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6beaedd6-46b6-44d0-bed8-ddcb66b3f5c5 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1469 microversion: 2.1 time: 0.979102 Aug 30 17:31:57.553661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 694/1468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:56 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1469 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:57.575325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:57.577160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:57.585227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:57.587752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:57.590847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:57.591630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:57.592091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:57.592511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:57.797377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lazy-loading 'services' on Instance uuid 2afbaf50-34c4-41d7-9bca-5e8c16386de1 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:31:57.916642 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85275f3b-2abd-4b61-a996-c4d27599c2d0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments/066c2865-00c0-494d-bf0a-f7647db04977" status: 202 len: 0 microversion: 2.1 time: 0.361490 Aug 30 17:31:57.917883 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 695/1469] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:31:57 2022] DELETE /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments/066c2865-00c0-494d-bf0a-f7647db04977 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:57.941016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1317528-acd4-4a58-9780-79a5d0d92664", "name": "network-vif-deleted", "tag": "67c0fad2-56c7-47e5-8499-3ba4325fe61e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:57.958850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:57.960475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:57.961274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:58.010304 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] Creating event network-vif-deleted:67c0fad2-56c7-47e5-8499-3ba4325fe61e for instance b1317528-acd4-4a58-9780-79a5d0d92664 on n-h1-852771-11 Aug 30 17:31:58.029951 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3baea7f8-a13a-48ff-ae96-06dd5dcd22b5 req-a64b4136-37b2-4de5-9457-a806a861415d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110385 Aug 30 17:31:58.041132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 696/1470] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:58.055785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:58.057992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:58.078202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:58.078901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:58.080350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:58.086183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:58.087116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:58.093343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:58.508279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:58.519855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:58.528801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:58.529273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3837f021-d922-4806-b99a-e8fc483e8b74 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.486651 Aug 30 17:31:58.529854 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 697/1471] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:31:58 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:31:58.534897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2f303c-c54d-4932-bf97-de42b5d5bd41", "name": "network-vif-unplugged", "status": "completed", "tag": "c37faeb8-2d36-4136-9715-a28dc7c62936"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:58.558651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:58.559173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:58.559552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:58.587559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] Creating event network-vif-unplugged:c37faeb8-2d36-4136-9715-a28dc7c62936 for instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 on n-h2-852771-11 Aug 30 17:31:58.602216 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0c71e92b-ac35-4449-90bc-d2eaafcc9f0e req-9968a9bc-4496-4854-a602-2d1dda34a479 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070328 Aug 30 17:31:58.604394 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 698/1472] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:58.617061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:58.619185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:58.639052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:58.647830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:58.648644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:58.649561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:58.653052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:58.653804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.062012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:59.075321 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85b5c2cd-762f-43b1-b194-19f420a3710a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.469669 Aug 30 17:31:59.076167 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 699/1473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:58 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:59.090336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:59.096176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:59.120795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.128763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.130860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.143380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.144296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.144951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.299444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Updating instance_info_cache with network_info: [{"id": "5e02187b-a601-44e4-844b-4af910af5599", "address": "fa:16:3e:b8:75:a0", "network": {"id": "277b9d29-1f5b-4c95-b7ac-de9596b8c54f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1312264503-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9ee730c6f9c4871bf4500f33d22270a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e02187b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:31:59.321532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Releasing lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:31:59.323702 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec0f359b-369b-4024-80a4-4ae5c25ea034 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 202 len: 0 microversion: 2.1 time: 6.185024 Aug 30 17:31:59.327784 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 775/1474] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:53 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 0 bytes in 6190 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:31:59.340969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:59.367692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:59.379136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.380334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.381440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.383371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.386485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.387173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.444552 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2d730b5-9061-41f8-8bfa-b8155965a0c3 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "POST /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6/action" status: 202 len: 0 microversion: 2.1 time: 0.365709 Aug 30 17:31:59.445182 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 700/1475] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:31:59 2022] POST /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:31:59.465327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:59.469060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:59.485416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.486250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.486901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.488098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.489259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.492031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.570480 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-540481ca-aafe-486b-b039-d016141f687a tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121840 Aug 30 17:31:59.574965 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 701/1476] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:31:59 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:59.586892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-plugged", "status": "completed", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:31:59.607810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.614151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.614732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.641327 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Creating event network-vif-plugged:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h2-852771-11 Aug 30 17:31:59.654012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:31:59.673007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e9376eb6-d8ba-4396-9478-7f493f1ca2c5 req-35c3224e-b131-41fc-b2d1-4fb4263d8730 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096277 Aug 30 17:31:59.674337 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 702/1477] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:31:59.680329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2698efc1-32e6-4e67-bd64-ca5b0dcd35b4 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '.version_select at 0x7f2d986dc040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:59.903534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:31:59.920154 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8de2e108-c887-409a-9e6c-a584f876e86d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.589511 Aug 30 17:31:59.922233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 776/1478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:59 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:31:59.935371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:31:59.936931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:31:59.949049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.949558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.949976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:31:59.950687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:31:59.951134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:31:59.951586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:00.295393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:00.310366 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e5c4b1f1-ab51-4c04-a9da-c0beb413a4df tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.386803 Aug 30 17:32:00.311355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 777/1479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:31:59 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:00.325093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:00.327685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:00.339259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:00.340021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:00.342080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:00.344215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:00.345702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:00.350023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:00.874027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:00.888028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:00.892936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:00.895761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fee17b5a-94fc-4d7e-bd94-7708d0af595e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.582058 Aug 30 17:32:00.900189 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 778/1480] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:00 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:00.907922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:00.909390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:00.922318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:00.923332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:00.923995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:00.924927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:00.925819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:00.926533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.305538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:01.319298 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b18267f9-ab87-4d9f-90e2-28fbf8788c84 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.417420 Aug 30 17:32:01.320052 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 779/1481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:00 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:01.334282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80fcb56-50c0-4655-ba0e-998959d397bd", "tag": "5afc8d7d-1109-41f2-92f0-ba60c9adab58"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:01.362832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.363423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.363898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.386542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] Creating event network-changed:5afc8d7d-1109-41f2-92f0-ba60c9adab58 for instance c80fcb56-50c0-4655-ba0e-998959d397bd on n-h2-852771-11 Aug 30 17:32:01.397180 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-457b2d18-e64b-43d3-8a85-a8826cb554c9 req-02a914e2-2cda-4b2d-89a8-0348dd89694a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076032 Aug 30 17:32:01.397811 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 780/1482] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:01.643605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:01.646353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:01.653365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.653896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.655700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.656620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.657257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.657849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.697092 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a20b8244-24f6-41a5-8167-b7e353748060 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291086 Aug 30 17:32:01.698803 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 781/1483] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:32:01 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:01.707384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba5c0d0-bb43-4408-b3d9-a2539324b17a", "tag": "5e02187b-a601-44e4-844b-4af910af5599"}, {"name": "network-changed", "server_uuid": "6c2f303c-c54d-4932-bf97-de42b5d5bd41", "tag": "c37faeb8-2d36-4136-9715-a28dc7c62936"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:01.722491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.724396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.725783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.753141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Creating event network-changed:5e02187b-a601-44e4-844b-4af910af5599 for instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a on n-h2-852771-11 Aug 30 17:32:01.754075 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] Creating event network-changed:c37faeb8-2d36-4136-9715-a28dc7c62936 for instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 on n-h2-852771-11 Aug 30 17:32:01.761580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8a83fe8c-a30a-42f1-ba01-45744badd67e req-4ec71fdf-49f3-4dff-b582-a948872696f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061047 Aug 30 17:32:01.764721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 782/1484] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:01.779120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:01.779967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:01.788710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.789414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.790637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.791539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.792313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.792897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.859583 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2698efc1-32e6-4e67-bd64-ca5b0dcd35b4 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/71f37322-5729-4703-99ee-91ee35b0cbde" status: 202 len: 0 microversion: 2.1 time: 2.183778 Aug 30 17:32:01.868098 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 703/1485] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:31:59 2022] DELETE /compute/v2.1/os-floating-ips/71f37322-5729-4703-99ee-91ee35b0cbde => generated 0 bytes in 2193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:01.873495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95eaba8f-7e94-441e-a3f6-f9627dcc2c85 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cbb1820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:01.920285 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95eaba8f-7e94-441e-a3f6-f9627dcc2c85 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50" status: 200 len: 661 microversion: 2.1 time: 0.050868 Aug 30 17:32:01.929186 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 704/1486] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:01 2022] GET /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:01.934210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:01.935130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:01.942244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.942963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.943594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.944454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:01.945123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:01.945702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:01.955701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:01.964611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ec80632-8ada-431f-8db8-e26829441d4d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.195549 Aug 30 17:32:01.965725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 783/1487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:01 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:02.031872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dcac07ed-a080-4d01-950b-3b9d2b0c04cd tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d98dcd3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-670503924", "description": "tempest-description-1108445918"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.127797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:02.141720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd5f5882-9c9d-41c9-8c3d-e1394535a73b tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.211178 Aug 30 17:32:02.145040 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 705/1488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:01 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:02.157545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0e77fdf-62e9-4242-a13c-1fcc0b5ff97c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0e77fdf-62e9-4242-a13c-1fcc0b5ff97c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Request method failure captured: Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action HTTP/1.1 Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 34 Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDklbknXt8H9PI0oytpeNWPu0R0xW7ripkrelggzfm6lAb-cJts2oUA-pmtEi2D82pUT5A4uvMC89k2kKS3kHn0aIqErm86dHJR10_MxJO9C1Grpv-V0xMUuLGJ-irkKGzdldSQjStXhzIRSUrUPpFCdBwCZScDB__gzt_3TyUVQm0zU Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:02.163514 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e9ee730c6f9c4871bf4500f33d22270a"}]}] Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 7e9432d2aef74db082bdeeb06b721703 Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: {"addFloatingIp": {"address": ""}} Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:32:02.165222 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4ba5c0d0-bb43-4408-b3d9-a2539324b17a', 'body': {'addFloatingIp': {'address': ''}}} Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '' Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:02.166218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:32:02.168023 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:32:02.169490 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 17:32:02.169490 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.169490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0e77fdf-62e9-4242-a13c-1fcc0b5ff97c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:02.171006 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0e77fdf-62e9-4242-a13c-1fcc0b5ff97c tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 400 len: 142 microversion: 2.1 time: 0.021933 Aug 30 17:32:02.172654 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 706/1489] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 142 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:32:02.178806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:02.180152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:02.192071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.192828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.193445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.194322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.194946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.195472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.213911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dcac07ed-a080-4d01-950b-3b9d2b0c04cd tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.246800 Aug 30 17:32:02.214752 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 784/1490] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:02.222994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed4019b6-4b71-43cf-9104-705ff85b3ee8 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99318a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:02.283760 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed4019b6-4b71-43cf-9104-705ff85b3ee8 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50" status: 200 len: 661 microversion: 2.1 time: 0.067403 Aug 30 17:32:02.285567 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 785/1491] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:02 2022] GET /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:02.292136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.297506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:02.306656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.307359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.308036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.308862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.309442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.310095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.345800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:32:02.346434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquired lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:32:02.410833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:02.421547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:02.429466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:02.431129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2274d676-52da-4aa5-b883-f0deeb131e91 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.257286 Aug 30 17:32:02.432003 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 707/1492] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:02 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:02.440946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bda3fded-22de-47f3-8ca1-7d9acfb25222 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d9873e9d0>, body: {"security_group_rule": {"parent_group_id": "a2967f92-e8bb-4771-9185-2168272a6c53", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.478184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Releasing lock "refresh_cache-4ba5c0d0-bb43-4408-b3d9-a2539324b17a" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:32:02.478691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] HTTP exception thrown: floating IP not found Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Request method failure captured: Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action HTTP/1.1 Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 41 Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklbknXt8H9PI0oytpeNWPu0R0xW7ripkrelggzfm6lAb-cJts2oUA-pmtEi2D82pUT5A4uvMC89k2kKS3kHn0aIqErm86dHJR10_MxJO9C1Grpv-V0xMUuLGJ-irkKGzdldSQjStXhzIRSUrUPpFCdBwCZScDB__gzt_3TyUVQm0zU Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:02.480545 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e9ee730c6f9c4871bf4500f33d22270a"}]}] Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7e9432d2aef74db082bdeeb06b721703 Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:32:02.482620 n-d-852771-11 devstack@n-api.service[122124]: exception: floating IP not found Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4ba5c0d0-bb43-4408-b3d9-a2539324b17a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.484996 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 30 17:32:02.489250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.493193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Returning 404 to user: floating IP not found {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:02.493193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-49d2057c-9c12-4a02-aaa3-934398dad786 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 404 len: 67 microversion: 2.1 time: 0.194633 Aug 30 17:32:02.493193 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 786/1493] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 67 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:02.493193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:02.493193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:02.497962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.497962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.497962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.498478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.498819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.499118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.667179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:02.676078 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e926f3e9-e5a4-4bd6-b20b-2e00d6080e03 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.191900 Aug 30 17:32:02.676671 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 787/1494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:02 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:02.683371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4a7ad0b-f2e1-4c98-9e32-00f990551358 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.697855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bda3fded-22de-47f3-8ca1-7d9acfb25222 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.264596 Aug 30 17:32:02.698661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 708/1495] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:02.720627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:02.722984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:02.729841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.730929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.731710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.733016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.733696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.733918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b4a7ad0b-f2e1-4c98-9e32-00f990551358 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.734403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4a7ad0b-f2e1-4c98-9e32-00f990551358 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Request method failure captured: Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action HTTP/1.1 Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 44 Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklbknXt8H9PI0oytpeNWPu0R0xW7ripkrelggzfm6lAb-cJts2oUA-pmtEi2D82pUT5A4uvMC89k2kKS3kHn0aIqErm86dHJR10_MxJO9C1Grpv-V0xMUuLGJ-irkKGzdldSQjStXhzIRSUrUPpFCdBwCZScDB__gzt_3TyUVQm0zU Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:02.735756 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e9ee730c6f9c4871bf4500f33d22270a"}]}] Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7e9432d2aef74db082bdeeb06b721703 Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:32:02.737396 n-d-852771-11 devstack@n-api.service[122124]: exception: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4ba5c0d0-bb43-4408-b3d9-a2539324b17a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:02.738237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 30 17:32:02.739446 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:02.740778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4a7ad0b-f2e1-4c98-9e32-00f990551358 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:02.740778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b4a7ad0b-f2e1-4c98-9e32-00f990551358 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action" status: 404 len: 88 microversion: 2.1 time: 0.058941 Aug 30 17:32:02.740778 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 788/1496] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a/action => generated 88 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:02.745398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c61c5e2-340d-41d3-a2fc-b5b8a69c8044 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d9924ee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-490626411", "description": "tempest-description-539808635"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:02.789534 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7318ea8-bddc-48cd-87df-8ca2e43bbf3f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081519 Aug 30 17:32:02.794481 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 709/1497] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:32:02 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:02.800136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:02.800767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:02.817076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.819022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.819707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.820900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:02.822060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:02.825264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:02.878147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:02.939678 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c61c5e2-340d-41d3-a2fc-b5b8a69c8044 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.198506 Aug 30 17:32:02.948753 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 789/1498] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:02.966780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f633801-9ab0-4c46-b3f1-727b76f66530 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d9929eca0>, body: {"security_group_rule": {"parent_group_id": "f0ab0c7d-b6de-4f97-b5a3-f9d59c328c66", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:03.002219 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61bd1344-dff3-4b33-80e0-bc1123f4bd20 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 204 len: 0 microversion: 2.1 time: 0.205698 Aug 30 17:32:03.004483 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 710/1499] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:02 2022] DELETE /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:03.010837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:03.011878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:03.019445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.020271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.020942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.021736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.022286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.022807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.184021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.193739 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f889e751-d693-45e6-8b03-e8537946cb56 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.187521 Aug 30 17:32:03.195703 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 711/1500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:03 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:03.203134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:03.204269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:03.218113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.218706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.219242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.220973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f633801-9ab0-4c46-b3f1-727b76f66530 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.270789 Aug 30 17:32:03.222069 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 790/1501] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:02 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:03.225050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.225545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.225990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.233361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:03.246911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:03.270980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.270980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.271414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.272684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.273154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.273587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.467896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.472165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:03.486144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08c02721-fc06-46b4-a3a2-678ae223ec75 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.262903 Aug 30 17:32:03.487644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 791/1502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:03 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:03.510651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98fccc12-17ce-4840-94b1-d3a549959faa tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d99318b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-218081831", "description": "tempest-description-891921515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:03.708168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.718469 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a16bcde-88ed-4368-82ad-61a047d54186 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1542 microversion: 2.1 time: 0.520336 Aug 30 17:32:03.719299 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 712/1503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:03 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1542 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:03.725789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:03.726745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:03.742823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.744657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.745117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.745850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.749157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.751191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.761520 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98fccc12-17ce-4840-94b1-d3a549959faa tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.271341 Aug 30 17:32:03.769542 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 792/1504] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:03.769542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:03.769542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:03.782128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.783518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.786443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.787462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:03.788186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:03.792018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:03.965747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.979029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.980992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:03.983577 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fce1dae6-d467-490d-9b20-b6a53e44c211 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.262106 Aug 30 17:32:03.999976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 713/1505] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:03 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:04.002338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:04.007259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d57901e-a2f1-4360-b189-24a0dcb28321 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d9878d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-427817436", "description": "tempest-description-1978611384"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:04.017765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9aa12e1-807b-4aba-8c4e-c6ba04bb829d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.254241 Aug 30 17:32:04.020593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 793/1506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:03 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:04.024146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:04.029877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.039972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:04.055122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.055795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:04.058172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.058841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.063219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.064032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.064848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.131368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37121dde-2a9d-41c0-b3a1-87ec5a7fd567 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109097 Aug 30 17:32:04.132663 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 794/1507] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:04.137960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be425278-f4ac-4113-8a26-2466b3e5422f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98845550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.196397 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be425278-f4ac-4113-8a26-2466b3e5422f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45" status: 200 len: 662 microversion: 2.1 time: 0.062375 Aug 30 17:32:04.197735 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 795/1508] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:04.219203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58bd6f20-79c2-43d0-b6dd-62666b537e4e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98aa9dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.286331 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58bd6f20-79c2-43d0-b6dd-62666b537e4e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45" status: 200 len: 662 microversion: 2.1 time: 0.073370 Aug 30 17:32:04.287328 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 796/1509] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:04.291906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.292515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:04.320109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.321285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.323245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.324428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.325228 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d57901e-a2f1-4360-b189-24a0dcb28321 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.339449 Aug 30 17:32:04.325818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 714/1510] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:04.326149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.328740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.347894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c6399d1-a9a3-47d1-996b-d61b3b38a4ed tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d98d913a0>, body: {"security_group_rule": {"parent_group_id": "ea7a9f17-6bcb-4914-95f5-bfa1ab63ee5d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "18a12178-0ee0-41a2-a0ef-8f446d1575d8"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:04.549139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:04.559448 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2bfebfce-fbb6-4aca-80c5-2840b4e5e040 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.271055 Aug 30 17:32:04.560762 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 797/1511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:04.568411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.569367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:04.577990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.579192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.580731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.581816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.582443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.583025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.733622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c6399d1-a9a3-47d1-996b-d61b3b38a4ed tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.395582 Aug 30 17:32:04.734228 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 715/1512] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:04 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:04.740601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:04.741590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:04.755676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.756168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.756641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.757347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:04.757799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:04.758252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:04.796129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:04.804623 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18945385-92dc-4c4e-9d63-176a5182dab8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.242251 Aug 30 17:32:04.805769 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 798/1513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:04.810649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cbc9342-1e03-469a-8d79-b898b735431a tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d99238040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1519356514", "description": "tempest-description-501158673"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:04.914545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:04.925334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-42ecc955-3433-412e-90fe-a87f41346d3e tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1542 microversion: 2.1 time: 0.189053 Aug 30 17:32:04.926436 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 716/1514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:04 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1542 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:04.991235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cbc9342-1e03-469a-8d79-b898b735431a tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.184183 Aug 30 17:32:04.992013 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 799/1515] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:05.006692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d23694c2-1d06-4bc3-933e-4ab0d39c2239 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d98d91ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1859879888", "description": "tempest-description-2050658550"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:05.007954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:05.008751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:05.015878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.016648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.017086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.017987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.018641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.019071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.158673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:05.164053 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d23694c2-1d06-4bc3-933e-4ab0d39c2239 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.163219 Aug 30 17:32:05.165057 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 717/1516] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:05.167614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:05.169074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:05.169933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:05.170247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62fd7ef6-6025-47be-b569-e0be4d8a4698 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.166801 Aug 30 17:32:05.171226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:05.178868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 800/1517] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:05 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:32:05.190105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:05.192947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:05.194706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.195283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.196327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.197044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.197498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.197921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.199418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.199991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.200524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.201220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.201703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.202120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.236150 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c591b15b-e114-44cc-bc56-0556511ffed0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050149 Aug 30 17:32:05.237831 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 801/1518] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:32:05 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:32:05.243392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3cfafdd-2328-4bf2-8a80-8b557d9895b9 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d99318a60>, body: {"security_group_rule": {"parent_group_id": "743f0004-80e2-4822-ac5c-ba418d8e885c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:05.665102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:05.678210 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50049838-ecd2-4bc0-97b6-e0ad87b5dd96 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.509377 Aug 30 17:32:05.679176 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 718/1519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:05 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:05.691588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:05.692301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:05.711094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.715275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.715974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.724332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:05.725200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:05.726275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:05.802016 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3cfafdd-2328-4bf2-8a80-8b557d9895b9 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.562624 Aug 30 17:32:05.809271 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 802/1520] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:05 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:05.816577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10b7193d-56ca-4c39-ac7e-67fa4fb9099b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d99246f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:06.228599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:06.239524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d38bdad-17ee-4fbb-9460-2c69ef295472 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.555149 Aug 30 17:32:06.245917 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 719/1521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:05 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:06.259267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:06.260024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:06.276423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:06.279300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:06.280159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:06.281361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:06.283466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:06.286653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:06.445383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10b7193d-56ca-4c39-ac7e-67fa4fb9099b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c" status: 202 len: 0 microversion: 2.1 time: 0.634898 Aug 30 17:32:06.446332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 803/1522] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:05 2022] DELETE /compute/v2.1/os-security-groups/ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:06.452859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e7978da-675a-4e73-bdb5-38274983c956 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d991e24c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:06.540240 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e7978da-675a-4e73-bdb5-38274983c956 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b" status: 200 len: 662 microversion: 2.1 time: 0.092696 Aug 30 17:32:06.550738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 804/1523] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:06 2022] GET /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b => generated 662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:06.555585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:06.556395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:06.563976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:06.564738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:06.565347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:06.566279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:06.568027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:06.568639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:06.613097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:06.948792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:06.965816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3121f7c-f613-4315-a706-d7153be03888 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.716469 Aug 30 17:32:06.967792 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 720/1524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:06 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:06.984892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:06.986043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:06.998092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:06.999155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:06.999683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.000433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:07.000876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:07.001979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.288409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9432d2aef74db082bdeeb06b721703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ee730c6f9c4871bf4500f33d22270a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:07.312640 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b312af8-4194-46f0-9d37-8be18e14b496 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 200 len: 1542 microversion: 2.1 time: 0.760433 Aug 30 17:32:07.321430 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 805/1525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:06 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 1542 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:07.335214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d0fb2d5-c2de-4e1d-8762-e4ace7c88a0b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d98aed5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:07.373108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:07.394895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:07.397954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:07.406042 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87782ba2-43f0-4411-89b3-3d7dc3d47b38 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.436697 Aug 30 17:32:07.407609 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 721/1526] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:06 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:07.423676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd9b31dd-d7d2-400a-a69e-da63055ab78c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9873ef70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:07.505240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd9b31dd-d7d2-400a-a69e-da63055ab78c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b" status: 200 len: 662 microversion: 2.1 time: 0.095250 Aug 30 17:32:07.519514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 722/1527] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:07 2022] GET /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:07.519514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:07.519514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:07.522265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:07.522756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:07.523194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.524143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:07.531972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:07.532386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.533609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d0fb2d5-c2de-4e1d-8762-e4ace7c88a0b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/743f0004-80e2-4822-ac5c-ba418d8e885c" status: 200 len: 247 microversion: 2.1 time: 0.208291 Aug 30 17:32:07.534452 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 806/1528] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:32:07 2022] GET /compute/v2.1/os-security-groups/743f0004-80e2-4822-ac5c-ba418d8e885c => generated 247 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:07.539562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:07.540613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:07.559069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:07.559930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:07.560589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.562227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:07.562907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:07.563614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:07.843719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:07.862985 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b30039f-1589-4204-9621-2a189ea4f73f tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.325698 Aug 30 17:32:07.864809 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 807/1529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:07 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:07.881516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05a7dad5-f4be-46c3-b901-dbbce092970b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d99246f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-802286503", "description": "tempest-description-609789752"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:08.000177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:08.013008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9bceefb7-af89-4573-8297-b2520a66ce38 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.504774 Aug 30 17:32:08.016501 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 723/1530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:07 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:08.027756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1825154241", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:08.139122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:08.503613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05a7dad5-f4be-46c3-b901-dbbce092970b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.637671 Aug 30 17:32:08.505140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 808/1531] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:32:07 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:08.519093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba5c0d0-bb43-4408-b3d9-a2539324b17a", "name": "network-vif-deleted", "tag": "5e02187b-a601-44e4-844b-4af910af5599"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:08.532893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.533785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.534446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.553056 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] Creating event network-vif-deleted:5e02187b-a601-44e4-844b-4af910af5599 for instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a on n-h2-852771-11 Aug 30 17:32:08.560443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f411c7a5-d033-45d7-8c77-5b759d009f8a req-946eb07f-13e8-4d08-9a6f-181910406fbd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053897 Aug 30 17:32:08.562350 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 809/1532] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:08.569030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:08.570034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:08.572283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:08.580866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.581807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.583065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.584074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.584968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.586061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.916152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:08.917466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:08.918618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:08.920064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:08.922013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:08.922522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:08.934071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-861d86de-6267-41b2-9923-24131933df8d tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.370137 Aug 30 17:32:08.934898 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 810/1533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:08 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:08.942057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80fcb56-50c0-4655-ba0e-998959d397bd", "name": "network-vif-plugged", "status": "completed", "tag": "5afc8d7d-1109-41f2-92f0-ba60c9adab58"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:08.954938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.955791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.955916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.956319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.956956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.957093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.958395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:08.960609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:08.962033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:08.973549 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] Creating event network-vif-plugged:5afc8d7d-1109-41f2-92f0-ba60c9adab58 for instance c80fcb56-50c0-4655-ba0e-998959d397bd on n-h2-852771-11 Aug 30 17:32:08.979972 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2a227ea8-4287-4966-8040-6c8911f74f7e req-1e1f8470-37eb-4bdb-a323-2f0fb4d8afc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042965 Aug 30 17:32:08.986125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 811/1534] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:08.987955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Getting quotas for project c83f7d6d5ba648cfb8144d776625ecb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:08.994686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Getting quotas for user 60bf4b69be994c5080597a25ece2eeeb and project c83f7d6d5ba648cfb8144d776625ecb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:09.004201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-unplugged", "status": "completed", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:09.010937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:09.013813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:09.042050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.043725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.044413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.075308 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Creating event network-vif-unplugged:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:32:09.079084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c014b7e0-ec9b-416c-b211-eeb697ea0b62 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060975 Aug 30 17:32:09.083644 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 724/1535] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:09.089443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:09.090957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] [instance: 4ba5c0d0-bb43-4408-b3d9-a2539324b17a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:09.099545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 17:32:09.111365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.113278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.114072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.115100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.115890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.116507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.127934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7bf44958-a052-49da-bb9c-cc19d91306c9 req-62577797-c357-40a9-911f-7fff00d447b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138919 Aug 30 17:32:09.129175 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 812/1536] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:09.144243 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] HTTP exception thrown: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Request method failure captured: Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a HTTP/1.1 Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDklbknXt8H9PI0oytpeNWPu0R0xW7ripkrelggzfm6lAb-cJts2oUA-pmtEi2D82pUT5A4uvMC89k2kKS3kHn0aIqErm86dHJR10_MxJO9C1Grpv-V0xMUuLGJ-irkKGzdldSQjStXhzIRSUrUPpFCdBwCZScDB__gzt_3TyUVQm0zU Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:09.146316 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e9ee730c6f9c4871bf4500f33d22270a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e9ee730c6f9c4871bf4500f33d22270a"}]}] Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: e9ee730c6f9c4871bf4500f33d22270a Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832 Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 7e9432d2aef74db082bdeeb06b721703 Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:09.148156 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4ba5c0d0-bb43-4408-b3d9-a2539324b17a'} Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:09.149101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. Aug 30 17:32:09.150992 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:09.153625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] Returning 404 to user: Instance 4ba5c0d0-bb43-4408-b3d9-a2539324b17a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:09.155732 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ff3f162-7569-4731-855f-a0ef307306c1 tempest-FloatingIPsAssociationNegativeTestJSON-948612832 tempest-FloatingIPsAssociationNegativeTestJSON-948612832-project] 10.222.0.50 "GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a" status: 404 len: 111 microversion: 2.1 time: 0.070617 Aug 30 17:32:09.157046 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 725/1537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:09 2022] GET /compute/v2.1/servers/4ba5c0d0-bb43-4408-b3d9-a2539324b17a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:09.159727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:09.160445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:09.167534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-675d8ba1-357e-4464-9e1d-8ffeab4d6590 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d9873e550>, body: {"security_group_rule": {"parent_group_id": "ce504c15-13b4-43e2-8999-3c08bd1d63fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:09.181621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.182111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.191869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.192827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.193322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.194278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.572251 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-675d8ba1-357e-4464-9e1d-8ffeab4d6590 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.413828 Aug 30 17:32:09.573422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 726/1538] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:09.578552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:09.579157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:09.603097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.603900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.604347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.605061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.605983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.606650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.779242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:09.791054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:09.792521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:09.798422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:09.799533 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb84beb8-0726-428f-8bb8-ab797ffc97dc tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1566 microversion: 2.25 time: 0.668230 Aug 30 17:32:09.800109 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 813/1539] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:09 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1566 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:09.824365 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a277c842-91a8-4a0a-a1b9-18221f54c130 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1308 microversion: 2.1 time: 0.249503 Aug 30 17:32:09.825557 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 727/1540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:09 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:09.832120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:09.834286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:09.835074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-993330527", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:09.853031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.853553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.853996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.858333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:09.858826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:09.862507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:09.927864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:10.122617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:10.134351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e598b922-ee70-457f-a58d-30ecc94d7458 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.333013 Aug 30 17:32:10.149808 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 814/1541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:09 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:10.156435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a4ae6fd-1c99-4416-a59f-9cdfd0b294e2 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Action: 'create', calling method: .version_select at 0x7f2d991e23a0>, body: {"security_group_rule": {"parent_group_id": "ce504c15-13b4-43e2-8999-3c08bd1d63fa", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:10.178745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:10.179169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:10.179666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:10.180277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:10.180687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:10.194600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.195237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.195798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:10.196791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.197338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.198099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:10.225657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Getting quotas for project c83f7d6d5ba648cfb8144d776625ecb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:10.233191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Getting quotas for user 60bf4b69be994c5080597a25ece2eeeb and project c83f7d6d5ba648cfb8144d776625ecb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:10.248173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:10.254812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:10.320130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-201c69d8-98fe-4b49-b19f-3bcc384d558b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492514 Aug 30 17:32:10.321114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 728/1542] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:10.325585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:10.326389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:10.333221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.333850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.334396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:10.335242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.335838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.336370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:10.568560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:10.579557 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ac77d75-4732-40b5-8f26-97efc69c76cf tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1468 microversion: 2.1 time: 0.257430 Aug 30 17:32:10.581622 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 729/1543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:10 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1468 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:10.586823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4d5ff79-5f2f-4cd3-b97a-139fcfb4a297 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:10.587774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4d5ff79-5f2f-4cd3-b97a-139fcfb4a297 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:10.667229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c4d5ff79-5f2f-4cd3-b97a-139fcfb4a297 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:10.674068 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a4ae6fd-1c99-4416-a59f-9cdfd0b294e2 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.523137 Aug 30 17:32:10.674993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 815/1544] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:32:10 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:10.690416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0892c07e-5edf-43a2-a66f-2a1d88f7dd86 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d991b9160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:10.692399 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4d5ff79-5f2f-4cd3-b97a-139fcfb4a297 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1217 microversion: 2.1 time: 0.109448 Aug 30 17:32:10.693307 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 730/1545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:10 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:10.797714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0892c07e-5edf-43a2-a66f-2a1d88f7dd86 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/ce504c15-13b4-43e2-8999-3c08bd1d63fa" status: 200 len: 663 microversion: 2.1 time: 0.112543 Aug 30 17:32:10.799535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 816/1546] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:32:10 2022] GET /compute/v2.1/os-security-groups/ce504c15-13b4-43e2-8999-3c08bd1d63fa => generated 663 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:10.814609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7f3c8d3-0560-4e9f-b466-8d2d81109376 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d9cbb1dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:10.828987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:10.829909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:10.846624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.849044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.849996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:10.851647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:10.852318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:10.853431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.074688 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7f3c8d3-0560-4e9f-b466-8d2d81109376 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/611e0c41-aa8d-462d-8583-7339b61aa203" status: 202 len: 0 microversion: 2.1 time: 0.265571 Aug 30 17:32:11.076292 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 731/1547] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 30 17:32:10 2022] DELETE /compute/v2.1/os-security-group-rules/611e0c41-aa8d-462d-8583-7339b61aa203 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:11.081812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:11.082627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:11.097704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.098260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.098762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.099556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.100995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.101886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.134067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:11.144413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:11.146718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:11.148134 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7f95953-718d-4691-af0f-138d5fa16850 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1556 microversion: 2.25 time: 0.326468 Aug 30 17:32:11.148904 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 817/1548] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:10 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1556 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:32:11.164049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-529beed8-88a9-499b-b93f-fb29b988dd49 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d991e2700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:11.286457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:11.294817 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a2402f0-f506-42eb-89b6-1ffe666ec0bd tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1489 microversion: 2.1 time: 0.216940 Aug 30 17:32:11.316735 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 732/1549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:11 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1489 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:11.330483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:11.331336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:11.338812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.339594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.340186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.341068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.341682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.344061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.661996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:11.676783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5c613a7-e32c-4e5e-bfe0-a2171020dfa7 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.358066 Aug 30 17:32:11.690220 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 733/1550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:11 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:11.704991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3f80e862-b5c0-450b-893e-8465ba5f15cb tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '.version_select at 0x7f2d98d913a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:11.710336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f80e862-b5c0-450b-893e-8465ba5f15cb tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.710831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f80e862-b5c0-450b-893e-8465ba5f15cb tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.711271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f80e862-b5c0-450b-893e-8465ba5f15cb tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.726031 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3f80e862-b5c0-450b-893e-8465ba5f15cb tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 3660 microversion: 2.25 time: 0.032461 Aug 30 17:32:11.727420 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 734/1551] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 30 17:32:11 2022] GET /compute/v2.1/os-migrations => generated 3660 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:11.735094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:11.743274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:11.756788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.757514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.758139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.771203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] Creating event network-changed:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:32:11.777061 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-47615b39-4af1-4a9f-b888-219e55bebc4d req-d8491114-3113-4156-978c-e32d090a5226 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048054 Aug 30 17:32:11.777915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 735/1552] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:11.783792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-673900679"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:11.787169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:11.794919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.795662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.796256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.797371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.797979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.798591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.933909 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-529beed8-88a9-499b-b93f-fb29b988dd49 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ce504c15-13b4-43e2-8999-3c08bd1d63fa" status: 202 len: 0 microversion: 2.1 time: 0.783908 Aug 30 17:32:11.935835 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 818/1553] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:11 2022] DELETE /compute/v2.1/os-security-groups/ce504c15-13b4-43e2-8999-3c08bd1d63fa => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:11.942646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:11.946243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:11.971119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.972185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.972585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:11.973580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:11.974070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:11.982353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.161741 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27e5fe7c-7cff-4cec-8e24-0bb566444e52 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "POST /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd/action" status: 202 len: 0 microversion: 2.1 time: 0.379625 Aug 30 17:32:12.172982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 736/1554] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:32:11 2022] POST /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:32:12.182809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:12.184257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:12.194702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.195939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.196900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.198023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.198699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.199570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.433297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:12.443701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-33b2180e-a516-490d-be49-0ee209b0e089 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1269 microversion: 2.1 time: 0.268281 Aug 30 17:32:12.444336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 737/1555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:12 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:12.449442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:12.450114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:12.456682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.457171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.457610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.458529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.459115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.459562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.463746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:12.737667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:12.739906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c2f303c-c54d-4932-bf97-de42b5d5bd41 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:12.756181 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe86c2bf-9271-4bac-b4e0-c32d93e0cb39 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1461 microversion: 2.1 time: 0.818244 Aug 30 17:32:12.757309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 819/1556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:11 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1461 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:12.762403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d991e2dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:12.827942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:32:12.828768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Neutron security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:32:12.829447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] HTTP exception thrown: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.829447 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Request method failure captured: Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-groups/ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c HTTP/1.1 Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkmRxxQEOMEAHZhqJNh5qaTH_pb6xX4VGZyY6eKKzS9G_iy9WLOLMEIgZ91PFKNbOuk3-oOnV8OhcavB3jZmmJLV-gi9K5sL_EmbRuqp7a9SyRjC2Q3mMKDZuDd_jFfcScapzhrokaixIrqdhe8La-dBqagSqP2n48fN0rdDuvtuLus Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 603f0383caf343c3b5e5db679761b26f Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1778549979 Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:12.844007 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/603f0383caf343c3b5e5db679761b26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/603f0383caf343c3b5e5db679761b26f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/603f0383caf343c3b5e5db679761b26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_603f0383caf343c3b5e5db679761b26f"}]}] Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1778549979 Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 603f0383caf343c3b5e5db679761b26f Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1778549979 Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupRulesTestJSON-1778549979-project Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 5ba78f15aabe4e1a867bc017ecfef557 Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1778549979-project Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.846146 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c'} Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:32:12.847283 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:32:12.848881 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.852501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] Aug 30 17:32:12.854325 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:12.856418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Returning 404 to user: Security group ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c does not exist Aug 30 17:32:12.856418 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2481d4d7-afe8-4b47-9ba8-64e7ead051e8'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:12.858871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b2a0844-eba4-4d04-b699-b57d39ea697d tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c" status: 404 len: 194 microversion: 2.1 time: 0.099147 Aug 30 17:32:12.864375 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 820/1557] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:12 2022] DELETE /compute/v2.1/os-security-groups/ad0bf194-1ed0-4a83-bd9f-cc7bf3837a3c => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:12.869155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42ea7307-87f1-42b9-9ace-913d106b46df tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d99058f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:12.923592 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-68603c6e-07f7-4cb3-a3bc-281c5f98c864 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 2050 microversion: 2.25 time: 0.477851 Aug 30 17:32:12.934453 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 738/1558] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:12 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 2050 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:12.937344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:12.937344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:12.945135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.945827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.946360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:12.947222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:12.947858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:12.948822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.014185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42ea7307-87f1-42b9-9ace-913d106b46df tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49" status: 200 len: 1413 microversion: 2.1 time: 0.151523 Aug 30 17:32:13.025659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 821/1559] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:12 2022] GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:13.042512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:13.049676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:13.059165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.060021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.061440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.062350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.064716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.065333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.165481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:13.174501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f47afd06-521d-4fa0-821f-66e9e6c4a81b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.244621 Aug 30 17:32:13.175086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 739/1560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:12 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:13.184581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-426c56d1-d8b9-4b8b-8876-6a2901a719d6 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d9873e430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:13.520717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2495a93c-0594-4bc0-8b61-70438b94bac8 tempest-MigrationsAdminTest-1310142836 tempest-MigrationsAdminTest-1310142836-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1614 microversion: 2.1 time: 0.493318 Aug 30 17:32:13.521996 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 822/1561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:13 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1614 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:13.530674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b30a61f7-60f0-4c4a-bc69-3f909ab6bc18 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98971b80>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:13.573213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-426c56d1-d8b9-4b8b-8876-6a2901a719d6 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/743f0004-80e2-4822-ac5c-ba418d8e885c" status: 202 len: 0 microversion: 2.1 time: 0.392640 Aug 30 17:32:13.574105 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 740/1562] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:13 2022] DELETE /compute/v2.1/os-security-groups/743f0004-80e2-4822-ac5c-ba418d8e885c => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:13.579044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-814257377", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "217d0c94-8215-478d-a8e4-3bc0b700061c"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:13.649423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b30a61f7-60f0-4c4a-bc69-3f909ab6bc18 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49" status: 200 len: 1413 microversion: 2.1 time: 0.126161 Aug 30 17:32:13.650419 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 823/1563] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:13 2022] GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:13.657614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:13.658872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:13.665571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.666842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.667771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.668714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.669379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.670794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.709957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] validate_networks() for [('217d0c94-8215-478d-a8e4-3bc0b700061c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:13.885929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:13.901642 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2783fd0e-61e9-4558-b958-551168a50867 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1275 microversion: 2.1 time: 0.249941 Aug 30 17:32:13.902238 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 824/1564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:13 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:13.913649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:13.914525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:13.936957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.938000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.940622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:13.941720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:13.943304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:13.947099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:14.008957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:14.181840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d163b001-32eb-4bbb-aa60-6ecdc79ec997 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 204 len: 0 microversion: 2.1 time: 0.278106 Aug 30 17:32:14.188693 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 825/1565] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:13 2022] DELETE /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:14.223297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8476c54-4d74-4ff1-a0bc-c8b1771c7ec2 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d991cae50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:14.796892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:14.799226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:14.803379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:14.803859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:14.804292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:14.827782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:14.828950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:14.830041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:14.831075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:14.831736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:14.833849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:14.867559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:14.879004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for user 859d8e930c434d519e4208e58246b471 and project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:14.910373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:14.916150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:15.020042 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad47e276-fb00-4f68-a777-7603cc8fc885 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.443388 Aug 30 17:32:15.027770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 741/1566] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:32:15.034525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad2066a0-0956-4200-b739-51a3a6119923 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cbb1430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:15.072313 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8476c54-4d74-4ff1-a0bc-c8b1771c7ec2 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/18a12178-0ee0-41a2-a0ef-8f446d1575d8" status: 202 len: 0 microversion: 2.1 time: 0.881067 Aug 30 17:32:15.073362 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 826/1567] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:14 2022] DELETE /compute/v2.1/os-security-groups/18a12178-0ee0-41a2-a0ef-8f446d1575d8 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:15.079742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:15.081139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:15.100923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.105337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.106613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:15.110468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.111160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.113892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:15.353695 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad2066a0-0956-4200-b739-51a3a6119923 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49" status: 204 len: 0 microversion: 2.1 time: 0.324529 Aug 30 17:32:15.354514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 742/1568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:15 2022] DELETE /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:15.363584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:15.377488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:15.418683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.419402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.423103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:15.439097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.441638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.442353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:15.696532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:15.711398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae9b15d1-d039-421c-8650-7bc2ea74f971 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1467 microversion: 2.1 time: 0.632961 Aug 30 17:32:15.733503 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 827/1569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:15 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1467 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:15.738976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:15.739848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:15.749107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.749912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.750804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:15.751877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:15.752520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:15.753152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:16.133456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:16.146879 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-213a9a04-7168-46f1-949c-b235ab60859e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.790902 Aug 30 17:32:16.147795 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 743/1570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:15 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:16.167321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:16.170818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:16.188201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:16.190369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:16.191174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:16.193360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:16.195714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:16.196330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:16.336780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:16.356777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:16.359082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:16.362258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb5cefc8-56b1-4fe9-8960-ba5c0898616d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1257 microversion: 2.25 time: 0.213330 Aug 30 17:32:16.368438 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 744/1571] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:16 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1257 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:16.373388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e39b118-3270-4a73-b441-76bd5d24b4e9 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d9cc92c10>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:16.450245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:16.479406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd3398fc-0dd2-4048-931c-b6d0c564f3b9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.744442 Aug 30 17:32:16.491353 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 828/1572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:15 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:16.515749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e578507-0c28-4d92-be8b-fc7b0b8f3c40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d992023a0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:16.564273 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-3e578507-0c28-4d92-be8b-fc7b0b8f3c40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Image not found. Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e578507-0c28-4d92-be8b-fc7b0b8f3c40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 HTTP/1.1 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:16.566919 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '10875d4a-baca-4fca-93d2-720932001c49'} Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:16.568745 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 10875d4a-baca-4fca-93d2-720932001c49 Aug 30 17:32:16.570355 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:16.571850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10875d4a-baca-4fca-93d2-720932001c49 could not be found. Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:16.573445 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:16.575020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e578507-0c28-4d92-be8b-fc7b0b8f3c40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:16.582223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e578507-0c28-4d92-be8b-fc7b0b8f3c40 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49" status: 404 len: 62 microversion: 2.1 time: 0.079754 Aug 30 17:32:16.587225 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 829/1573] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:16 2022] GET /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:16.595921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-plugged", "status": "completed", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:16.624436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:16.625774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:16.626226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:16.662950 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] Creating event network-vif-plugged:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:32:16.677438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-48a6f36b-50c7-495d-806e-c688d20bd82b req-3cf6a22c-1f19-468f-8bb5-429a5fdc621d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089953 Aug 30 17:32:16.680975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 830/1574] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:16.693233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:16.696218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:16.708905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:16.715075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:16.719360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:16.722611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:16.723342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:16.724358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:17.532842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e39b118-3270-4a73-b441-76bd5d24b4e9 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ea7a9f17-6bcb-4914-95f5-bfa1ab63ee5d" status: 202 len: 0 microversion: 2.1 time: 1.163087 Aug 30 17:32:17.534397 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 745/1575] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:16 2022] DELETE /compute/v2.1/os-security-groups/ea7a9f17-6bcb-4914-95f5-bfa1ab63ee5d => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:17.539668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:17.540286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:17.569136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:17.569858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:17.570812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:17.571622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:17.572325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:17.572977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:17.626817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:17.627500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:17.628395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:17.629033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lazy-loading 'fault' on Instance uuid 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:17.698397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:17.715193 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-faf521d1-d7a3-4618-be9c-8e95263171ff tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 200 len: 1303 microversion: 2.1 time: 0.179687 Aug 30 17:32:17.718443 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 746/1576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:17 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:17.733785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:17.734701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:17.742970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:17.744320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:17.744972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:17.746210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:17.746843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:17.747444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.059008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.069893 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73018849-4c0e-4f43-9dca-74b4da15bb0d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.348321 Aug 30 17:32:18.081775 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 747/1577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:17 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:18.096539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.098082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6", "name": "network-vif-deleted", "tag": "36c67498-6d9d-4a4b-a4a6-2e294e980483"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:18.108144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e39ed03-d1f0-4b57-8659-4e1b18a989a4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1489 microversion: 2.1 time: 1.422853 Aug 30 17:32:18.110943 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 831/1578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:16 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1489 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:18.121503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.126147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:18.128007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.128796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.129503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.142612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.143288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.143548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.147595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.152124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.152812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.176130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] Creating event network-vif-deleted:36c67498-6d9d-4a4b-a4a6-2e294e980483 for instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 on n-h1-852771-11 Aug 30 17:32:18.190969 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c095d455-d343-4af3-ae61-f658524a0668 req-bd2cb0ba-81a4-4bb3-9f0e-edee9c385cb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106623 Aug 30 17:32:18.192467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 748/1579] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:18.205120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.206736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:18.214013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.214807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.215998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.217326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.218180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.218985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.380993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.392886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:18.405876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.407573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.411536 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a29b8cc-4507-4335-8fca-5deca519537c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1319 microversion: 2.25 time: 0.298953 Aug 30 17:32:18.412741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 832/1580] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:18 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:18.423442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ecbc4c24-34d2-4709-a28f-9626a32e326b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d98dcc9d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.585805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:18.595233 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0dc7062-9d07-45b8-9bf4-bab6fe63365e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.401280 Aug 30 17:32:18.598786 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 749/1581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:18 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:18.607439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.610261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:18.617309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.618002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.618607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.619472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.620130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.620722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.660020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:18.757729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6f8648b-d4fb-4761-b63e-561f5541854d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 204 len: 0 microversion: 2.1 time: 0.153210 Aug 30 17:32:18.759422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 750/1582] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:18 2022] DELETE /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:18.767532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.768916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:18.778027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.779031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.779863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.781668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.782371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.783109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.802604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] HTTP exception thrown: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Request method failure captured: Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 HTTP/1.1 Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhf4C4C5v8YPtDP7220CnYUGY3HgwtXpMhZlQjEW89YgoJwJ7ZSx4bGNezbEWs3ajmGtHBdLQyT5fTcj4Y2pkQHEp1lEWsB6iqAm35OOX38Pxg4lLKjTUQX0mZquWfvgXeHpfPAYZr9m-ioP9waunHpkdyzmMjx9A5Vx2W9PCUtpaY Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:18.804888 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8309c74c20234daf928cb7048270089f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8309c74c20234daf928cb7048270089f"}]}] Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 976b33387d4c4e0b82cc73c4caf91346 Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. Aug 30 17:32:18.806452 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6'} Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:18.807324 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. Aug 30 17:32:18.808709 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.810029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Returning 404 to user: Instance 0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:18.810029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53106994-6e79-488b-abe1-45c016a36a40 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6" status: 404 len: 111 microversion: 2.1 time: 0.045953 Aug 30 17:32:18.810029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 751/1583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:18 2022] GET /compute/v2.1/servers/0dfc3ab2-296e-4c5b-a16a-b605d0b6bfc6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:18.813666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80fcb56-50c0-4655-ba0e-998959d397bd", "name": "network-vif-plugged", "status": "completed", "tag": "5afc8d7d-1109-41f2-92f0-ba60c9adab58"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:18.824139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.824751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.825221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.838965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] Creating event network-vif-plugged:5afc8d7d-1109-41f2-92f0-ba60c9adab58 for instance c80fcb56-50c0-4655-ba0e-998959d397bd on n-h2-852771-11 Aug 30 17:32:18.845630 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-12f550de-6517-4c08-8e78-d69fdcbdc6e7 req-da02a25d-b8bf-481d-9efe-e573c5298899 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Aug 30 17:32:18.846561 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 752/1584] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:18.852335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-842aa819-5901-4dee-a095-d787405efcae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9cc14310>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.904895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-842aa819-5901-4dee-a095-d787405efcae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Image not found. Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-842aa819-5901-4dee-a095-d787405efcae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 HTTP/1.1 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:18.907619 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '10875d4a-baca-4fca-93d2-720932001c49'} Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:18.909126 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10875d4a-baca-4fca-93d2-720932001c49 to delete Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.910065 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10875d4a-baca-4fca-93d2-720932001c49 could not be found. Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:18.911355 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-842aa819-5901-4dee-a095-d787405efcae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-842aa819-5901-4dee-a095-d787405efcae tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49" status: 404 len: 62 microversion: 2.1 time: 0.065560 Aug 30 17:32:18.914785 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 753/1585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:18 2022] DELETE /compute/v2.1/images/10875d4a-baca-4fca-93d2-720932001c49 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:18.922749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:18.923360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:18.936105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.936435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.936881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:18.937579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:18.938030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:18.938450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.005713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:19.146283 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ea93d0f-30ae-45f8-98bc-af54d6712472 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 204 len: 0 microversion: 2.1 time: 0.227181 Aug 30 17:32:19.146957 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 754/1586] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:18 2022] DELETE /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:19.153473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.156385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.167017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.168286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.168735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.170480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.171520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.172148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.208741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:19.292657 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Instance is already in deleting state, ignoring this request Aug 30 17:32:19.293491 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-13d079e1-b5a3-4c3b-9203-681bd2dc0daa tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 204 len: 0 microversion: 2.1 time: 0.145324 Aug 30 17:32:19.294428 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 755/1587] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:19 2022] DELETE /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:19.301556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:19.311919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.312712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.313333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.319359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:19.335294 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] Creating event network-changed:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:32:19.342477 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ed9aab0a-c32e-4eb2-adde-d20270d737e8 req-b680ba73-824c-4819-8d9f-fc8e0f440254 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045340 Aug 30 17:32:19.343832 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 756/1588] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:19.350094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.351040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.360266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.363061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.363886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.364777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.365404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.365996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.475633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ecbc4c24-34d2-4709-a28f-9626a32e326b tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f0ab0c7d-b6de-4f97-b5a3-f9d59c328c66" status: 202 len: 0 microversion: 2.1 time: 1.061084 Aug 30 17:32:19.476230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 833/1589] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:18 2022] DELETE /compute/v2.1/os-security-groups/f0ab0c7d-b6de-4f97-b5a3-f9d59c328c66 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:19.483166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.484142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.492337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.493192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.493630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.494541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.495160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.495797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.534623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.544411 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b11a5554-f169-43ee-8b14-03cf12c046ff tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.198046 Aug 30 17:32:19.546619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 757/1590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:19 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:19.553580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.554269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.564704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.565527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.566169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.567135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.567715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.569347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.721279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.729664 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec1c94ea-3ee2-423d-ab82-371333eb1415 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1495 microversion: 2.1 time: 0.181900 Aug 30 17:32:19.730559 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 758/1591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:19 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1495 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:19.743535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.743535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.744104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.744316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.744951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.745669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.746252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.746688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.888072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.898011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8823a01-e72d-4361-b8dc-7c7f8885c957 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1534 microversion: 2.1 time: 0.420390 Aug 30 17:32:19.899919 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 834/1592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:19 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1534 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:19.906997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eec7f2be-db89-482d-80f6-55c5dc80cd18 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] Calling method '.version_select at 0x7f2d99246820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.930415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.941164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.942764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:19.943981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb3a4443-267f-4eb7-ba84-b6d4233b4292 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.212425 Aug 30 17:32:19.947017 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 759/1593] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:19 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:19.952740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:19.953575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:19.961363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.962162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.962787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:19.963708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:19.964353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:19.964945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.344902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:20.358026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5331bc9e-825f-4dbf-aa63-d294da40aaea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.409410 Aug 30 17:32:20.358621 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 760/1594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:19 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:20.372143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a212786-ac1b-4080-aac9-1b6bcfce5f2e", "tag": "e51d53e0-2b99-48f8-a792-d2d0331a8aeb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:20.393748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.394229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.394662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.415599 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] Creating event network-changed:e51d53e0-2b99-48f8-a792-d2d0331a8aeb for instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e on n-h2-852771-11 Aug 30 17:32:20.424533 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c651d2f2-70ff-44e1-b00f-f0f7480ea3a8 req-486cf2c2-d729-4d52-8e64-0ab5795c5741 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064229 Aug 30 17:32:20.425357 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 761/1595] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:20.567752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:20.568747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:20.576485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.577198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.577811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.579095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.579749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.580332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.706087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eec7f2be-db89-482d-80f6-55c5dc80cd18 tempest-SecurityGroupRulesTestJSON-1778549979 tempest-SecurityGroupRulesTestJSON-1778549979-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a2967f92-e8bb-4771-9185-2168272a6c53" status: 202 len: 0 microversion: 2.1 time: 0.804877 Aug 30 17:32:20.709953 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 835/1596] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:32:19 2022] DELETE /compute/v2.1/os-security-groups/a2967f92-e8bb-4771-9185-2168272a6c53 => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:20.753589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:20.754212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:20.760707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.764334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.765196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.766044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.766682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.767277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.798895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:20.821598 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b6994da-be56-40b2-9376-11ab7ce4c476 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.258441 Aug 30 17:32:20.824558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 762/1597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:20 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:20.926959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:20.929520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:20.942902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.944046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.947155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.948046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.950100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.954123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.128110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.143174 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96b253c5-da4d-48c1-afc4-b335e9ae33ac tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1534 microversion: 2.1 time: 0.221679 Aug 30 17:32:21.157484 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 763/1598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:20 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1534 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:21.157484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:21.157484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:21.162646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.163391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.163956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.164772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.165337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.165867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.168438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.186184 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37cd9e73-baf7-4207-b7c7-f2ac12a51895 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1495 microversion: 2.1 time: 0.436767 Aug 30 17:32:21.203505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 836/1599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:20 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1495 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:21.350169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.366849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.369847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.371197 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-633f4874-02e9-46bd-ad8d-5ffffd1a331f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.225164 Aug 30 17:32:21.372284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 764/1600] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:21 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:21.382111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:21.383061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:21.390381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.391323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.391720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.393554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.394638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.395726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.643436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5f232c-737e-4544-bf65-ca0a86598157", "tag": "2e7a491d-2d06-4f61-ba6c-9e4bb543ad18"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:21.656682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.657671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.658203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.672976 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] Creating event network-changed:2e7a491d-2d06-4f61-ba6c-9e4bb543ad18 for instance 6c5f232c-737e-4544-bf65-ca0a86598157 on n-h1-852771-11 Aug 30 17:32:21.680917 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b725d5d1-4515-4c08-8671-87ae0518be23 req-d9bd10e3-fa8c-4f46-a885-a045da34dec1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Aug 30 17:32:21.687413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 765/1601] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:21.787448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.798328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04b67256-34ab-4943-bf74-87a2810159f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.420500 Aug 30 17:32:21.800553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 837/1602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:21 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:21.846322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:21.847031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:21.853859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.854345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.854785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.855507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.856047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.856470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.051882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.078076 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27b60d3c-3937-441b-beb4-64f3de5c82bd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1514 microversion: 2.1 time: 0.236820 Aug 30 17:32:22.079838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 766/1603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:21 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:22.165360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:22.166148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:22.172616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.173413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.174042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.174992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.175678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.176300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.213832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:22.214474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:22.236821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.240577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.241714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.244727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.245205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.270634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.543295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.568308 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d201783-e694-43c5-a053-55cbfc9c0b62 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1534 microversion: 2.1 time: 0.394428 Aug 30 17:32:22.569590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 838/1604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:22 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1534 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:22.574493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:22.575351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:22.583014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.590064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.590711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.592243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.592706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.593135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.696692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.709122 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bda8e1f8-ea85-4551-bddd-ba58d4642032 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1495 microversion: 2.1 time: 0.502129 Aug 30 17:32:22.724578 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 767/1605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:22 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1495 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:22.828169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:22.829408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:22.839554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.840460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.841233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.843660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.844996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.845950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.943819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.958051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.962277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:22.968051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a158844-ccae-40f3-8fac-47528973af9a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.393199 Aug 30 17:32:22.969208 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 839/1606] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:22 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:23.080893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:23.098738 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5dde65e1-2600-4b37-af17-928b841a5498 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.279081 Aug 30 17:32:23.100410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 768/1607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:22 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:23.102861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:23.103826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:23.116121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.117784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.119846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.120778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.123690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.125391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.448697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:23.461064 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4d8aebcb-55a2-40d1-b1f1-efbc45e1b853 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1532 microversion: 2.1 time: 0.363237 Aug 30 17:32:23.463703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 840/1608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:23 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1532 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:23.589810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:23.590622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:23.602733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.610959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.610959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.614347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.614877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.615321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.739969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:23.741304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:23.757584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.758167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.758808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.760030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.760734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.761330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.145359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:24.170854 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6ab83d6-c424-4c16-931d-4f983fcd650e tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1495 microversion: 2.1 time: 0.444294 Aug 30 17:32:24.188075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 841/1609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:23 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1495 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:24.196863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:24.201837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:24.212197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.213051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.213742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.214705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.215388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.216218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.368522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:24.389729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b2a937f-739f-4101-be08-5896c7996b8a tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1534 microversion: 2.1 time: 0.802000 Aug 30 17:32:24.392721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 769/1610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:23 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1534 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:24.409796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:24.412413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:24.440348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.441053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.441711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.442545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.443108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.443704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.703658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:24.722683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:24.724796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:24.726323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18a4f944-b53b-4ca6-9a75-b5a2713f991d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.536745 Aug 30 17:32:24.728340 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 842/1611] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:24 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:24.752661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:24.753739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:24.761743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.762845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.764191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.765499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.766235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.766886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.856463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:24.890150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=20 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:25.010961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:25.030221 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e65ad74-d78c-4aef-9391-91dc2bad1998 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.631768 Aug 30 17:32:25.032036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 770/1612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:24 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:25.195551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:25.196331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:25.207318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:25.207839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:25.211803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:25.213915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:25.214581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:25.216984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:25.276048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:25.290485 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-052e00f2-f5e1-4c4c-8af2-579b3a0f87b0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 0.560752 Aug 30 17:32:25.304575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 843/1613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:24 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:25.412522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:25.413135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:25.427204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:25.427631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:25.428070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:25.429244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:25.429244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:25.429640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.110669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.120274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41afe975-7215-401e-8c2a-e64c80b4c751 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1534 microversion: 2.1 time: 0.711703 Aug 30 17:32:26.121812 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 844/1614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:25 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1534 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:26.127890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:26.128742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:26.135914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.136705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.137334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.138846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.139742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.140358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.427740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.451795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.461041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.462610 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b4f006ca-60fa-4b01-9085-d276faf3c8a6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.338866 Aug 30 17:32:26.463504 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 845/1615] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:26 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:26.472083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:26.474132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:26.498449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.502296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.505683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.506637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.507267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.507891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.789958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.799999 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-560104e0-597c-4b77-8d83-e698dbeda61a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.335041 Aug 30 17:32:26.801580 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 846/1616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:26 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:26.807031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:26.807883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:26.816200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.817417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.818194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.819093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.820019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.821278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:26.878891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:26.896745 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c42db132-c669-4575-a82f-5086e6c1eb24 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1495 microversion: 2.1 time: 1.704940 Aug 30 17:32:26.897652 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 771/1617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:25 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1495 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:26.958527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80fcb56-50c0-4655-ba0e-998959d397bd", "name": "network-vif-deleted", "tag": "5afc8d7d-1109-41f2-92f0-ba60c9adab58"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:26.979331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:26.979953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:26.980593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.004670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] Creating event network-vif-deleted:5afc8d7d-1109-41f2-92f0-ba60c9adab58 for instance c80fcb56-50c0-4655-ba0e-998959d397bd on n-h2-852771-11 Aug 30 17:32:27.023017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3c762fe6-c1e4-4d0d-8eb3-035b7a12b80f req-2d75502b-2228-4309-bded-cd85aacded0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072446 Aug 30 17:32:27.023963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 772/1618] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:32:27.083561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:27.093570 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fe182b9-39e3-430c-9730-febe79ddb077 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 0.290732 Aug 30 17:32:27.094683 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 847/1619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:26 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:27.157000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:27.158415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:27.172897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.174175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.175044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.176722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.178043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.179109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.391847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:27.407297 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96e930c5-2428-4b29-bb09-6f265c8bc982 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1492 microversion: 2.1 time: 0.263155 Aug 30 17:32:27.407919 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 773/1620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:27 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1492 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:27.500668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:27.501487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:27.511590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.512373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.515395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.516361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.516941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.517252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.629484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95a51d3-bee7-4607-9481-7572fbecb5f8", "name": "network-vif-unplugged", "status": "completed", "tag": "5f484586-2596-4299-ae84-21ccd7390204"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:27.667903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.668770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.670310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.718259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] Creating event network-vif-unplugged:5f484586-2596-4299-ae84-21ccd7390204 for instance f95a51d3-bee7-4607-9481-7572fbecb5f8 on n-h2-852771-11 Aug 30 17:32:27.729853 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b2acfa06-f2e1-4fc4-ab2f-7c2a7a9ba86c req-91da5c64-95c6-4057-97d0-e3992c7fa687 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105260 Aug 30 17:32:27.733297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 774/1621] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:32:27.749751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:27.759451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:27.761470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:27.764670 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8aeec6b9-d079-4297-981b-8faf7b6525d5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.282936 Aug 30 17:32:27.770156 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 848/1622] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:27 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:27.823941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:27.824917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:27.833910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:27.836391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.838896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.840330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.842960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.844555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.845368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.932285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:27.933942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:27.953258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.955116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.977243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:27.978500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:27.979211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:27.980512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.067030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.067826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.068952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.071456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lazy-loading 'fault' on Instance uuid c80fcb56-50c0-4655-ba0e-998959d397bd {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:28.162806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9055e63b6e44751844a7274c1979566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c170887d97a48f7b66119c56f6ac547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:28.182450 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-32563695-3425-4150-8095-80df0a2726ce tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 200 len: 1298 microversion: 2.1 time: 0.250013 Aug 30 17:32:28.183890 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 849/1623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:27 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:28.194275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:28.194907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:28.208814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.209321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.209712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.212558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.216842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.217529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.412075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:28.420948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed0adba1-c638-4b28-96ab-ecedc7499e9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.601837 Aug 30 17:32:28.424966 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 775/1624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:27 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:28.430564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:28.437004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:28.454072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.456969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.457621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.457796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:28.459794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.460433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.462328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.467005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39e2eeaa-728f-4a18-b4d1-d029ccfc6698 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 0.281849 Aug 30 17:32:28.467598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 850/1625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:28 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:28.499419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:28.514088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.514574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.515008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.515470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lazy-loading 'fault' on Instance uuid 4fc758dd-32e6-4e01-80b8-a6a556293064 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:28.693097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:28.707786 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3cec7705-dc33-474a-aff7-4798b30c1347 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 200 len: 1368 microversion: 2.1 time: 0.280517 Aug 30 17:32:28.710043 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 776/1626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:28 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:28.798132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:28.799446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:28.806669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.807522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.808185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.809128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:28.809907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:28.810555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:28.815673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:29.106333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:29.124479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:29.126221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:29.128817 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ba6d9fe-8f94-49f1-88dc-f630bd6ee5af tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.333278 Aug 30 17:32:29.131096 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 851/1627] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:28 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:29.208500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.209215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c80fcb56-50c0-4655-ba0e-998959d397bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.217965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.218785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.222745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.223690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.224288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.227064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.243540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd HTTP/1.1 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:29.246414 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. Aug 30 17:32:29.249187 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c80fcb56-50c0-4655-ba0e-998959d397bd'} Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.250060 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. Aug 30 17:32:29.254076 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.255582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance c80fcb56-50c0-4655-ba0e-998959d397bd could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.255582 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53f126b0-92b1-42e1-a448-d37b23fe63a6 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd" status: 404 len: 111 microversion: 2.1 time: 0.049362 Aug 30 17:32:29.256899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 777/1628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] GET /compute/v2.1/servers/c80fcb56-50c0-4655-ba0e-998959d397bd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:29.270524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-523c58eb-1f77-4200-b85d-490282c074b4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d98dc3700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.298775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-523c58eb-1f77-4200-b85d-490282c074b4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Image not found. Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-523c58eb-1f77-4200-b85d-490282c074b4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 HTTP/1.1 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:29.300683 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '16e8b722-5e3d-4f19-822a-39b79e521009'} Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.302278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 16e8b722-5e3d-4f19-822a-39b79e521009 to delete Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.303285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16e8b722-5e3d-4f19-822a-39b79e521009 could not be found. Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.304694 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-523c58eb-1f77-4200-b85d-490282c074b4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-523c58eb-1f77-4200-b85d-490282c074b4 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009" status: 404 len: 62 microversion: 2.1 time: 0.036546 Aug 30 17:32:29.306093 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 852/1629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] DELETE /compute/v2.1/images/16e8b722-5e3d-4f19-822a-39b79e521009 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:29.313511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.314032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.322050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.322919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.323358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.325789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.326511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.327162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.346596 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 HTTP/1.1 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:29.349324 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.351077 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b1317528-acd4-4a58-9780-79a5d0d92664'} Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.352085 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.353753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.356987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.358066 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53db5a79-bfd4-4676-9626-6894e1aa7384 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 404 len: 111 microversion: 2.1 time: 0.051226 Aug 30 17:32:29.359177 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 778/1630] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:29 2022] DELETE /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:29.372156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.373399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: b1317528-acd4-4a58-9780-79a5d0d92664] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.385230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.386722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.386722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.387441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.389481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.390355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.407011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 HTTP/1.1 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:29.409132 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.410889 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b1317528-acd4-4a58-9780-79a5d0d92664'} Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.411917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. Aug 30 17:32:29.413486 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.414933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance b1317528-acd4-4a58-9780-79a5d0d92664 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.415797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69117621-6ade-4e77-9dbb-2bbd832fd49d tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664" status: 404 len: 111 microversion: 2.1 time: 0.050459 Aug 30 17:32:29.425377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5743bd5-9285-4a12-9d5b-bf3c12b3bfb7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d9878d790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.435793 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 853/1631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] GET /compute/v2.1/servers/b1317528-acd4-4a58-9780-79a5d0d92664 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:29.446276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.448124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.451284 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d5743bd5-9285-4a12-9d5b-bf3c12b3bfb7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Image not found. Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5743bd5-9285-4a12-9d5b-bf3c12b3bfb7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a HTTP/1.1 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:29.453509 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4ee935ab-1fe0-4b49-9fae-fd5951a8941a'} Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.455146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ee935ab-1fe0-4b49-9fae-fd5951a8941a to delete Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.456162 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ee935ab-1fe0-4b49-9fae-fd5951a8941a could not be found. Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.457448 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5743bd5-9285-4a12-9d5b-bf3c12b3bfb7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.458790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5743bd5-9285-4a12-9d5b-bf3c12b3bfb7 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a" status: 404 len: 62 microversion: 2.1 time: 0.033719 Aug 30 17:32:29.461865 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 779/1632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] DELETE /compute/v2.1/images/4ee935ab-1fe0-4b49-9fae-fd5951a8941a => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:29.473872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.474485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.474779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.475272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.476023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.476912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.479333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.479912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.489238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.490170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.490859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.491864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.492554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.493226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.510204 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a HTTP/1.1 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:29.519743 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:29.521720 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c5de5d84-d461-4587-984e-3561d9cd735a'} Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:29.522554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:29.524046 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:29.530926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:29.533259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d11677a-4e01-4264-9343-dcbd3fd6612b tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 404 len: 111 microversion: 2.1 time: 0.070105 Aug 30 17:32:29.536474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 780/1633] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:29 2022] DELETE /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:29.546779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:29.549653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:29.568171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.568675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.569119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.570357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.570357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.570677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:29.906899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:29.923451 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-baf0c698-5f64-426a-af47-08ac78d45f49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.480073 Aug 30 17:32:29.942377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 854/1634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:29.954704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc758dd-32e6-4e01-80b8-a6a556293064", "name": "network-vif-deleted", "tag": "4a5119ac-5d22-4434-aa63-5581db25024c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:29.981986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:29.984892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:29.985348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.000318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:30.009888 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24e93e54-73d5-4505-ba0f-8fa6d04ae4d5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 0.470868 Aug 30 17:32:30.015834 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 781/1635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:29 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:30.025123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] Creating event network-vif-deleted:4a5119ac-5d22-4434-aa63-5581db25024c for instance 4fc758dd-32e6-4e01-80b8-a6a556293064 on n-h2-852771-11 Aug 30 17:32:30.027434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.028434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: c5de5d84-d461-4587-984e-3561d9cd735a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.039361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5ceeb95b-c0dc-4a7e-b4d0-c2ecc3e91a88 req-5c46f444-d5f8-4a0d-835e-fefaccdc6ece service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095113 Aug 30 17:32:30.043132 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 855/1636] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:30.045217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.045985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.046624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.051188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.051978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.052634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.058640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.064533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 4fc758dd-32e6-4e01-80b8-a6a556293064] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.084277 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:30.085832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.086340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.086860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.087726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.088243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.088736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a HTTP/1.1 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:30.089092 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:30.090697 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c5de5d84-d461-4587-984e-3561d9cd735a'} Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:30.092144 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. Aug 30 17:32:30.093769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.096056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance c5de5d84-d461-4587-984e-3561d9cd735a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:30.100477 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e82024d-2624-4823-9103-992976ab2cba tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a" status: 404 len: 111 microversion: 2.1 time: 0.083015 Aug 30 17:32:30.102250 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 782/1637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:30 2022] GET /compute/v2.1/servers/c5de5d84-d461-4587-984e-3561d9cd735a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:30.114418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ee70c03-49fd-4fe1-92cd-ee15288232d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '.version_select at 0x7f2d987b5a60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.120311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] HTTP exception thrown: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Request method failure captured: Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 HTTP/1.1 Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhf4C4C5v8YPtDP7220CnYUGY3HgwtXpMhZlQjEW89YgoJwJ7ZSx4bGNezbEWs3ajmGtHBdLQyT5fTcj4Y2pkQHEp1lEWsB6iqAm35OOX38Pxg4lLKjTUQX0mZquWfvgXeHpfPAYZr9m-ioP9waunHpkdyzmMjx9A5Vx2W9PCUtpaY Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:30.132837 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8309c74c20234daf928cb7048270089f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8309c74c20234daf928cb7048270089f"}]}] Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 976b33387d4c4e0b82cc73c4caf91346 Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. Aug 30 17:32:30.134808 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4fc758dd-32e6-4e01-80b8-a6a556293064'} Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:30.135894 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. Aug 30 17:32:30.137507 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.139155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Returning 404 to user: Instance 4fc758dd-32e6-4e01-80b8-a6a556293064 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:30.139155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba6ebc9f-f626-4576-9d85-402e948f8e94 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064" status: 404 len: 111 microversion: 2.1 time: 0.088259 Aug 30 17:32:30.139155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 856/1638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:30 2022] GET /compute/v2.1/servers/4fc758dd-32e6-4e01-80b8-a6a556293064 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:30.148365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea5c799f-8c9c-4e1a-b1ca-4928eb906815 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '.version_select at 0x7f2d98dc3550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.171201 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2ee70c03-49fd-4fe1-92cd-ee15288232d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Image not found. Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ee70c03-49fd-4fe1-92cd-ee15288232d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f HTTP/1.1 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:32:30.174246 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f'} Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:30.176031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f to delete Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.177146 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f could not be found. Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:30.178749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:32:30.181227 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.185555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ee70c03-49fd-4fe1-92cd-ee15288232d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:30.186636 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ee70c03-49fd-4fe1-92cd-ee15288232d0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f" status: 404 len: 62 microversion: 2.1 time: 0.081378 Aug 30 17:32:30.187829 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 783/1639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:30 2022] DELETE /compute/v2.1/images/5ff48bfd-a658-4e6d-bc4d-b78a1788eb6f => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:32:30.194228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea5c799f-8c9c-4e1a-b1ca-4928eb906815 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350239531" status: 202 len: 0 microversion: 2.1 time: 0.054739 Aug 30 17:32:30.195230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 857/1640] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350239531 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:30.202138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.202796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.205973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.206691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.219961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.220452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.222695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.224657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.225307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.225960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.226345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.226861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.227182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.227808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.228381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.229140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.267421 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 HTTP/1.1 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:30.268642 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.270129 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3b09f88a-fa60-412b-9ae5-644b99ee7c89'} Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:30.270965 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.272346 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.275696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:30.276808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bcc7c08f-2b33-483a-97d1-dcac415c9ca0 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 404 len: 111 microversion: 2.1 time: 0.080542 Aug 30 17:32:30.277613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 858/1641] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:30 2022] DELETE /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:30.293087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.299024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] [instance: 3b09f88a-fa60-412b-9ae5-644b99ee7c89] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.317645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.318531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.319180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.320156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.320827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.321467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.347866 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] HTTP exception thrown: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Request method failure captured: Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 HTTP/1.1 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkioACnLjZlYmdg5z8LvzRSRfvds0e9F42iSRTc6oixCEVMy_ZVSqIBdeX3DOr2te9XKtPROlBi1nDzZNg8EnoOsZ9oKY9YdsfKYAheMRbkgqHEGkb3ee0m3oVeO9DF5-zLK71nFjiyD7XI-JXhkifH10MczF23FGZv6M0zqjmbsmEg Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:30.358012 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c170887d97a48f7b66119c56f6ac547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c170887d97a48f7b66119c56f6ac547"}]}] Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3c170887d97a48f7b66119c56f6ac547 Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesTestJSON-1085330436 Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e9055e63b6e44751844a7274c1979566 Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesTestJSON-1085330436-project Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.360422 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3b09f88a-fa60-412b-9ae5-644b99ee7c89'} Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:30.361539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. Aug 30 17:32:30.363047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:30.369375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] Returning 404 to user: Instance 3b09f88a-fa60-412b-9ae5-644b99ee7c89 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:30.370416 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-64663953-5752-4e11-855e-0e231c8ffa23 tempest-ImagesTestJSON-1085330436 tempest-ImagesTestJSON-1085330436-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89" status: 404 len: 111 microversion: 2.1 time: 0.084220 Aug 30 17:32:30.372001 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 859/1642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:30 2022] GET /compute/v2.1/servers/3b09f88a-fa60-412b-9ae5-644b99ee7c89 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:32:30.945009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:30.947059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:30.971168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.971992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.972739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:30.977091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:30.978297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:30.979393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:31.006711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:31.016895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:31.022426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:31.026197 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e060ab5-f6f0-4e14-bef0-a916aa9d124b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.837162 Aug 30 17:32:31.030366 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 784/1643] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:30 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:31.045668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a212786-ac1b-4080-aac9-1b6bcfce5f2e", "name": "network-vif-plugged", "status": "completed", "tag": "e51d53e0-2b99-48f8-a792-d2d0331a8aeb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:31.072124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:31.074349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:31.075076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:31.109426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] Creating event network-vif-plugged:e51d53e0-2b99-48f8-a792-d2d0331a8aeb for instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e on n-h2-852771-11 Aug 30 17:32:31.126049 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a486ae1c-5dcf-4f1f-b64f-2409552c5ec5 req-c2b952aa-fe7f-4e67-b1be-d08a76f36271 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089931 Aug 30 17:32:31.127010 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 785/1644] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:31.138724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:31.141472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:31.162684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:31.163466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:31.166049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:31.170492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:31.171226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:31.173138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:31.665865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:31.676112 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-470608f1-c1c8-4e87-9ceb-c78b1e773781 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 0.734995 Aug 30 17:32:31.682311 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 860/1645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:30 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:32.102807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:32.104592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:32.166163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:32.169147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:32.170474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:32.174056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:32.177040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:32.179100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:32.420705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:32.438549 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5ed81e0-bfcd-43c1-a21e-47542ef33df2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 1.307749 Aug 30 17:32:32.440223 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 786/1646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:31 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:32.705556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:32.708737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:32.709554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:32.718084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:32.718777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:32.719499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:32.720288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:32.720906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:32.721440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6c5494cf-df20-4c5d-92d6-04a5bc6739f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.666936 Aug 30 17:32:32.721988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 861/1647] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:32 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:32.726302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:32.726961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:32.727755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.099663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:33.100302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:33.114377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.116476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.117396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.119106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.120770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.122806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.187789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:33.393730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e19f31fb-2489-4e17-9a67-5ea0f219bdef tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "DELETE /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 204 len: 0 microversion: 2.1 time: 0.298518 Aug 30 17:32:33.396263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 862/1648] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:33 2022] DELETE /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:32:33.409989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95a51d3-bee7-4607-9481-7572fbecb5f8", "name": "network-vif-plugged", "status": "completed", "tag": "5f484586-2596-4299-ae84-21ccd7390204"}, {"server_uuid": "6c5f232c-737e-4544-bf65-ca0a86598157", "name": "network-vif-plugged", "status": "completed", "tag": "2e7a491d-2d06-4f61-ba6c-9e4bb543ad18"}, {"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-plugged", "status": "completed", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:33.439768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:33.448723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.449603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.464232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.538264 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Creating event network-vif-plugged:5f484586-2596-4299-ae84-21ccd7390204 for instance f95a51d3-bee7-4607-9481-7572fbecb5f8 on n-h2-852771-11 Aug 30 17:32:33.539360 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Creating event network-vif-plugged:2e7a491d-2d06-4f61-ba6c-9e4bb543ad18 for instance 6c5f232c-737e-4544-bf65-ca0a86598157 on n-h1-852771-11 Aug 30 17:32:33.548683 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] Creating event network-vif-plugged:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:32:33.589604 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-28ddfb45-19a0-4c5b-9429-40e2e45d5dd3 req-c169ad45-0752-416a-87ce-3e7522501662 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.190691 Aug 30 17:32:33.591258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 863/1649] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:33.605344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:33.606647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:33.615370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.616204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.617090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.618273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.618892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.619471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.876217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:33.889133 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ab24ee6-24a7-4251-b855-82fa7eaafd78 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1317 microversion: 2.1 time: 1.185414 Aug 30 17:32:33.890429 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 787/1650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:32 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1317 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:33.896499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:33.898528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:33.918863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.921613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.922394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.923458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.925068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.925852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.927388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:33.944078 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56c9a8f7-7a90-46db-92f5-174cbf7c5b97 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1468 microversion: 2.1 time: 0.342521 Aug 30 17:32:33.944734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 864/1651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:33 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:33.967592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:33.967813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:33.973961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.974469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.974905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:33.976098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:33.976742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:33.977256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:34.312932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:34.326711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:34.331003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:34.332220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c73095e-33a0-4a3f-9032-5272c79f1f0b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1361 microversion: 2.25 time: 0.374436 Aug 30 17:32:34.334509 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 865/1652] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:33 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:34.507299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:34.517955 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6cbb6784-b074-4ad7-9fd1-7eccc3275b1e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1520 microversion: 2.1 time: 0.625903 Aug 30 17:32:34.518467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 788/1653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:33 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1520 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:34.854056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-17005247", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "555ceb67-cbe8-440f-b69e-5ec755787dff"}], "block_device_mapping_v2": [{"uuid": "d78598d5-92b3-44c0-a21c-458677109ae2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:34.912213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:34.912827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:34.932169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:34.939762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:34.940232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:34.944595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:34.945334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:34.948868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:35.021610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] validate_networks() for [('555ceb67-cbe8-440f-b69e-5ec755787dff', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:35.729089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:35.743521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bff4f12f-4e51-4678-8c2a-ee15124dbbc9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1467 microversion: 2.1 time: 0.833385 Aug 30 17:32:35.759370 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 789/1654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:34 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1467 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:35.768899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:35.772100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:35.780066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:35.780773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:35.781401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:35.782278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:35.782894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:35.783537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.198087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:36.222160 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08672cdb-2776-40b9-b8cc-0b0637ef4cb0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 200 len: 1468 microversion: 2.1 time: 0.460266 Aug 30 17:32:36.224565 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 790/1655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:35 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:36.252302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:36.253659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:36.275401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.278706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.281417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.284443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.289611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.291168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.426797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:36.428159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:36.428920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:36.429706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:36.430343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:36.453854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.454740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.455373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.460457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.461307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.462792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.503136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:36.514408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Getting quotas for user 5fa0c244b665489ab32553dd33c47518 and project 75c6078a31ba4cafb47564e45e877c1f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:36.591912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:36.594396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d78598d5-92b3-44c0-a21c-458677109ae2',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:36.772894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:36.791297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:36.807975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:36.809340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-875197b6-c087-4e94-9e9a-3a2236d94672 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1557 microversion: 2.25 time: 0.583383 Aug 30 17:32:36.810230 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 791/1656] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:36 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1557 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:36.814794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:36.815391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:36.842010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.842735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.843609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.847695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.848541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.849641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.873814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7293d59-7ce3-4f75-902c-7f1bedc4cf42 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025108 Aug 30 17:32:36.876132 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 866/1657] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:36.886888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:36.892556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:36.907453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.907977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.908416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:36.909124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:36.916260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:36.916990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.206214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:37.222472 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20f43f9e-dddd-4ad6-9625-c91afd00395e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1468 microversion: 2.1 time: 0.342532 Aug 30 17:32:37.239584 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 867/1658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:36 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1468 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:37.245318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045973ae-b001-4849-9c29-0a7d3bb9f44e", "name": "network-vif-deleted", "tag": "b5be2547-1b39-4e07-8398-963a0500c05d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:37.260088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:37.260939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:37.261591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.279704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] Creating event network-vif-deleted:b5be2547-1b39-4e07-8398-963a0500c05d for instance 045973ae-b001-4849-9c29-0a7d3bb9f44e on n-h1-852771-11 Aug 30 17:32:37.288248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2b74aefa-1630-480b-9b83-1b3c6f2072d4 req-990cc5dc-6c58-417f-af41-2343629c9c25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047014 Aug 30 17:32:37.289479 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 868/1659] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:37.296378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:37.297303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:37.308553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:37.310925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:37.311758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.312703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:37.313224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:37.314111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.464009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:37.477301 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6dc00bd-9b97-4327-afbb-189a75cd174c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1505 microversion: 2.1 time: 0.665555 Aug 30 17:32:37.478230 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 792/1660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:36 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:37.484227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a1f59fd-e31d-4b1c-8b01-8298a6c7106c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:37.485088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7a1f59fd-e31d-4b1c-8b01-8298a6c7106c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:37.614624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7a1f59fd-e31d-4b1c-8b01-8298a6c7106c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:37.622544 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7a1f59fd-e31d-4b1c-8b01-8298a6c7106c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1051 microversion: 2.1 time: 0.142959 Aug 30 17:32:37.623142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 793/1661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:37 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1051 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:37.631075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-417410884"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:37.650392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:37.673613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:37.674058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:37.674677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.675394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:37.675864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:37.676290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:37.983041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:38.053208 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e6eab316-10b2-4a8e-99a9-02517e95c9bc tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 2051 microversion: 2.25 time: 0.758998 Aug 30 17:32:38.054617 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 869/1662] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:37 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 2051 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:38.061305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:38.063011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: 045973ae-b001-4849-9c29-0a7d3bb9f44e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:38.084983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.085482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.085924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.093040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.093562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.094013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.115096 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] HTTP exception thrown: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Request method failure captured: Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e HTTP/1.1 Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhf4C4C5v8YPtDP7220CnYUGY3HgwtXpMhZlQjEW89YgoJwJ7ZSx4bGNezbEWs3ajmGtHBdLQyT5fTcj4Y2pkQHEp1lEWsB6iqAm35OOX38Pxg4lLKjTUQX0mZquWfvgXeHpfPAYZr9m-ioP9waunHpkdyzmMjx9A5Vx2W9PCUtpaY Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:38.116744 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8309c74c20234daf928cb7048270089f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8309c74c20234daf928cb7048270089f"}]}] Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 976b33387d4c4e0b82cc73c4caf91346 Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. Aug 30 17:32:38.118284 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '045973ae-b001-4849-9c29-0a7d3bb9f44e'} Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:38.119136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. Aug 30 17:32:38.121952 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:38.124959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Returning 404 to user: Instance 045973ae-b001-4849-9c29-0a7d3bb9f44e could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:38.124959 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-891c31df-e364-4b82-9cfa-950c4579d456 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e" status: 404 len: 111 microversion: 2.1 time: 0.061245 Aug 30 17:32:38.124959 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 870/1663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:38 2022] GET /compute/v2.1/servers/045973ae-b001-4849-9c29-0a7d3bb9f44e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:38.127826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:38.128706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:38.135589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.136437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.137169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.138058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.138736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.139333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.225745 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-47905e8e-5d97-442b-8a86-8af550ce3f6d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "POST /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86/action" status: 202 len: 0 microversion: 2.1 time: 0.594634 Aug 30 17:32:38.226661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 794/1664] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:32:37 2022] POST /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:32:38.246895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:38.250530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:38.273479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.274076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.275207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.279236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.281268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.283597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.499060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:38.508385 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0db59718-05c6-47b9-ac8d-694072408fd5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 200 len: 1505 microversion: 2.1 time: 0.384174 Aug 30 17:32:38.514398 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 871/1665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:38 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:38.732680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84f71611-64cc-460c-a0ec-7c5c313b2dbe tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Action: 'create', calling method: .version_select at 0x7f2d9cd93700>, body: {"keypair": {"name": "tempest-keypair-1504879311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwu9U4McttIHtUyei1c7vqDkfSdgwvY3fiAWIEZGk2yUjTmAZHIEvvtWZTCfKt2klKt9V6zsa/Fiw5ltQ8CNb9dd61oNS95T4OXIijUcgtc6YQhh5fvNwP4MW9XZqT+Kw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:38.764083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-84f71611-64cc-460c-a0ec-7c5c313b2dbe tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for project ab904bdc06b24b34ac4b151b44bb6944. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:38.775013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-84f71611-64cc-460c-a0ec-7c5c313b2dbe tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for user 19e96a97ef7748f99a0a71e456c91276 and project ab904bdc06b24b34ac4b151b44bb6944. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:38.803370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84f71611-64cc-460c-a0ec-7c5c313b2dbe tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287640 Aug 30 17:32:38.811460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 872/1666] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:32:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:38.817622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:38.818890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:38.828582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.829361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.830094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.830882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:38.831534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:38.832034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:38.882904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:38.893450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:38.930526 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f76ae94e-232a-4ed3-a02d-aed41629d39c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 2051 microversion: 2.25 time: 0.700160 Aug 30 17:32:38.943910 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 795/1667] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:38 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 2051 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:38.955564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-39a684ce-b17b-4ccf-90ef-15cf46946bab tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9878d9d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.010805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:39.030026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-39a684ce-b17b-4ccf-90ef-15cf46946bab tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.084774 Aug 30 17:32:39.033145 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 796/1668] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:38 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:39.044961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.045795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:39.060351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.061174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.062992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.064855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.065536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.067266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.124709 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58ee3e8f-6b19-4f53-aa12-d2e0d665abd8 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 204 len: 0 microversion: 2.1 time: 0.311435 Aug 30 17:32:39.125805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 873/1669] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:38 2022] DELETE /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:39.135836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:39.141549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.142537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:39.162047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.162996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.164270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.165273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.166056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.170443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.179747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:39.301877 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ebe7d66-7f20-491e-8ab4-0cf2736004fb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 204 len: 0 microversion: 2.1 time: 0.266907 Aug 30 17:32:39.303465 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 797/1670] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:39 2022] DELETE /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:39.311149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.321880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.322759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.323530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.325158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.326557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.327069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.353981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ad99d63-8522-46c9-ab39-4068ec46d9d9 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.048366 Aug 30 17:32:39.366400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:39.375542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06995a13-ec79-413d-aeba-12a481807be6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1157 microversion: 2.1 time: 0.248188 Aug 30 17:32:39.375800 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 798/1671] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 30 17:32:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:32:39.380807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.381684 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 874/1672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:39 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1157 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:39.383851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:39.404656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:39.405205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:39.409809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.410793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.414397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.415342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.415991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.417496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.418141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.422698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.423339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.424282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:39.427320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:39.427986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:39.559530 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db5d49a1-8ae5-4b91-8c65-9eda2b6a741b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157/action" status: 202 len: 0 microversion: 2.25 time: 0.175857 Aug 30 17:32:39.569133 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 875/1673] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:32:39 2022] POST /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:39.573514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2020281954", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "5cbe98ac-21be-43d9-bb02-1945a3517c1d"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:39.643708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] validate_networks() for [('5cbe98ac-21be-43d9-bb02-1945a3517c1d', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:39.948608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:39.970783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2efff0bd-1d88-4f15-b8ff-bcc74792b7a1 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1467 microversion: 2.1 time: 0.593648 Aug 30 17:32:39.974442 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 799/1674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:39 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1467 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:39.987171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:39.988994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:40.008000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:40.008913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:40.009518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:40.011513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:40.012923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:40.013572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:40.950543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:40.951079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:40.951575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:40.952194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:40.952799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:40.990579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:40.991076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:40.998800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:40.999680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:41.003631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:41.004416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:41.084364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:41.101655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for user dadf1246d7264e3ba4f840a27b1f4aad and project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:41.140054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:41.148880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:41.251838 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e5835435-5d23-42a8-92ea-860c270770f0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682997 Aug 30 17:32:41.253104 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 876/1675] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:41.273316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81b9e9cb-14e9-4c54-a019-88b38e48d0ce tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cde2ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:41.339323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81b9e9cb-14e9-4c54-a019-88b38e48d0ce tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.084963 Aug 30 17:32:41.340488 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 877/1676] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:41 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:41.345229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:41.351245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:41.382463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:41.383252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:41.383974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:41.387032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:41.388031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:41.390035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:42.134414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:42.154317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9f2142d-d610-4929-ad6a-ba5f5aa95f1d tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1167 microversion: 2.1 time: 0.812476 Aug 30 17:32:42.155115 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 878/1677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:41 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1167 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:42.178190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:42.179352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:42.205093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:42.209423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:42.210043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:42.213224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:42.215662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:42.220004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:42.926362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:43.038315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67131d0e-da32-4379-ac38-ff6fcb1d8a94 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 2056 microversion: 2.25 time: 3.040752 Aug 30 17:32:43.041651 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 800/1678] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:39 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 2056 bytes in 3066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:43.072452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:43.084597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:43.097837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:43.106480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-866d7c9c-7b82-412a-a498-1a5b2e88dabc tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1467 microversion: 2.1 time: 0.948005 Aug 30 17:32:43.109588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 879/1679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:42 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1467 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:43.116409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.116943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.117390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.118148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.118575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.118996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.122635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad3ce2c9-1277-455b-b973-a573185e044b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99355f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:43.246517 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad3ce2c9-1277-455b-b973-a573185e044b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.132502 Aug 30 17:32:43.256163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 880/1680] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:43 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:43.268029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:43.278689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:43.305683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.306572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.308077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.310209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.313864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.314553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.595885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:43.605025 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-387bd9c4-2d7e-4a7a-b094-88483f059edb tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1270 microversion: 2.1 time: 0.562246 Aug 30 17:32:43.618420 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 801/1681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:43 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1270 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:43.622769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:43.635884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7af9e743-f76c-45be-a988-791128ae01b7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1167 microversion: 2.1 time: 0.378494 Aug 30 17:32:43.649077 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 881/1682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:43 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1167 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:44.067007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:44.068545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:44.091357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.096314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.097135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.100726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.101479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.102167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.132392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95a51d3-bee7-4607-9481-7572fbecb5f8", "name": "network-vif-deleted", "tag": "5f484586-2596-4299-ae84-21ccd7390204"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:44.156899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.157960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.160852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.200443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] Creating event network-vif-deleted:5f484586-2596-4299-ae84-21ccd7390204 for instance f95a51d3-bee7-4607-9481-7572fbecb5f8 on n-h2-852771-11 Aug 30 17:32:44.221115 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b67e8603-9199-41fe-bcbc-b6112c0e2a7f req-9da27102-4d7b-487b-a16c-8cca8815dd43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095353 Aug 30 17:32:44.227802 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 882/1683] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:32:44.245255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:44.247967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:44.283358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.286152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.288342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.290682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.292567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.293863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.900567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:44.947355 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ce3025f-f878-451b-972a-499a31309f16 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 2036 microversion: 2.25 time: 0.885070 Aug 30 17:32:44.957887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 802/1684] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:44 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 2036 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:44.965399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c3a2894-cd76-43f5-8caf-65e7727393c9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cca6dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:45.136189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c3a2894-cd76-43f5-8caf-65e7727393c9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.176551 Aug 30 17:32:45.141343 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 803/1685] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:44 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:45.151030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:45.155722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:45.185937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.188613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.189289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.190261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.190919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.193305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.538493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976b33387d4c4e0b82cc73c4caf91346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8309c74c20234daf928cb7048270089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:45.550973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd330235-6ced-416a-bcd6-81dcd2f8ade0 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 200 len: 1467 microversion: 2.1 time: 1.321376 Aug 30 17:32:45.559263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 883/1686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:44 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 1467 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:45.597980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:45.598621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:45.614189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.615091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.616490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.618133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.619547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.620355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.769809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:45.784857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-613abca8-565d-4b2e-9b99-e62702637f98 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1276 microversion: 2.1 time: 0.642129 Aug 30 17:32:45.801412 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 804/1687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:45 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1276 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:45.803841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-11", "block_migration": "auto"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:45.812392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:45.826433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.828593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.831091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.832190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:45.833626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:45.835830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.912348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'flavor' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:32:45.946282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Going to try to live migrate instance to n-h2-852771-11 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:32:46.033041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:46.041612 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45e3236f-33e8-4985-9c64-50c0b23151dc tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1209 microversion: 2.1 time: 0.481151 Aug 30 17:32:46.059504 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 884/1688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:45 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1209 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:46.066975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1088469438", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "073179a6-73b9-4303-9bdd-02f790e167db"}], "security_groups": [{"name": "tempest-securitygroup--1265109430"}], "key_name": "tempest-keypair-1504879311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:46.783971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] validate_networks() for [('073179a6-73b9-4303-9bdd-02f790e167db', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:32:47.622827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:49.336400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:49.929565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for project ab904bdc06b24b34ac4b151b44bb6944. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:49.948629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for user 19e96a97ef7748f99a0a71e456c91276 and project ab904bdc06b24b34ac4b151b44bb6944. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:49.978838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:49.979658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:49.980910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:49.983778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:49.987954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:50.018248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.020417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.023440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.024470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.025101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.025701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.071392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for project ab904bdc06b24b34ac4b151b44bb6944. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:50.074304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:50.086254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Getting quotas for user 19e96a97ef7748f99a0a71e456c91276 and project ab904bdc06b24b34ac4b151b44bb6944. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:50.137872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:50.140682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:50.284653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-072de2b5-2361-4b65-9096-52ba03853a81 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.219834 Aug 30 17:32:50.286099 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 885/1689] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 4226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:50.311364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78219a55-3715-4a35-b3a4-582e57bdd427 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dccee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:50.380493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aeb1326f-4155-475f-9ef1-ac6cf0521324 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157/action" status: 202 len: 0 microversion: 2.25 time: 4.590871 Aug 30 17:32:50.382326 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 805/1690] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:32:45 2022] POST /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157/action => generated 0 bytes in 4593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:50.391504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cc3a94-89e3-47f4-abf9-1a017048ffab", "name": "network-vif-deleted", "tag": "36ea0451-277f-43c7-9424-6a07459e02c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:50.430377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.431139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.434789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.450992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78219a55-3715-4a35-b3a4-582e57bdd427 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.163219 Aug 30 17:32:50.456722 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 886/1691] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:50 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:50.493046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:50.493811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] [instance: e5cc3a94-89e3-47f4-abf9-1a017048ffab] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:50.525633 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] Creating event network-vif-deleted:36ea0451-277f-43c7-9424-6a07459e02c7 for instance e5cc3a94-89e3-47f4-abf9-1a017048ffab on n-h1-852771-11 Aug 30 17:32:50.534606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.535111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.535581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.543430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.559679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.563450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.574865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-041c8f12-ed75-44ca-8b2d-b49b7253bf51 req-8515d48a-3f67-4a12-be1e-9b72fffa53f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184711 Aug 30 17:32:50.578396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 806/1692] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:50.602525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:50.625664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:50.653846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] HTTP exception thrown: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. Aug 30 17:32:50.655735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Request method failure captured: Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab HTTP/1.1 Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkhf4C4C5v8YPtDP7220CnYUGY3HgwtXpMhZlQjEW89YgoJwJ7ZSx4bGNezbEWs3ajmGtHBdLQyT5fTcj4Y2pkQHEp1lEWsB6iqAm35OOX38Pxg4lLKjTUQX0mZquWfvgXeHpfPAYZr9m-ioP9waunHpkdyzmMjx9A5Vx2W9PCUtpaY Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:32:50.658719 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8309c74c20234daf928cb7048270089f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8309c74c20234daf928cb7048270089f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8309c74c20234daf928cb7048270089f"}]}] Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8309c74c20234daf928cb7048270089f Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MigrationsAdminTest-451543109 Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 976b33387d4c4e0b82cc73c4caf91346 Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MigrationsAdminTest-451543109-project Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. Aug 30 17:32:50.660511 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e5cc3a94-89e3-47f4-abf9-1a017048ffab'} Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:50.661501 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. Aug 30 17:32:50.663071 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:32:50.667075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.672743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.673444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] Returning 404 to user: Instance e5cc3a94-89e3-47f4-abf9-1a017048ffab could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:50.674570 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fc724cc-a9bc-482d-afc2-e4a01d497df7 tempest-MigrationsAdminTest-451543109 tempest-MigrationsAdminTest-451543109-project] 10.222.0.50 "GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab" status: 404 len: 111 microversion: 2.1 time: 0.216784 Aug 30 17:32:50.675716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.676354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.683011 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 887/1693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:50 2022] GET /compute/v2.1/servers/e5cc3a94-89e3-47f4-abf9-1a017048ffab => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:50.684004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.702557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:50.703178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:50.751258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.751780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.752221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.762322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.764563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.766601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:51.507429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:51.536527 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a676a177-54d1-444e-abd8-47724db108c6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.952078 Aug 30 17:32:51.539267 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 807/1694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:50 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:51.559472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-plugged", "status": "completed", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:51.620117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:51.620735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:51.623571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:51.688934 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] Creating event network-vif-plugged:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:32:51.720060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f2f20f3c-1cb3-44bc-9e99-4e35c3fdc5a6 req-4b623fbf-afe9-4a7e-989a-fa7b4b6e710b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178239 Aug 30 17:32:51.736514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 808/1695] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:51.752604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3898b1d1-8da4-4809-8fbc-7d5eb9c0707a", "tag": "33b61bb2-9024-4dbd-8dcc-c2e478e0745e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:51.811385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:51.812255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:51.818726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:51.851056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] Creating event network-changed:33b61bb2-9024-4dbd-8dcc-c2e478e0745e for instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a on n-h1-852771-11 Aug 30 17:32:51.860861 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ae7a0589-bebe-40a8-af31-d6a94d4bb1c4 req-56c9a300-165f-4fe1-a24d-34b623a5037b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122398 Aug 30 17:32:51.862107 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 809/1696] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:51.870619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:51.874593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:51.899915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:51.900736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:51.901369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:51.902895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:51.904483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:51.908026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.045301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.059585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3b19067-b977-4b9c-a447-a0f2e7e8fa4e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1209 microversion: 2.1 time: 1.373422 Aug 30 17:32:52.064208 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 888/1697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:50 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1209 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:52.072525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:52.076169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:52.098766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.099746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.104112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.105352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.106052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.106827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.128068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.140926 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3623151-fe53-4a5b-b6e6-0d32bb093312 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1266 microversion: 2.1 time: 0.277409 Aug 30 17:32:52.163027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 810/1698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:51 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:52.183885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bf96a05-94ec-4e60-9e26-74796995160a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc5aee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:52.294905 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6bf96a05-94ec-4e60-9e26-74796995160a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.121145 Aug 30 17:32:52.303210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 811/1699] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:52 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:52.560600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:52.561365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:52.570757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.573119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.574604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.575945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.576692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.577277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.790939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.806409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.815203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.818773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-988d181c-4e0a-4eac-9f1a-ab9a3229a834 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 0.753293 Aug 30 17:32:52.823405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 889/1700] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:52 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:52.892910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1e958-79f8-4165-82b0-4e62d28b2d65", "tag": "64d4e4fe-cbb4-47ba-9da4-c572ab158f95"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:52.926350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.931429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.932149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.969598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] Creating event network-changed:64d4e4fe-cbb4-47ba-9da4-c572ab158f95 for instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 on n-h2-852771-11 Aug 30 17:32:52.981132 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4eb3ded0-5073-469a-a783-602f57364069 req-17fff055-79c7-4eba-a5a8-68a431b7cacb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095718 Aug 30 17:32:52.985707 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 890/1701] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:53.093181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:53.096316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:53.147400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:53.148368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:53.149027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:53.150717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:53.152320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:53.152985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.156940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:54.173974 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-80b35060-78b2-43b9-89c8-eacdad241cc6 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 1.618386 Aug 30 17:32:54.187261 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 812/1702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:52 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:54.191421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:54.192506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:54.217318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.217812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.219418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.220606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.221059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.222341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.550924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:54.566357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23f1ca3c-944b-4cf9-b77d-1c62a8b5f6d3 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1209 microversion: 2.1 time: 1.475907 Aug 30 17:32:54.569791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 891/1703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:53 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1209 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:54.613558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5ef89a9-d317-4de5-adc6-dee583015a37 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dccee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:54.649898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:54.669824 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4082a290-971b-462e-8f6e-bb2e376c2428 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1328 microversion: 2.1 time: 0.492697 Aug 30 17:32:54.674149 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 813/1704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:54 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1328 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:54.694445 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5ef89a9-d317-4de5-adc6-dee583015a37 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.123173 Aug 30 17:32:54.695338 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 892/1705] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:54 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:54.712062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:54.718501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:54.753296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.753795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.754449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.755361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.755852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.758465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.195741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:55.196358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:55.216165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.216669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.217111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.217829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.218281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.218804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.751620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:55.761537 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eff7d192-8986-4309-85a5-3c67c514a065 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.570032 Aug 30 17:32:55.775280 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 893/1706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:55 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:55.781210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:55.782147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:55.788511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.789325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.789986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.795427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.796322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.798155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.061917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.077508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.079216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.082565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-486e1546-7a24-4868-9936-65877da91cee tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 1.403422 Aug 30 17:32:56.101494 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 814/1707] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:54 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:32:56.109002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:56.114094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:56.135416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.136750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.137422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.138343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.138985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.139621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.151427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:56.248585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.258770 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-711f050e-a3b2-4a67-b210-52e8794d529a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1328 microversion: 2.1 time: 0.153863 Aug 30 17:32:56.259186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.267715 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 815/1708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:56 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:56.272609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1e3b3a2e-208e-4708-8647-f35a698721e4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cca60d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:56.281711 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3ffc859-ddce-4852-9c77-33acfb353fb6 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.504869 Aug 30 17:32:56.282407 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 894/1709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:55 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:56.362118 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1e3b3a2e-208e-4708-8647-f35a698721e4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.093023 Aug 30 17:32:56.363195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 816/1710] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:56 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:56.782971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:56.783618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:56.795511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.796143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.796471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.797226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.799116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.799628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.108098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:57.108985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:57.119905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.123642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.124190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.125184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.126519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.127419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.329638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:57.346095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa3e497b-827a-49a6-87aa-0a72cb1a4140 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.566985 Aug 30 17:32:57.367690 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 895/1711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:56 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:57.373502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5f232c-737e-4544-bf65-ca0a86598157", "name": "network-vif-unplugged", "status": "completed", "tag": "2e7a491d-2d06-4f61-ba6c-9e4bb543ad18"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:57.396434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.397206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.397806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.403374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:57.418524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] Creating event network-vif-unplugged:2e7a491d-2d06-4f61-ba6c-9e4bb543ad18 for instance 6c5f232c-737e-4544-bf65-ca0a86598157 on n-h1-852771-11 Aug 30 17:32:57.427611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5d8efab0-619d-4149-8f6f-aaa5c4506333 req-a2a67353-b914-48cc-8e5a-fb202df22a06 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056483 Aug 30 17:32:57.429348 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 896/1712] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:57.439050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:57.440567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:57.447792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.449099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.449852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.450760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.451385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.452018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.846564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:57.856850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f25df549-89d2-4b7a-ad4d-865abbbd5e0f tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1328 microversion: 2.1 time: 0.425808 Aug 30 17:32:57.867276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 897/1713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:57 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:57.900142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:57.901254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:57.920270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.924612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.928257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.931382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.939724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.940517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.334069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:58.363537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:58.367510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:58.368428 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e0e6199-333e-46ea-b905-4debfcb3c759 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 1.265140 Aug 30 17:32:58.369001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 817/1714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:57 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:32:58.402553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d318ae4d-b56d-460b-b9b1-0bea85242c2f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd6e040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:58.480234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d318ae4d-b56d-460b-b9b1-0bea85242c2f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.109251 Aug 30 17:32:58.481179 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 818/1715] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:58 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:58.502307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:58.503417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:58.504400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:58.516437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:58.525862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08f13180-a5e1-4254-abd5-816d97447d18 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.649278 Aug 30 17:32:58.527013 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 898/1716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:57 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:58.529002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:58.529506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:58.533362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.534186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:58.534856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:58.535348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.895516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:58.896288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:58.945773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:58.962752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:58.966172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.968185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:58.973056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:58.973732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.591579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:59.617431 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5c12263-69ce-42d1-af61-4e2624159e3c tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.726167 Aug 30 17:32:59.632370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 899/1717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:58 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:59.646325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:59.649894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:59.659129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.659926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.660786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.663952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.664617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.665259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.816745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:59.827641 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f81e1d3-ca3a-4acc-8c30-f26540c4a754 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 1.344443 Aug 30 17:32:59.833469 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 819/1718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:58 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:59.851712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-38b82b22-c9dc-49fa-a046-b7af872504dd tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cca63a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:59.931039 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-38b82b22-c9dc-49fa-a046-b7af872504dd tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.091909 Aug 30 17:32:59.932278 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 820/1719] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:32:59 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:59.954263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:59.955310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:59.968947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.969434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.970906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.971680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.972141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.972574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.039821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.052863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.056456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.059242 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1940bac2-e651-4108-92d8-787f6ba28792 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 0.424211 Aug 30 17:33:00.060915 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 900/1720] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:32:59 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:00.065613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:00.118319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=26 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:00.346147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99238e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:00.458301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.459517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.461484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.462543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.463222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.465063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.552665 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9aac4901-8f9f-4e99-8ebf-50599127099a tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c" status: 200 len: 148 microversion: 2.57 time: 0.488554 Aug 30 17:33:00.555355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 901/1721] 10.222.0.50 () {62 vars in 1303 bytes} [Tue Aug 30 17:33:00 2022] PUT /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c => generated 148 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:00.568234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5f232c-737e-4544-bf65-ca0a86598157", "tag": "2e7a491d-2d06-4f61-ba6c-9e4bb543ad18"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:00.609545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.610891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.611978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.644358 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] Creating event network-changed:2e7a491d-2d06-4f61-ba6c-9e4bb543ad18 for instance 6c5f232c-737e-4544-bf65-ca0a86598157 on n-h1-852771-11 Aug 30 17:33:00.657224 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5141e811-88bd-44ec-83f4-157f8430bb62 req-414265e2-f27f-42e4-80eb-dd1660b0f549 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099861 Aug 30 17:33:00.658357 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 902/1722] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:00.664676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Calling method '.version_select at 0x7f2d9cda8310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:00.739059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.747589 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-694a6d3f-f29a-4b70-a559-af74dc306bee tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.813326 Aug 30 17:33:00.760100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.761268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.762307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.764721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 821/1723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:59 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:00.765131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.765977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.766727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.769543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:00.780395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:00.786617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.787104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.787566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.788276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.795389 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d33c67e-c021-42c6-b838-d208116ef119 tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c/detail" status: 200 len: 463 microversion: 2.57 time: 0.135005 Aug 30 17:33:00.796939 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 903/1724] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 30 17:33:00 2022] GET /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c/detail => generated 463 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:00.799805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.800530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.939883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1302702218", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "3fe8a62b-b271-49fd-8999-906f2116a7d7"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:01.056086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] validate_networks() for [('3fe8a62b-b271-49fd-8999-906f2116a7d7', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:01.599296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:01.607515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c1c33fa3-ab5e-4cd4-bf56-7b9250f65d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.841612 Aug 30 17:33:01.622618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 822/1725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:00 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:01.632641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:01.637182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:01.669870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:01.670585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:01.679380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:01.680392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:01.680891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:01.681358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.318886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:02.330009 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb25c47d-c120-4ead-b5dd-09dc9d3c1d3a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.705805 Aug 30 17:33:02.330663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 823/1726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:01 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:02.348293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09a84846-8044-42d1-8881-b6e5dfc945e4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98d0fca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:02.407441 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09a84846-8044-42d1-8881-b6e5dfc945e4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.075084 Aug 30 17:33:02.408857 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 824/1727] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:02 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:02.414454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:02.415379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:02.424751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:02.427971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:02.428655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.429827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:02.430291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:02.430720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.882117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:02.883290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:02.884062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:02.884756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:02.885499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:02.900733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:02.905660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:02.906284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:02.906837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.907755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:02.909496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:02.910552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:02.910950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:02.911455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.912162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e378056-6c5a-48be-9b02-80752ec73b04 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 0.502072 Aug 30 17:33:02.935566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 825/1728] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:02 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:02.946467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9cdc29d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:02.955719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:02.969233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for user e81a00b7d1af419b8dadb0f1187ad4b7 and project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:03.029902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:03.042899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:03.117800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.119585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.124648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.125761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.126458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.127227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.193758 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d51e7fc3-3ebe-4eba-8484-fb5f7a882cea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.395390 Aug 30 17:33:03.202864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 904/1729] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:03.207801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:03.212942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:03.228004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.231812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.233382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.234437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.236013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.237251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.243876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.246907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.247698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.251368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.252049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.252683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.386251 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66281edb-f2b7-4d5d-b70c-e968dc064bcf tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c?user_id=76a465ee8a6741529400e977e75b3799" status: 200 len: 148 microversion: 2.57 time: 0.449263 Aug 30 17:33:03.392873 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 826/1730] 10.222.0.50 () {62 vars in 1384 bytes} [Tue Aug 30 17:33:02 2022] PUT /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c?user_id=76a465ee8a6741529400e977e75b3799 => generated 148 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:03.471626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-763aeccb-cd4c-4747-aa33-4eab47543c85 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d986d5310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-777504295", "description": "tempest-description-494371249"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:03.672249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:03.685306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e28f051-8b86-40c8-be6b-9d687dd9ae59 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.478846 Aug 30 17:33:03.688510 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 905/1731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:03 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:03.699794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:03.700834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:03.717847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.719948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.720764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.722543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.723844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.726464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.811240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-763aeccb-cd4c-4747-aa33-4eab47543c85 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.416830 Aug 30 17:33:03.812454 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 827/1732] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:03.817704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4e35d-5257-4de7-9113-1ede40fa41b8", "tag": "6cce652b-7ed1-42af-b33e-7ddfcc1668b1"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:03.831377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:03.832157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:03.832850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:03.846948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] Creating event network-changed:6cce652b-7ed1-42af-b33e-7ddfcc1668b1 for instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 on n-h2-852771-11 Aug 30 17:33:03.855255 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-85a35ebe-7d5a-451c-8927-2425e5af2899 req-8bda19ea-e083-4b2b-af66-496d54d624ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040851 Aug 30 17:33:03.859873 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 828/1733] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:03.873433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4eb45ddd-73eb-47f2-aede-80e3d8b30a20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:03.877993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4eb45ddd-73eb-47f2-aede-80e3d8b30a20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:04.004581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:04.018946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4eb45ddd-73eb-47f2-aede-80e3d8b30a20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:04.028939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0333a15c-3861-44b8-8aef-339b4df07194 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.338110 Aug 30 17:33:04.049705 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4eb45ddd-73eb-47f2-aede-80e3d8b30a20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1225 microversion: 2.1 time: 0.187914 Aug 30 17:33:04.055078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 829/1734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:03 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:04.066713 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 906/1735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:03 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:04.069844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:04.071087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:04.095924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:04.100955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:04.101432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d11ba820-b6af-492d-8857-bcb44cbe46db tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] Calling method '.version_select at 0x7f2d9cd33e50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:04.102992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:04.106064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:04.107826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:04.110504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:04.340272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d11ba820-b6af-492d-8857-bcb44cbe46db tempest-QuotasAdminTestV257-1404728199 tempest-QuotasAdminTestV257-1404728199-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c?user_id=76a465ee8a6741529400e977e75b3799" status: 200 len: 190 microversion: 2.57 time: 0.269180 Aug 30 17:33:04.353062 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 907/1736] 10.222.0.50 () {60 vars in 1364 bytes} [Tue Aug 30 17:33:04 2022] GET /compute/v2.1/os-quota-sets/6e93a0aa80634a548f5c7f183d00634c?user_id=76a465ee8a6741529400e977e75b3799 => generated 190 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:04.385986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-337f0dee-4b48-4926-9648-aa65889fdc58 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd3b310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:04.573637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:04.586521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4df81e32-a265-4dad-9a15-4e9b98012275 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.529247 Aug 30 17:33:04.588328 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 830/1737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:04 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:04.605868 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-337f0dee-4b48-4926-9648-aa65889fdc58 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.249557 Aug 30 17:33:04.609118 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 908/1738] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:04 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:04.633218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:04.636304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:04.639288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-973a6bea-d155-46d8-ada4-b266c9276740 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d986d5280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1614776120", "description": "tempest-description-1221644242"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:04.656232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:04.663135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:04.664701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:04.667540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:04.673386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:04.674770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:05.132151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-973a6bea-d155-46d8-ada4-b266c9276740 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.528144 Aug 30 17:33:05.133319 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 831/1739] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:05.138832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:05.139764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:05.186415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:05.187076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:05.197227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:05.199521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:05.201399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:05.213035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:05.573424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:05.606736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:05.611668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:05.613485 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-279b2a1f-3a01-4010-9af6-dd4c0a10926c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 1.002266 Aug 30 17:33:05.623104 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 909/1740] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:04 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:05.629509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:05.630336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:05.645034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:05.645871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:05.647626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:05.654593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:05.655376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:05.656084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:06.017888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:06.036072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca0d59c2-03a7-456f-8f1f-b44d439574ae tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.411256 Aug 30 17:33:06.053050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 910/1741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:05 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:06.060608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:06.061632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:06.069929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:06.070733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:06.071585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:06.072686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:06.073385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:06.073972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:06.277722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:06.289623 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ca1c1c9-41bc-413b-8343-a9c6f20e2050 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1277 microversion: 2.1 time: 0.234937 Aug 30 17:33:06.290506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 911/1742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:06 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:06.308345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-697606905", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "10cf8f84-a1c9-4ce9-bfa7-d94e61d6a40b"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:06.439630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] validate_networks() for [('10cf8f84-a1c9-4ce9-bfa7-d94e61d6a40b', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:06.512949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:06.522505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6c094c0-4851-4af7-b134-6600b7f54206 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 1.387816 Aug 30 17:33:06.536274 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 832/1743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:05 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:06.561407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:06.562038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:06.586145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:06.588067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:06.588737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:06.590675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:06.598487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:06.599216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:07.444670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:07.462116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c72bd712-422e-4a00-ad05-d771001bd555 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.910633 Aug 30 17:33:07.462772 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 833/1744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:06 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:07.496300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-edad2fbc-15d8-4542-a63f-42c80e959548 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc690d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:07.564436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-edad2fbc-15d8-4542-a63f-42c80e959548 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.081469 Aug 30 17:33:07.565749 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 834/1745] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:07 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:07.571796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1e958-79f8-4165-82b0-4e62d28b2d65", "name": "network-vif-plugged", "status": "completed", "tag": "64d4e4fe-cbb4-47ba-9da4-c572ab158f95"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:07.587852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:07.589313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:07.589929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:07.603506 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] Creating event network-vif-plugged:64d4e4fe-cbb4-47ba-9da4-c572ab158f95 for instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 on n-h2-852771-11 Aug 30 17:33:07.616023 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3e9af81a-3a40-4e16-b366-141c6559da5b req-a73e0558-8523-4378-bf2f-2e93baa476bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048311 Aug 30 17:33:07.634241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 835/1746] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:07.642218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:07.643185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:07.654817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:07.655791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:07.656405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:07.657282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:07.658100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:07.658734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.200132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:08.221108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:08.224114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:08.236938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0da4cd5-1c6b-45b3-b1f0-27e33a45407e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1567 microversion: 2.25 time: 0.600417 Aug 30 17:33:08.237741 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 836/1747] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:07 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1567 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:08.242092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:08.242692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:08.273616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.274463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.276556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.279028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.280154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.283726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.373148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:08.373661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:08.374042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:08.374453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:08.374874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:08.398078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.399259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.399895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.401470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.402135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.402758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.447305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Getting quotas for project 8a152d89d8c448c590cd4d7e885c7c44. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:08.463364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Getting quotas for user 132cb6854f064d2e8b8193de1c7d5861 and project 8a152d89d8c448c590cd4d7e885c7c44. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:08.489358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:08.506087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:08.508332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:08.622887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-740e6f35-9161-4166-aca4-72dc10eede68 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328799 Aug 30 17:33:08.624246 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 912/1748] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:08.636247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:08.639990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:08.652804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.653313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.653763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.654517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.654979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.659151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.722917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:08.732440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-accca7e2-4694-4765-9fe9-3704873c91b5 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.493832 Aug 30 17:33:08.754154 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 837/1749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:08 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:08.761227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:08.761842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:08.804691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.805297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.805741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.806475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:08.806922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:08.809171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:08.960242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:08.969022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ab130fd-0ab0-46c2-a787-e6da0ef2f7ae tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.342219 Aug 30 17:33:08.976420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 913/1750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:08 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:08.995464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:08.997023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:09.020633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.030283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.032312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.034541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.037949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.039948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.403984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.436175 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-620a1ed2-b78c-4070-a3b2-4cf46c19a8bb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.680560 Aug 30 17:33:09.448007 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 838/1751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:08 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:09.468083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25fca3d5-fa3e-4245-bee5-7418652a67fb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd803a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:09.533705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.543433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23ace1b1-b905-45c9-b128-7df92607f1bf tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1318 microversion: 2.1 time: 0.563802 Aug 30 17:33:09.544257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 914/1752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:08 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:09.581150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fae1540-aaa6-48f4-9ea8-806f950a5d4f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:09.581850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fae1540-aaa6-48f4-9ea8-806f950a5d4f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:09.623609 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25fca3d5-fa3e-4245-bee5-7418652a67fb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.172211 Aug 30 17:33:09.624483 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 839/1753] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:09 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:09.638588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:09.642186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:09.670955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.672375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.673048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.674114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.674738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.675375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.769022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fae1540-aaa6-48f4-9ea8-806f950a5d4f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.777443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fae1540-aaa6-48f4-9ea8-806f950a5d4f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1215 microversion: 2.1 time: 0.205620 Aug 30 17:33:09.781587 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 915/1754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:09 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:09.787457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3898b1d1-8da4-4809-8fbc-7d5eb9c0707a", "name": "network-vif-plugged", "status": "completed", "tag": "33b61bb2-9024-4dbd-8dcc-c2e478e0745e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:09.820121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.824398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.824831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.854296 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] Creating event network-vif-plugged:33b61bb2-9024-4dbd-8dcc-c2e478e0745e for instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a on n-h1-852771-11 Aug 30 17:33:09.896037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e8dce265-5f29-4d63-8f1b-9cb5d411aed7 req-fd4fa10e-11f7-4045-911f-8687f4301105 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107211 Aug 30 17:33:09.898409 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 916/1755] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:09.917510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:09.918239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:09.940940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.948336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.949301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.950072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:09.950550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:09.950981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:09.953329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.965811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.968178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:09.968925 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b684332d-b8b3-4ce1-8bf2-8f3a4c716a4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1542 microversion: 2.25 time: 0.341220 Aug 30 17:33:09.983517 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 840/1756] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:09 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:10.001454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a69d163-17f5-442c-841e-2061d47690a8 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '.version_select at 0x7f2d9cce4160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:10.006452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a69d163-17f5-442c-841e-2061d47690a8 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.007087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a69d163-17f5-442c-841e-2061d47690a8 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.007741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a69d163-17f5-442c-841e-2061d47690a8 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.024981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a69d163-17f5-442c-841e-2061d47690a8 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2380 microversion: 2.25 time: 0.033467 Aug 30 17:33:10.030423 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 841/1757] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 30 17:33:09 2022] GET /compute/v2.1/os-migrations => generated 2380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:10.037023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:10.038055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:10.045295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.046206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.046893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.047882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.048582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.049216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.396242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:10.397705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:10.405609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:10.423137 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87e4d1e7-dd2e-402a-bcda-80acd2d66612 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.390762 Aug 30 17:33:10.433144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa5892a4-9e78-46f7-9882-3715b5864269 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.531770 Aug 30 17:33:10.442173 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 917/1758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:09 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:10.443350 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 842/1759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:10 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:10.467554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:10.467554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:10.483333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:10.484177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:10.494299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.495136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.495312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.496297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.497196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.498164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.499312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.518659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.522221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.523194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.524913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.527170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.841798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:33:10.862858 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11f71273-f78e-41d5-bf15-2e80160e3143 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 2036 microversion: 2.25 time: 0.417498 Aug 30 17:33:10.863826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 843/1760] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:10 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 2036 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:10.870284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:10.871197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:10.879147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.880161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.881457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.882990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:10.884186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:10.885740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:10.907334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:10.922813 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a6ffb51-2a03-43fd-9ba3-3124cd74a8f0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1197 microversion: 2.1 time: 0.449719 Aug 30 17:33:10.925025 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 918/1761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:10 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1197 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:10.943587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a30e255-7272-4613-acf0-01b9116555ea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd93790>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:11.002690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a30e255-7272-4613-acf0-01b9116555ea tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1452 microversion: 2.1 time: 0.075965 Aug 30 17:33:11.003421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 919/1762] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:10 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:11.018619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73364f13-0808-4670-9ac4-9ba19b74df5b", "tag": "7a0ab5b7-fd3f-462c-a165-2ecab2f435e9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:11.040548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.041052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.042082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.069565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] Creating event network-changed:7a0ab5b7-fd3f-462c-a165-2ecab2f435e9 for instance 73364f13-0808-4670-9ac4-9ba19b74df5b on n-h1-852771-11 Aug 30 17:33:11.087969 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cb17701f-810f-4d9b-89f4-f512cd78239b req-158e7b24-c271-4441-bfa5-68a83bcf1506 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080232 Aug 30 17:33:11.089775 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 920/1763] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:11.100209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:11.103471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:11.112271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.113160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.113808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.114896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.115753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.118731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.129013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:11.143812 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ba203284-4755-4717-8aed-58b9e1a34946 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1507 microversion: 2.1 time: 0.278059 Aug 30 17:33:11.147151 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 844/1764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:10 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:11.170977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae33140d-155e-48b5-a74e-6b1a477c428e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: .version_select at 0x7f2d9cd02160>, body: {"keypair": {"name": "tempest-keypair-900656860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlIQS/11d90n7dkoDKaXL+9PRXminhwDhW8ZSkQh0nCIT4zokPTe8mISJ9UPAlLAfgJ6mnXNPZ7hK0ikf3GHNlKgJ4GaMvt4Dyr/KLv/IeAdeJ9cEGZ2gLUYJreDvnFxw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:11.201664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ae33140d-155e-48b5-a74e-6b1a477c428e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:11.209741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ae33140d-155e-48b5-a74e-6b1a477c428e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for user 859d8e930c434d519e4208e58246b471 and project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:11.278956 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae33140d-155e-48b5-a74e-6b1a477c428e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.126730 Aug 30 17:33:11.283864 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 845/1765] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:33:11.306267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:11.309231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:11.322959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.323594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.324054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.324763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.325216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.325647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.410671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:11.422695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fdff53c-548b-4133-80ec-7f62d532e317 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1267 microversion: 2.1 time: 0.331416 Aug 30 17:33:11.429581 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 921/1766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:11 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:11.461872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:11.462775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:11.477409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.488197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.489380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.490347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.496132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.498368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.508255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:11.838777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:11.852883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df32f520-3158-42d4-9a2a-67e6d44e139d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1507 microversion: 2.1 time: 0.567855 Aug 30 17:33:11.856528 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 846/1767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:11 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:11.878742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:11.887783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:11.889983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:11.901128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d6934268-9c72-4eca-89b4-adc3d99c8322 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.450508 Aug 30 17:33:11.902309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 922/1768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:11 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:11.909994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:11.913484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:11.917068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.920269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.920732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.927285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.928024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.928396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.929273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.929396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.930751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:11.931720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:11.933303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:11.933934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.127152 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5affb7a1-fc43-451d-94ad-c4b0abb6b13c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "PUT /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1079 microversion: 2.1 time: 0.221881 Aug 30 17:33:12.141257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 923/1769] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:33:11 2022] PUT /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1079 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.147350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4e35d-5257-4de7-9113-1ede40fa41b8", "name": "network-vif-plugged", "status": "completed", "tag": "6cce652b-7ed1-42af-b33e-7ddfcc1668b1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:12.158753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.159496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.160232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.174496 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] Creating event network-vif-plugged:6cce652b-7ed1-42af-b33e-7ddfcc1668b1 for instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 on n-h2-852771-11 Aug 30 17:33:12.180491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-eae1e83e-da80-4457-af91-f422b02cbb13 req-0a426e71-03d0-4c41-903f-41d68776971e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Aug 30 17:33:12.181738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 924/1770] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:12.189782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:12.190780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:12.197498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.199123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.199864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.200864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.201525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.202191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.346785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:12.360503 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d299b272-54c9-4f04-95e5-9f98b6b5cfb4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1396 microversion: 2.1 time: 0.502111 Aug 30 17:33:12.361275 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 847/1771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:11 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1396 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.366385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c36d515e-7857-4978-a577-5976f8a6d2cf tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd07dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:12.437856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:12.451265 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99bdf743-0630-4a10-aedc-bd05fb93335c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1381 microversion: 2.1 time: 0.267147 Aug 30 17:33:12.464278 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c36d515e-7857-4978-a577-5976f8a6d2cf tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1461 microversion: 2.1 time: 0.095103 Aug 30 17:33:12.464278 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 848/1772] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1461 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.466275 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 925/1773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1381 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.479554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:12.481809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:12.482565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:12.483870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:12.497341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.498121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.498786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.499784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.500543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.501193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.503130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.503671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.504115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.504834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:12.505282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:12.509054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:12.589581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:12.598636 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca4b487b-b4a5-4371-8921-e2cd1d425330 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1273 microversion: 2.1 time: 0.125885 Aug 30 17:33:12.599749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 926/1774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.856768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:12.865189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a67494ab-4f93-4039-b010-6c31a48c500f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1505 microversion: 2.1 time: 0.402329 Aug 30 17:33:12.866845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 849/1775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:12.889451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-38092c56-5150-4a11-82e6-9f3f7935ab74 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc38310>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:12.958493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-38092c56-5150-4a11-82e6-9f3f7935ab74 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 200 len: 1461 microversion: 2.1 time: 0.090297 Aug 30 17:33:12.960400 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 850/1776] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:13.055656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:13.056619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:13.081895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.082665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.083293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:13.084214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.084676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.085115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:13.167045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74e7819c-9558-4bd5-93d3-33b7b97ef2f3 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] Action: 'create', calling method: .version_select at 0x7f2d9cd02670>, body: {"security_group": {"name": "tempest-securitygroup-64777690", "description": "tempest-description-475255589"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:13.265038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:13.451246 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3076bc48-d046-4402-b404-e11a2810caa4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1534 microversion: 2.1 time: 0.847991 Aug 30 17:33:13.453386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 927/1777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:12 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1534 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:13.463767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:13.465077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:13.473614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.474172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.474618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:13.476115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.476789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.477455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:13.798235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:13.809475 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-083a94fa-9bdd-45a6-acdb-2ade519d7549 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1505 microversion: 2.1 time: 0.354248 Aug 30 17:33:13.813193 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 928/1778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:13 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:13.818598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:13.819564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:13.831110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.831650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.832536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:13.833284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:13.833758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:13.834173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.127471 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74e7819c-9558-4bd5-93d3-33b7b97ef2f3 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.164594 Aug 30 17:33:14.128948 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 851/1779] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:12 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:14.152410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:14.153462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.171704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.172207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.172648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.173405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.173861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.176580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.383290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:14.395715 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a6906cee-1cf8-42d0-8c6e-35f684f21504 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1468 microversion: 2.1 time: 0.252345 Aug 30 17:33:14.396898 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 852/1780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:14 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1468 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:14.403675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:14.404676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.413449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.414506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.415188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.418146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.419097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.419557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.464782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:14.478169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37b6956e-b3a9-46d6-b6fc-c934d899b6a2 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.663213 Aug 30 17:33:14.478999 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 929/1781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:13 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:14.500282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:14.500984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.507626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.508111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.508543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.509236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.510598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.511229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.663279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:14.671409 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f4a5d8a-873e-4d70-83ed-47fafb708cf7 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1576 microversion: 2.1 time: 0.273311 Aug 30 17:33:14.683723 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 853/1782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:14 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1576 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:14.683723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:14.683723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.694202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.694836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.695378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.696212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.696736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.697260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.790662 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fac417e2-9403-4ab9-bddb-6f8699425e7a tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1534 microversion: 2.1 time: 0.310140 Aug 30 17:33:14.791934 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 930/1783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:14 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1534 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:14.797449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:14.800305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.807911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.808787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.809461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.810889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.811426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.812050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.906639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:14.907067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:14.907590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:14.907999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:14.908411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:14.979455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:14.983983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:14.990022 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1aeee453-41de-4887-a2b6-a2907b7f21f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.316658 Aug 30 17:33:14.994632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.995661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.996520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:14.997964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:14.998993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:14.999898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.004348 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 854/1784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:14 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:15.009470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65305f54-a137-4f02-9894-d6790963e54b tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] Action: 'create', calling method: .version_select at 0x7f2d9cca6f70>, body: {"security_group": {"name": "tempest-securitygroup-1777766372", "description": "tempest-description-2108642726"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:15.045700 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2172eff-2c2d-4494-b204-9a45d11ce737 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "POST /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65/action" status: 202 len: 1111 microversion: 2.1 time: 0.251553 Aug 30 17:33:15.046610 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 931/1785] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:14 2022] POST /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65/action => generated 1111 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 17:33:15.051844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f7cb06-6bca-40c3-b2f6-1c07eae493bd", "tag": "9da007b3-7d71-47af-9e7a-f72289b2a381"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:15.061675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.062116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.062549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.074878 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] Creating event network-changed:9da007b3-7d71-47af-9e7a-f72289b2a381 for instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd on n-h2-852771-11 Aug 30 17:33:15.079814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-db998ab7-b23d-4227-b8a3-f3f2f7197f5f req-7dae00e9-24ed-439f-9c27-a76e6c6e6fa2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Aug 30 17:33:15.080738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 932/1786] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:15.086494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-605344005"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:15.088867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:15.095088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.095608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.096047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.096749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.097225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.097614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.196894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65305f54-a137-4f02-9894-d6790963e54b tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.191152 Aug 30 17:33:15.206512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 855/1787] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:15.211642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:15.212131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:15.220006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.220678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.221202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.222048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.222683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.223197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.300173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7da60d6-61cb-4156-a6ce-eff01482a8c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "POST /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e/action" status: 202 len: 0 microversion: 2.1 time: 0.218080 Aug 30 17:33:15.300870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 933/1788] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:15 2022] POST /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:33:15.305676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:15.306027 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-202d9724-7720-46eb-90c4-c6cb0dedd971 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098173 Aug 30 17:33:15.306657 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 856/1789] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:33:15 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:15.310009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.310492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.310931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.311718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.312174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.312488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1270326519", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "217d0c94-8215-478d-a8e4-3bc0b700061c"}], "security_groups": [{"name": "tempest-securitygroup--1150011242"}], "key_name": "tempest-keypair-900656860", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:15.312618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.338535 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-311cfab8-f28a-4730-bed6-16957edc5997 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035851 Aug 30 17:33:15.339156 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 934/1790] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:33:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:15.343937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:15.344942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:15.351955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.352555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.353069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.353918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.354435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.354953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.442977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] validate_networks() for [('217d0c94-8215-478d-a8e4-3bc0b700061c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:15.604212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:15.614167 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87c20968-0ed6-44de-8108-bf041c1779c8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.273490 Aug 30 17:33:15.614596 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 935/1791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:15 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:15.679741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4cb15f7-7dd7-4ffb-9aca-14d4d0198568 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] Action: 'create', calling method: .version_select at 0x7f2d9cda8670>, body: {"security_group": {"name": "tempest-securitygroup-1826686926", "description": "tempest-description-583409106"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:15.864756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:15.865442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:15.866100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:15.866516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:15.867104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:15.879022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.880437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.881092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.882037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:15.882833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:15.883561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:15.903978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:15.910438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for user 859d8e930c434d519e4208e58246b471 and project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:15.922613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:15.928852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:15.932654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:15.991273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aedf985b-96d1-43e2-9008-e298b9ae62b4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.682692 Aug 30 17:33:16.000413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 857/1792] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:33:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:33:16.006581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c3a1c301-9455-4db2-b041-e8c2eb6ca66c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc389d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:16.081475 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c3a1c301-9455-4db2-b041-e8c2eb6ca66c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.086080 Aug 30 17:33:16.082249 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 858/1793] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:15 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:16.097354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-11", "block_migration": false, "disk_over_commit": false}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:16.100808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:16.110455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.110948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.111820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:16.112645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.113159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.114901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:16.146771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lazy-loading 'flavor' on Instance uuid 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:33:16.161767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Going to try to live migrate instance to n-h2-852771-11 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:33:16.320457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4cb15f7-7dd7-4ffb-9aca-14d4d0198568 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.704163 Aug 30 17:33:16.321039 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 936/1794] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:16.334327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:16.335174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:16.347512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.352489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.353145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:16.354090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.355534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.356977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:16.877373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:16.893574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:16.905925 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c29b4eeb-04f3-47c0-af2f-819b4bc02787 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.572802 Aug 30 17:33:16.911554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 937/1795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:16 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:16.918898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:16.920311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:16.946187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.957776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.959570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:16.963617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:16.964105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:16.964644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.075804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:17.090609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:17.092129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:17.093802 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d8e89e4-5717-47c7-9b9d-d8212b28714b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1289 microversion: 2.25 time: 0.180686 Aug 30 17:33:17.101901 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 938/1796] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:16 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1289 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:17.101901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:17.101901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:17.116310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.116798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.117228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.118155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.118611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.119083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.317894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:17.326471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aee7ec40-4c2d-4262-85a0-abd12c94fd2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.231020 Aug 30 17:33:17.327062 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 939/1797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:17 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:17.336560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3d6f1cc-69cd-4eb8-a62f-8fc3870205f6 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] Action: 'create', calling method: .version_select at 0x7f2d9cd934c0>, body: {"security_group": {"name": "tempest-securitygroup-1859100286", "description": "tempest-description-1495743926"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:17.535976 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3d6f1cc-69cd-4eb8-a62f-8fc3870205f6 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.204039 Aug 30 17:33:17.536593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 940/1798] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:17 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:17.547499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-unplugged", "status": "completed", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:17.558315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.559266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.559906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.575362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] Creating event network-vif-unplugged:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:33:17.580730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8b6f5658-d84e-4ebf-aa0b-e0c9a6503b2a req-68e8b218-e8fc-4fb0-a8ac-6235ceee6f40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042382 Aug 30 17:33:17.581529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 941/1799] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:17.589792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:17.591071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:17.598072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.598918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.599685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.600554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.601193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.601784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.718093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43e6965e-3e64-4779-86b6-8bfcb23d7d9b tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a/action" status: 202 len: 0 microversion: 2.1 time: 1.628960 Aug 30 17:33:17.719547 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 859/1800] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:16 2022] POST /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a/action => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:17.725366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:17.726292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:17.738892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.739755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.740437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.742079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.742759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.743467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.764000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:17.775373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0acbcc4-f1ee-4c3c-80e2-c4a7ab52cf21 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.192453 Aug 30 17:33:17.776219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 942/1801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:17 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:17.787325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4e35d-5257-4de7-9113-1ede40fa41b8", "tag": "6cce652b-7ed1-42af-b33e-7ddfcc1668b1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:17.800381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:17.800918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:17.801347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:17.814179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] Creating event network-changed:6cce652b-7ed1-42af-b33e-7ddfcc1668b1 for instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 on n-h2-852771-11 Aug 30 17:33:17.819370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-fc57cb0e-10ae-483a-a533-a4ff4cd9f4a2 req-87fe1400-392c-423e-8fc6-45fbf0677d76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Aug 30 17:33:17.820017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 943/1802] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:17.828870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3928d828-55f8-428d-a9b5-44cc7e346343 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dcc8b0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:17.887350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3928d828-55f8-428d-a9b5-44cc7e346343 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.062480 Aug 30 17:33:17.888533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 944/1803] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:17 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:17.893865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fde5cfa1-c18b-4645-9d16-3963b7d9d7f1 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] Calling method '.version_select at 0x7f2d9cd62160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:18.036308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:18.065762 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f170f776-1439-486d-b43e-ae3a5855a618 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1576 microversion: 2.1 time: 0.342096 Aug 30 17:33:18.067358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 860/1804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:17 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1576 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:18.087584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:18.089786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:18.105561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:18.122056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:18.123027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:18.124081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:18.128039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:18.130778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:18.590441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:18.605317 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c15dd06-0ca8-4428-be32-018ae1e10cb9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.535977 Aug 30 17:33:18.619794 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 861/1805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:18 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:18.624886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:18.634301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:18.649342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:18.649837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:18.653550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:18.654792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:18.655417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:18.658784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.057114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.064945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f98430e5-800d-4b5b-9ea3-fd7d15359826 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.443832 Aug 30 17:33:19.065533 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 862/1806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:18 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:19.078129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:19.078129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:19.078403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.078905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.080047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.081352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.082934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.084127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.213425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.222244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.224412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.225651 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75168257-9c68-4939-b6b1-7996fbbdf991 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1343 microversion: 2.25 time: 0.159205 Aug 30 17:33:19.226461 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 863/1807] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:19 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1343 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:19.240818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:19.242578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:19.251151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.251953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.252558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.265015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.267408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.268887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.273651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:19.444852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.464941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2fd9c2a-b030-4e88-aaa8-58d373582570 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.236971 Aug 30 17:33:19.465560 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 864/1808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:19 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:19.470392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:19.471005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:19.485652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.486502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.487113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.488069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.488764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.489200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.686142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:19.695227 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b190c91d-62b5-4e0a-bc3d-de972d2457d4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.228416 Aug 30 17:33:19.708697 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 865/1809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:19 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:19.716034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ede307b-952f-4008-9db1-9a4b6b18a091 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc5a820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:19.776166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ede307b-952f-4008-9db1-9a4b6b18a091 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.077558 Aug 30 17:33:19.776555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=28 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:19.778042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 866/1810] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:19 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:19.784006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73364f13-0808-4670-9ac4-9ba19b74df5b", "name": "network-vif-plugged", "status": "completed", "tag": "7a0ab5b7-fd3f-462c-a165-2ecab2f435e9"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:19.798950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.799827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.800521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.813012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] Creating event network-vif-plugged:7a0ab5b7-fd3f-462c-a165-2ecab2f435e9 for instance 73364f13-0808-4670-9ac4-9ba19b74df5b on n-h1-852771-11 Aug 30 17:33:19.818996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d89498ca-cd43-43e8-ae49-5aef03b023a4 req-5305d293-4e15-4a97-a654-7defb9c99c18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038401 Aug 30 17:33:19.819635 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 867/1811] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:19.830025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:19.830857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:19.837491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.838137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.838861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:19.839661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:19.840125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:19.840557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.073267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.081665 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17f93f26-5f97-48b8-a3c0-dfbc51cd3681 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.257747 Aug 30 17:33:20.082579 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 868/1812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:19 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:20.088172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:20.089344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:20.104133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.105822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.106278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.107201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.107799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.108327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.319467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.336053 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-995b3477-5558-454c-b071-5a8a9e548e76 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1325 microversion: 2.1 time: 0.252215 Aug 30 17:33:20.337281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 869/1813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:20 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:20.344111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:20.344849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:20.354156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.354791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.355360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.356770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.357490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.358009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.592663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.609263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.613962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.617639 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a9e63c5-b994-4baf-85d8-a6fb0971d7d6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.278217 Aug 30 17:33:20.622054 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 870/1814] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:20 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:20.629865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:20.631276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:20.668236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.669768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.670500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.676155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.677127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.679244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.940920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:20.952154 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a9f9fc77-4e0e-464c-9af1-b5b072a3c304 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.328653 Aug 30 17:33:20.960275 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 871/1815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:20 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:20.970232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:20.972270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:20.981488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.982437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.983085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:20.984032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:20.984963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:20.985616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.283525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:21.295384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99cf0b78-3089-4e61-9877-b124bfcaf4ad tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.333097 Aug 30 17:33:21.309936 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 872/1816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:20 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:21.314876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2fed75a-1a34-4804-b1be-894876462819 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9878df70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:21.410106 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2fed75a-1a34-4804-b1be-894876462819 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.098939 Aug 30 17:33:21.415572 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 873/1817] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:21 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:21.444022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:21.464111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:21.464337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:21.464748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.500825 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] Creating event network-changed:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h1-852771-11 Aug 30 17:33:21.516425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5fee5a28-9255-4e54-ad5d-c4a63e545d40 req-ef6594bf-c86e-4f99-a762-d15d8c69094c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091030 Aug 30 17:33:21.517377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 874/1818] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:21.527993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:21.528810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:21.537234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:21.538457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:21.538964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.540268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:21.540268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:21.541343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.726054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:21.738616 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1be5d2e4-75e0-49ac-ae31-7a4c1313e1e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.219723 Aug 30 17:33:21.739220 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 875/1819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:21 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:21.746669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:21.747289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:21.767789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:21.768873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:21.769524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.770441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:21.771095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:21.771758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:21.977441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fde5cfa1-c18b-4645-9d16-3963b7d9d7f1 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12747 microversion: 2.1 time: 4.087585 Aug 30 17:33:21.978939 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 945/1820] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 30 17:33:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12747 bytes in 4090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:21.985036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:21.986068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:21.993142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.000331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.002803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.003641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.004391 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d6a387b-627d-4f7f-87db-b42b0e6401eb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.260765 Aug 30 17:33:22.005370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.005564 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 876/1821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:21 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:22.007536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.011180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f7cb06-6bca-40c3-b2f6-1c07eae493bd", "name": "network-vif-plugged", "status": "completed", "tag": "9da007b3-7d71-47af-9e7a-f72289b2a381"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:22.011934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.025980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.026558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.027076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.043111 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] Creating event network-vif-plugged:9da007b3-7d71-47af-9e7a-f72289b2a381 for instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd on n-h2-852771-11 Aug 30 17:33:22.059553 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f4eff645-1334-4bda-9fb2-3d90b0b1de12 req-828e1e2d-821d-44d3-9121-31e965ecaee0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052503 Aug 30 17:33:22.060470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 877/1822] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:22.067055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:22.067806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:22.076149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.076640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.077077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.077964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.078420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.079131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.234183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.246290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.248678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.250190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8a8a11b-2c95-4d5f-a368-15aa4547ab89 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.269914 Aug 30 17:33:22.251412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 946/1823] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:21 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:22.256779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35a45e4e-d017-4ada-8dff-0b16ebedd644 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] Calling method '.version_select at 0x7f2d9cd1baf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:22.618509 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35a45e4e-d017-4ada-8dff-0b16ebedd644 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.365456 Aug 30 17:33:22.620710 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 947/1824] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 30 17:33:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:22.626104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:22.627453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:22.636919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.638099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.639126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.640400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.641650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.642933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.821070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.827133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:22.833176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d71662b-2d6e-4b9f-aa71-7180124026bc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.211269 Aug 30 17:33:22.843424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-286c8e11-54d3-4439-a959-8b6aa56abb77 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.774292 Aug 30 17:33:22.843424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 878/1825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:22 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:22.846185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 948/1826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:22 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:22.856530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:22.857184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:22.863080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eea98a6d-7ead-4588-be91-2899f6bc2cba tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd62670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:22.881142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.881633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.883066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.884058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:22.885657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:22.889582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:22.946345 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eea98a6d-7ead-4588-be91-2899f6bc2cba tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.098535 Aug 30 17:33:22.954266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 949/1827] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:22 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:22.959542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5126a8a7-0e19-4825-ab15-50ea948f778f tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] Calling method '.version_select at 0x7f2d9cd2a9d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.111063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.120712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e82b7b23-3ba0-4dde-9283-da1deb2f3ce0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.278687 Aug 30 17:33:23.131512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 879/1828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:22 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:23.131512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.131512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:23.135744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.136472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.137112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.138119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.138741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.139330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.213103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5126a8a7-0e19-4825-ab15-50ea948f778f tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3bc2f502-2597-45f4-9839-ba68c3265301" status: 202 len: 0 microversion: 2.1 time: 0.257463 Aug 30 17:33:23.214459 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 950/1829] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:22 2022] DELETE /compute/v2.1/os-security-groups/3bc2f502-2597-45f4-9839-ba68c3265301 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:23.223200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96dc3ba1-912a-41a1-b53c-7fe44d541152 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1962338970", "metadata": {"": ""}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96dc3ba1-912a-41a1-b53c-7fe44d541152 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action HTTP/1.1 Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 107 Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:23.232718 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1962338970", "metadata": {"": ""}}} Aug 30 17:33:23.234805 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1962338970', 'metadata': {'': ''}}}} Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'': ''} Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:23.235833 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.237522 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:23.239318 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:23.241451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96dc3ba1-912a-41a1-b53c-7fe44d541152 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:23.243039 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-96dc3ba1-912a-41a1-b53c-7fe44d541152 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action" status: 400 len: 170 microversion: 2.1 time: 0.023764 Aug 30 17:33:23.245709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 951/1830] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 30 17:33:23 2022] POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:33:23.257792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef5ea142-1cb2-44a1-8369-b01861241f47 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] Calling method '.version_select at 0x7f2d994d13a0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.366866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.389030 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3942d04a-d705-43fc-a1cd-a5c2310476d1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.264526 Aug 30 17:33:23.390024 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 880/1831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:23 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:23.400914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.402113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:23.419006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.419951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.420699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.421943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.422622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.430728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.645492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.656004 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-353001ec-8500-4961-9111-5baca684d80b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.264590 Aug 30 17:33:23.668951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 881/1832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:23 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:23.679792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.680563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:23.702909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.703638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.704496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.705116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.705707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.706326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.870614 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef5ea142-1cb2-44a1-8369-b01861241f47 tempest-SecurityGroupsTestAdminJSON-1510808358 tempest-SecurityGroupsTestAdminJSON-1510808358-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5b857165-959a-4d50-b359-f61999bb2aef" status: 202 len: 0 microversion: 2.1 time: 0.622140 Aug 30 17:33:23.871955 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 952/1833] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:23 2022] DELETE /compute/v2.1/os-security-groups/5b857165-959a-4d50-b359-f61999bb2aef => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:23.895149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.897022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:23.920604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.923951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.924612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.926031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.926880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.927700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.930830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.942066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.947544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:23.949022 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9f868e77-cf76-46c0-8729-b6de4044a5e7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.278848 Aug 30 17:33:23.950126 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 882/1834] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:23 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:23.955355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:23.956214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:23.972269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.972838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.973344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:23.974374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:23.975062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:23.975729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.135248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:24.152911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e1d6f14-fe00-44cf-b9fb-6b7c84cd529f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1315 microversion: 2.1 time: 0.201551 Aug 30 17:33:24.154327 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 883/1835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:23 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:24.176495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e421bd0-dc71-4ece-b02b-bca1778d4398 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] Calling method '.version_select at 0x7f2d987b5040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.380239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:24.390346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d31ca0c-69ba-4a4e-8ffa-4117e7142ac7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.508765 Aug 30 17:33:24.390846 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 953/1836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:23 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:24.398378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf98b7c4-f62f-4ef4-9c93-77651ebe637d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd2a700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.476991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e421bd0-dc71-4ece-b02b-bca1778d4398 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a92cd3c3-fba6-41d3-8312-7c48c248840f" status: 202 len: 0 microversion: 2.1 time: 0.321375 Aug 30 17:33:24.477851 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 884/1837] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:24 2022] DELETE /compute/v2.1/os-security-groups/a92cd3c3-fba6-41d3-8312-7c48c248840f => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:24.479896 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf98b7c4-f62f-4ef4-9c93-77651ebe637d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.084973 Aug 30 17:33:24.484650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a212786-ac1b-4080-aac9-1b6bcfce5f2e", "name": "network-vif-plugged", "status": "completed", "tag": "e51d53e0-2b99-48f8-a792-d2d0331a8aeb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:24.492227 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 954/1838] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:24 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:24.503127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.503783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:24.515059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.515888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.521930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.524610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.538661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.539944 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] Creating event network-vif-plugged:e51d53e0-2b99-48f8-a792-d2d0331a8aeb for instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e on n-h2-852771-11 Aug 30 17:33:24.542837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.543731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.544210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.544643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.555555 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ec92c1b1-c169-4e3c-82cb-a85855292368 req-7d12ea34-81cb-4c0a-8276-34181d98d8b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075375 Aug 30 17:33:24.557304 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 885/1839] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:24.567306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.570711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:24.578258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.578725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.579356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.581068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.581767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.582399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.606322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:24.736294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:24.746831 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da8237e7-aad3-42f7-8283-f8d97d7bfbe8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.258760 Aug 30 17:33:24.749651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 955/1840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:24 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:24.757129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8d7b0f-0992-4160-bcdc-465d707a54c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1902679282", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8d7b0f-0992-4160-bcdc-465d707a54c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action HTTP/1.1 Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 619 Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:24.762823 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:24.764802 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:33:24.765654 n-d-852771-11 devstack@n-api.service[122124]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1902679282", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 30 17:33:24.765654 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:33:24.765654 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1902679282', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 17:33:24.765941 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:24.766990 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.768458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:33:24.773135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:24.774276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b8d7b0f-0992-4160-bcdc-465d707a54c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:24.774276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b8d7b0f-0992-4160-bcdc-465d707a54c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action" status: 400 len: 938 microversion: 2.1 time: 0.013065 Aug 30 17:33:24.774276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 956/1841] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 30 17:33:24 2022] POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:33:24.774599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cf7b152-1b35-45b4-8fd4-02fa9f09c803 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] Calling method '.version_select at 0x7f2d9cd2a700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.829986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:24.841623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a880b2be-f1e1-425c-87d9-ca4107e09a74 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.282307 Aug 30 17:33:24.855512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 886/1842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:24 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:24.855512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:24.855512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:24.858767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.859740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.860361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:24.861251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:24.861693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:24.862177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.095969 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cf7b152-1b35-45b4-8fd4-02fa9f09c803 tempest-SecurityGroupsTestAdminJSON-1695955125 tempest-SecurityGroupsTestAdminJSON-1695955125-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a4a8fae8-a02d-408f-9f98-b714c48f2eaa" status: 202 len: 0 microversion: 2.1 time: 0.329991 Aug 30 17:33:25.105536 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 957/1843] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:24 2022] DELETE /compute/v2.1/os-security-groups/a4a8fae8-a02d-408f-9f98-b714c48f2eaa => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:25.118149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:25.119073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:25.150515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.151032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.155671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.159233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.159951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.160567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.169176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.189803 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5773dfbb-a4e8-4abe-a478-31fca8507d89 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.343340 Aug 30 17:33:25.191918 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 887/1844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:24 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:25.198293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:25.199136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:25.205825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.206815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.207439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.208455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.209071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.209663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.321303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:25.460974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.479454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.488766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.490283 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8aefce2-17be-4e69-9e52-293c75d3edb1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1504 microversion: 2.1 time: 0.281741 Aug 30 17:33:25.490982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 888/1845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:25 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:25.494505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.498584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:25.500160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8c23fb2-b085-4322-85c2-f87b4b5c1e5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.401392 Aug 30 17:33:25.501628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:25.501836 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 958/1846] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:25 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:25.511380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8198aebe-75bc-4e23-974a-e9e040588d9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd2a5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:25.516547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.528370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.534269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.536463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.537260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.542368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.585700 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8198aebe-75bc-4e23-974a-e9e040588d9a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.080745 Aug 30 17:33:25.586287 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 959/1847] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:25 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:25.595350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-777504295"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:25.604301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:25.611115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.614266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.614917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.615866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.621478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.622322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.784244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:25.797485 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-636c2205-d9c8-4afe-b6a7-9009fd1725ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.304632 Aug 30 17:33:25.798315 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 889/1848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:25 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:25.814126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:25.816931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:25.828435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.829250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.829919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.830918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:25.831773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:25.832416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:25.907115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:25.922122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=24 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:25.948135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Adding security group 10b8d8c0-5f20-422d-8287-1c617ad04a8f to port 9da007b3-7d71-47af-9e7a-f72289b2a381 Aug 30 17:33:26.107898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:26.118223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-28e8d928-7339-4b28-abac-cd676c2a8344 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.318703 Aug 30 17:33:26.119420 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 890/1849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:25 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:26.124906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8da7d5e9-f00f-44db-9442-5b96d039b76b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8da7d5e9-f00f-44db-9442-5b96d039b76b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action HTTP/1.1 Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 285 Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:33:26.128994 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:33:26.130775 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:33:26.131725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:33:26.132771 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:33:26.134612 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:33:26.135713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:33:26.135713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:26.135713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8da7d5e9-f00f-44db-9442-5b96d039b76b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:26.137393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8da7d5e9-f00f-44db-9442-5b96d039b76b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action" status: 400 len: 619 microversion: 2.1 time: 0.013957 Aug 30 17:33:26.137393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 891/1850] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 30 17:33:26 2022] POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:33:26.142343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:26.143082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:26.156488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.157455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.158152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.159129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.159849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.160550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.487243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:26.505419 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-80afdf00-b6cf-4eec-9c04-53a6bb83d89e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.363883 Aug 30 17:33:26.506356 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 892/1851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:26 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:26.535343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:26.536931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:26.548481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.548970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.549449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.550204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.550843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.551280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.656423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-077f046f-c743-4ace-8428-10c1ee91c703 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/action" status: 202 len: 0 microversion: 2.1 time: 1.068540 Aug 30 17:33:26.657053 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 960/1852] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:25 2022] POST /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:26.672864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:26.674905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:26.692981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.694777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.695248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.697290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:26.697663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:26.700834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:26.872259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:26.882886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37dc9893-d4f8-4a86-acd8-c41cfcc3f6a7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.374717 Aug 30 17:33:26.884808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 893/1853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:26 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:26.905277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95c038e6-69da-4bcf-923f-5e10a9b6a3c4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd80ee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:27.001366 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95c038e6-69da-4bcf-923f-5e10a9b6a3c4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.115124 Aug 30 17:33:27.011658 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 894/1854] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:26 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:27.022204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1614776120"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:27.023924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:27.043174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.044068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.044524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.047217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.048281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.052890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.147959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:27.160432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:27.163171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:27.164884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cebb88b5-1579-4799-a396-f3ef534e0f92 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.504696 Aug 30 17:33:27.166292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 961/1855] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:26 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:27.172686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f7cb06-6bca-40c3-b2f6-1c07eae493bd", "tag": "9da007b3-7d71-47af-9e7a-f72289b2a381"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:27.184196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.184678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.185404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.200405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] Creating event network-changed:9da007b3-7d71-47af-9e7a-f72289b2a381 for instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd on n-h2-852771-11 Aug 30 17:33:27.207265 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c7f1a8bb-9834-42c7-a998-1eeb67966f85 req-cde1c889-4423-4a84-8c4f-00fc78bdd33c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038458 Aug 30 17:33:27.211623 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 962/1856] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:27.219751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:27.220537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:27.228519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.229669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.230266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.231107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.231797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.232407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.366914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.network.security_group_api [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Adding security group e04dfd4e-cf80-4b61-bff9-75c0f45059cc to port 9da007b3-7d71-47af-9e7a-f72289b2a381 Aug 30 17:33:27.445368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:27.457227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f5f3959-0577-4362-8b6a-d0a6a381590b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.243605 Aug 30 17:33:27.458656 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 963/1857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:27 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:27.465911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:27.467071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:27.474787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.475394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.475937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.476957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.477492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.478162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.653874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:27.662794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f346854-c4f2-4aa2-815e-327188635e9f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.200885 Aug 30 17:33:27.664155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 964/1858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:27 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:27.670107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-173303911"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:27.672697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:27.679683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.680411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.681648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.684645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.685820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.686495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.968338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54419035-de38-461c-96f0-92b2c8689160 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action" status: 202 len: 0 microversion: 2.1 time: 0.302754 Aug 30 17:33:27.969626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 965/1859] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:27 2022] POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:33:27.974940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:27.975990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:27.983412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.984567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.985314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:27.986324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:27.986994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:27.987667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.289720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:28.297833 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-248e34f4-7a66-431b-9104-a1a45df3e25b tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/action" status: 202 len: 0 microversion: 2.1 time: 1.283988 Aug 30 17:33:28.298859 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 895/1860] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:27 2022] POST /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/action => generated 0 bytes in 1286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:28.308722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1447392442"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:28.317014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:28.320438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1aaf482-964f-4d4d-852e-6277d19c0bcd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.349380 Aug 30 17:33:28.321336 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 966/1861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:27 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:28.329372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3591d984-2cfd-4eea-875b-7d84ace93fa2 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9ccb0700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:28.333482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.334200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.336277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.340374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.341222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.341906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.390888 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Cannot 'createImage' instance 73364f13-0808-4670-9ac4-9ba19b74df5b while it is in task_state image_snapshot Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action HTTP/1.1 Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 85 Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:33:28.393801 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1447392442"}} Aug 30 17:33:28.395623 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'createImage' instance 73364f13-0808-4670-9ac4-9ba19b74df5b while it is in task_state image_snapshot Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1447392442'}}} Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:28.396648 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 73364f13-0808-4670-9ac4-9ba19b74df5b while it is in task_state image_snapshot Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 73364f13-0808-4670-9ac4-9ba19b74df5b while it is in task_state image_snapshot Aug 30 17:33:28.398351 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:28.404705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 409 to user: Cannot 'createImage' instance 73364f13-0808-4670-9ac4-9ba19b74df5b while it is in task_state image_snapshot {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:28.405782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-952b8ec5-824e-44e0-a7b9-bd360c7b254a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action" status: 409 len: 159 microversion: 2.1 time: 0.105940 Aug 30 17:33:28.406826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 896/1862] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:28 2022] POST /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b/action => generated 159 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:33:28.412492 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3591d984-2cfd-4eea-875b-7d84ace93fa2 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.088763 Aug 30 17:33:28.414326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:28.415155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:28.423194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 967/1863] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:28 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:28.428470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:28.429042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:28.430420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.431464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.433048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.433957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.435092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.435744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.442668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.443168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.460691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.461901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.462459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.462905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.481122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:28.721375 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-babfb55a-d184-4c62-9c7a-971b8e85602a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.303240 Aug 30 17:33:28.733524 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 968/1864] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 30 17:33:28 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd/os-security-groups => generated 1157 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:28.740140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f7cb06-6bca-40c3-b2f6-1c07eae493bd", "tag": "9da007b3-7d71-47af-9e7a-f72289b2a381"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:28.753157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.754281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.754880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.765519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:28.770488 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] Creating event network-changed:9da007b3-7d71-47af-9e7a-f72289b2a381 for instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd on n-h2-852771-11 Aug 30 17:33:28.777289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:28.779464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:28.781461 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-737c957d-2944-456b-8daa-834e008733a7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.373307 Aug 30 17:33:28.782127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 897/1865] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:28 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:28.782537 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a62b1e51-fb02-4bd0-9b2d-1ce3586febb6 req-4debe196-f0ea-43d0-92a7-0fd1971c87ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046154 Aug 30 17:33:28.783563 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 969/1866] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:28.790231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "name": "network-vif-plugged", "status": "completed", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:28.804725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.805450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.806208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.808315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ea155bf-bedb-45c0-8ac3-63649ebd0185 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d98d02940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:28.823603 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] Creating event network-vif-plugged:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h1-852771-11 Aug 30 17:33:28.830827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-99347f28-166a-4104-bbc4-bd297b87a7fe req-ad8bfbea-7f66-4908-a4d7-c0914f675ef8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044838 Aug 30 17:33:28.832182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 970/1867] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:28.840005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:28.840944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:28.852319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:28.854926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.856301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.856925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:28.858377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:28.859811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:28.860427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.075686 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ea155bf-bedb-45c0-8ac3-63649ebd0185 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/images/dbd04c08-7325-4f89-afa6-a505bbf9a584" status: 204 len: 0 microversion: 2.1 time: 0.271877 Aug 30 17:33:29.076409 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 898/1868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:28 2022] DELETE /compute/v2.1/images/dbd04c08-7325-4f89-afa6-a505bbf9a584 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:33:29.086767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e17ebeae-1216-4671-bb82-4afca89544b1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9cc5a820>, body: {"security_group": {"name": " tempest-securitygroup -516818444 ", "description": "tempest-description-129606455"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:29.109491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:29.129405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01e63800-f119-43cf-879c-aeb1a96a725d tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.286461 Aug 30 17:33:29.130075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 971/1869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:28 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:29.141497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.142524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:29.153461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.154135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.154984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.156026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.156690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.157282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.443550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:29.452440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29af8605-2d94-42a1-83ae-e4846277545b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1533 microversion: 2.1 time: 0.321235 Aug 30 17:33:29.467061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 972/1870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:29 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1533 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:29.472385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.473458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:29.482878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.483369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.483827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.484787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.485238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.485656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.566123 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e17ebeae-1216-4671-bb82-4afca89544b1 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.484572 Aug 30 17:33:29.566734 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 899/1871] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:29 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:29.574137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d7502fd-177c-4d56-a8b8-10b83ed13fd7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9938a280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.655650 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d7502fd-177c-4d56-a8b8-10b83ed13fd7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.087452 Aug 30 17:33:29.663472 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 900/1872] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:29 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:29.674950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-085db193-2355-4329-ae3f-f26017404baf tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d99357790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.687290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:29.698256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c43deaa-36e6-44bd-a85c-5786f0efbecf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.229634 Aug 30 17:33:29.714064 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 973/1873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:29 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:29.767193 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-085db193-2355-4329-ae3f-f26017404baf tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd" status: 200 len: 222 microversion: 2.1 time: 0.102346 Aug 30 17:33:29.768101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 901/1874] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:33:29 2022] GET /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd => generated 222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:29.781072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b32850f-6bf6-44c4-b0e1-5f7bb5e32422 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cde21f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.811452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:29.812220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:29.820752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.822509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.823434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:29.824491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:29.825187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:29.825902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.093685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:30.108820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:30.110543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:30.113567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ec2a79b-eece-467c-b58a-dae039dce9d9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1411 microversion: 2.25 time: 0.307633 Aug 30 17:33:30.114336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 902/1875] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:29 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1411 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:30.157068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:30.158103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:30.165735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.166415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.168999 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b32850f-6bf6-44c4-b0e1-5f7bb5e32422 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd" status: 202 len: 0 microversion: 2.1 time: 0.392214 Aug 30 17:33:30.169582 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 974/1876] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:29 2022] DELETE /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:30.170175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.171742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.172510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.183650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cd2aaf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:30.188821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.239941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:33:30.242589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:33:30.246699 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.246699 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd HTTP/1.1 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:30.250493 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.252046 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '49b0f9f9-7104-4ab5-84f2-5cca3718a5cd'} Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:30.253010 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:33:30.254353 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.255791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] Aug 30 17:33:30.257228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:30.265858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:33:30.265858 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-f4589d58-5b50-484a-85f3-2196deaf79a9'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:30.268065 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cff2afc8-607b-429f-83a1-dc68c37343c4 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd" status: 404 len: 194 microversion: 2.1 time: 0.093661 Aug 30 17:33:30.270658 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 975/1877] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:33:30 2022] GET /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:30.292920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c91a95b6-caab-4c65-bc8e-735a68caf4be tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9ccb0f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2130988154", "description": "tempest-description-2041962312"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:30.497076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:30.512024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-747e8541-5137-4155-aa92-6903363fea73 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.362529 Aug 30 17:33:30.514469 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 903/1878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:30 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:30.519834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:30.525885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:30.542480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.542979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.543578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.544442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.550370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.550850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.706758 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c91a95b6-caab-4c65-bc8e-735a68caf4be tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.429064 Aug 30 17:33:30.708105 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 976/1879] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:33:30.713836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c897616e-a7ea-4c85-b6f7-fa0b4334bf70 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd2a5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:30.827580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c897616e-a7ea-4c85-b6f7-fa0b4334bf70 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.118012 Aug 30 17:33:30.837734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 977/1880] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:30 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:30.844403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b63e165-bbcc-426e-8eea-a2eda52779a5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9cde2dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1316443000", "description": "tempest-description-707235215"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:30.925224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:30.938507 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86f1b075-56c2-4680-a765-4eab3394e905 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1539 microversion: 2.1 time: 0.419781 Aug 30 17:33:30.942311 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 904/1881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:30 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1539 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:30.982557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:30.983980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:30.996366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.996861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.997303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:30.998116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:30.998769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:30.999436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.061003 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b63e165-bbcc-426e-8eea-a2eda52779a5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.221478 Aug 30 17:33:31.061914 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 978/1882] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:31.273581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:31.288416 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4cb5be33-5b32-4732-92bf-d7794f1f4e0f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.343585 Aug 30 17:33:31.302323 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 905/1883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:30 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:31.302323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb677fc0-fc3f-47a5-a524-41b9db5962f0 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d993570d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1513520282", "description": "tempest-description-1915257626"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:31.374880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-740850344", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:31.455433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:31.472457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb677fc0-fc3f-47a5-a524-41b9db5962f0 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.180361 Aug 30 17:33:31.473361 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 906/1884] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:31.489123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:31.489876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:31.496629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.497198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.497744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.499191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.499768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.500262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.720731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:31.732732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:31.735061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:31.742269 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d817f909-61fc-4f42-bb1b-a4c73a64aa6e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1606 microversion: 2.25 time: 0.259892 Aug 30 17:33:31.743620 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 907/1885] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:33:31 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1606 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:33:31.761829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ce52286-f04a-46aa-8fe9-7f901753ae5c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cc695e0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:31.802665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:31.803401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:31.804172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:31.804810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:31.805452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:31.821200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.823003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.823750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.824844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.825539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.826424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.848548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Getting quotas for project c2fccaba9aa34bbc98b69e09baca041e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:31.856373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Getting quotas for user 4ff2753ae0d547589265d28f0a3bd2a6 and project c2fccaba9aa34bbc98b69e09baca041e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:31.874978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:31.877499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:31.967222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-304b7421-62ef-47e7-8ccd-38e854f8a851 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893912 Aug 30 17:33:31.969883 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 979/1886] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:31.977686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:31.982320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:31.992946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.994183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.994785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:31.996250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:31.996879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:31.997577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.037615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ce52286-f04a-46aa-8fe9-7f901753ae5c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.292529 Aug 30 17:33:32.047903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 908/1887] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:33:31 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.047903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.047903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:32.063502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.064001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.064443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.065155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.065607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.066035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.210664 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48aa9622-d085-4fe1-a725-10cf0a6581a5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.170509 Aug 30 17:33:32.212703 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 909/1888] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:33:32 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:33:32.217772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98c2bacc-ca7b-42c8-b99e-615c1fa3b4eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98f12670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.236611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:32.253757 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e79339bd-bd10-4302-ae44-63c8f6fa9eb8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.282584 Aug 30 17:33:32.255235 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 980/1889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:31 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.261424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.262044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:32.270591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.271301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.271904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.272830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.273462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.274052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.310873 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98c2bacc-ca7b-42c8-b99e-615c1fa3b4eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.095948 Aug 30 17:33:32.315118 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 910/1890] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:32 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.328648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ca8c849-8f9e-4782-aae8-5023aebc5a0c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.330072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ca8c849-8f9e-4782-aae8-5023aebc5a0c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:32.452646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0ca8c849-8f9e-4782-aae8-5023aebc5a0c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:32.475044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ca8c849-8f9e-4782-aae8-5023aebc5a0c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1221 microversion: 2.1 time: 0.150966 Aug 30 17:33:32.477850 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 911/1891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:32 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.511834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d4d213ef-7fa2-47d3-8224-2dd81d2272de tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98d8b4c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.554450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:32.574839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35fc5f59-0d2e-492b-a35a-0a02271c1695 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1521 microversion: 2.1 time: 0.318473 Aug 30 17:33:32.580478 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 981/1892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:32 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.600408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.601263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:32.610694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.611718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.612404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.613530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.614298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.614914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.818064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:32.829006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-593e864a-115a-4453-8300-2370487189e9 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.246598 Aug 30 17:33:32.830500 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 982/1893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:32 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:32.851234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73364f13-0808-4670-9ac4-9ba19b74df5b", "name": "network-vif-plugged", "status": "completed", "tag": "7a0ab5b7-fd3f-462c-a165-2ecab2f435e9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:32.866134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.869464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.870542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.904473 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] Creating event network-vif-plugged:7a0ab5b7-fd3f-462c-a165-2ecab2f435e9 for instance 73364f13-0808-4670-9ac4-9ba19b74df5b on n-h1-852771-11 Aug 30 17:33:32.910455 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-acae3bd6-bc3a-44b4-a565-04969ae3fb3e req-4c2c210c-f9dc-49e6-af27-c52838608f9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078125 Aug 30 17:33:32.911961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 983/1894] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:32.933178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:32.935004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:32.944428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.945020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.945498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.949513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:32.951623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:32.952372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:32.980203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:33:33.122326 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62860d0c-f2f6-4b0e-b421-01f36bf387d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 204 len: 0 microversion: 2.1 time: 0.208064 Aug 30 17:33:33.126435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 984/1895] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:33:32 2022] DELETE /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:33:33.132070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:33.132814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:33.139363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.139877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.140312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.141019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.141464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.141886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.418955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:33.438920 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce28b031-41df-498e-a259-ad026497f589 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1527 microversion: 2.1 time: 0.310815 Aug 30 17:33:33.449982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 985/1896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:33 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1527 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:33.449982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:33.449982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:33.495885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.505553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.506461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.507989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.522136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.523692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.535296 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d4d213ef-7fa2-47d3-8224-2dd81d2272de tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0" status: 202 len: 0 microversion: 2.1 time: 1.056019 Aug 30 17:33:33.536236 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 912/1897] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:32 2022] DELETE /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0 => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:33.542407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5cce6306-47e0-4864-9b8b-c7c2d30d00db tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98cef940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:33.639668 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5cce6306-47e0-4864-9b8b-c7c2d30d00db tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.094253 Aug 30 17:33:33.647971 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 913/1898] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:33 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:33.668050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:33.668674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:33.702843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.703696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.707230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.713715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:33.720249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:33.721029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:33.737008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:33.749197 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0cade88-9b33-4501-a9e3-7f03f8487291 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.307274 Aug 30 17:33:33.775214 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 986/1899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:33 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:33.783263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cdab550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:33.813919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:33:33.815085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group a1c890fb-c684-4a2c-9021-465f66f7aab0 not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:33:33.815347 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.815347 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0 HTTP/1.1 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:33.817563 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.819117 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a1c890fb-c684-4a2c-9021-465f66f7aab0'} Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:33.820089 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:33:33.822651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.824893 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-bd22ce7c-931d-48bc-9c70-3365e0fe597a'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d0ec766-0c2a-42fa-9a67-1ecd95118f51 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0" status: 404 len: 194 microversion: 2.1 time: 0.041993 Aug 30 17:33:33.827972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 987/1900] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:33:33 2022] GET /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:33.831705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea61bb68-f98f-44d5-b3fc-e3475ddef2a5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9ccb0310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:34.163361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:34.175384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07023a68-5004-434c-ae52-b18868c3a143 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1273 microversion: 2.1 time: 0.526394 Aug 30 17:33:34.176345 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 914/1901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:33 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1273 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:34.184782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:34.186117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:34.195929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:34.197937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:34.199927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:34.201099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea61bb68-f98f-44d5-b3fc-e3475ddef2a5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936" status: 202 len: 0 microversion: 2.1 time: 0.374050 Aug 30 17:33:34.201717 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 988/1902] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:33 2022] DELETE /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:34.202763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:34.203751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:34.204665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:34.218787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9ccbb820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:34.277894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:33:34.279329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:33:34.280118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.280118 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936 HTTP/1.1 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:34.284662 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.286687 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5839fe1a-2222-4589-8c2b-95c5dc3cb936'} Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:34.287651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:33:34.288957 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.292265 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] Aug 30 17:33:34.295361 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:34.314065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:33:34.314065 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-586f72ab-612e-4032-8c9e-9d3bed6113d7'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:34.315712 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a4f8da2-755a-43b7-810c-df9c65afad28 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936" status: 404 len: 194 microversion: 2.1 time: 0.109493 Aug 30 17:33:34.317606 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 989/1903] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:33:34 2022] GET /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:34.346268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fc7ab47-afcb-41ff-85a3-48448cd74cd6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9ccb0820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:34.672703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fc7ab47-afcb-41ff-85a3-48448cd74cd6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a" status: 202 len: 0 microversion: 2.1 time: 0.348733 Aug 30 17:33:34.674318 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 990/1904] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:34 2022] DELETE /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:34.681289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:34.684379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:34.700527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:34.702322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:34.705707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:34.707205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:34.708175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:34.709152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.010049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:35.014328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:35.042756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29f31bbc-7aea-4f68-8601-5b74944f1975 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.864749 Aug 30 17:33:35.044170 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 915/1905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:34 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:35.059955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3898b1d1-8da4-4809-8fbc-7d5eb9c0707a", "name": "network-vif-unplugged", "status": "completed", "tag": "33b61bb2-9024-4dbd-8dcc-c2e478e0745e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:35.083744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:35.086485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:35.088117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.135934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:35.152114 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d33fb0a6-18e7-44ac-a3ea-93426be5eccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1527 microversion: 2.1 time: 0.473366 Aug 30 17:33:35.153047 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 991/1906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:34 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1527 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:35.168946 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] Creating event network-vif-unplugged:33b61bb2-9024-4dbd-8dcc-c2e478e0745e for instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a on n-h1-852771-11 Aug 30 17:33:35.169406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ddd9e31-efa3-4051-940e-1acbbd86e4ed tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9ccb0310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:35.178857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e0b6250e-4b3b-4441-a697-d6e1f5f79211 req-a137762d-5778-440e-9137-71eacd80e984 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133147 Aug 30 17:33:35.181709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 916/1907] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:35.189570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98cf6160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:35.287898 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ddd9e31-efa3-4051-940e-1acbbd86e4ed tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.132245 Aug 30 17:33:35.290742 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 992/1908] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:35 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:35.296961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:35.297854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:35.305826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:35.306733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:35.307556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.308509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:35.309201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:35.310576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.630512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:33:35.631134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:33:35.632102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.632102 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.633656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a HTTP/1.1 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:33:35.635651 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.637541 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '938260aa-08ce-4ed2-8180-f3ff1c433e0a'} Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:35.638714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:33:35.641260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.642784 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-bdd7fe53-61ef-4a85-8eb5-f271b7dd7679'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79f04caf-c6dd-4451-8402-c030ca4cc3ca tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a" status: 404 len: 194 microversion: 2.1 time: 0.452798 Aug 30 17:33:35.644640 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 917/1909] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:33:35 2022] GET /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a => generated 194 bytes in 459 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:35.648614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:35.649391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:35.661607 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50ef21a8-e17a-44f9-b95a-ff8df137b64a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.362597 Aug 30 17:33:35.662514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 993/1910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:35 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:35.671151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:35.672511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:35.672964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.676243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:35.676909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:35.678009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:35.678968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f4248de-03e3-4208-b494-b95a5f188378 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cdab0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:35.912069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:35.947584 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fa5138ab-4e1b-4f1a-a862-79e70228944f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1279 microversion: 2.1 time: 0.304685 Aug 30 17:33:35.954168 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 918/1911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:35 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1279 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:36.070059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:36.072093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:36.077805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:36.097918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.099925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.100657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.102439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.104496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.106099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.415907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f4248de-03e3-4208-b494-b95a5f188378 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.749688 Aug 30 17:33:36.417593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 994/1912] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:33:35 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:36.423240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73364f13-0808-4670-9ac4-9ba19b74df5b", "name": "network-vif-deleted", "tag": "7a0ab5b7-fd3f-462c-a165-2ecab2f435e9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:36.437140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.438107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.438708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.453141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] Creating event network-vif-deleted:7a0ab5b7-fd3f-462c-a165-2ecab2f435e9 for instance 73364f13-0808-4670-9ac4-9ba19b74df5b on n-h1-852771-11 Aug 30 17:33:36.459693 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-efeb0994-7659-4b6d-ae86-a1348adcfbf6 req-2bc96a30-0e9a-4ca6-99ab-35eb74c90224 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040605 Aug 30 17:33:36.464045 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 995/1913] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:36.470087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:36.471876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:36.480157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.480551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.482240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.483134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.483785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.484775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.545539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:36.546028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:36.546480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:36.546942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lazy-loading 'fault' on Instance uuid 73364f13-0808-4670-9ac4-9ba19b74df5b {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:33:36.660598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:36.671727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54d390a5-4eec-4240-b0bc-ae30500d53c9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 200 len: 1315 microversion: 2.1 time: 0.205853 Aug 30 17:33:36.672704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 996/1914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:36 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:36.682029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c407add1-fc49-4dbd-bcf6-0c5ae37470ef tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc6e280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:36.749357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c407add1-fc49-4dbd-bcf6-0c5ae37470ef tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.075161 Aug 30 17:33:36.757809 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 997/1915] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:36 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:36.763015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d2999c7-167f-43c2-9f16-1ab1086dd5b5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9cc6eaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1258694162", "description": "tempest-description-590717284"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:37.002517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:37.021238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d2999c7-167f-43c2-9f16-1ab1086dd5b5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.264500 Aug 30 17:33:37.027902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cdb52ad5-d1f1-4786-b30b-08410a015a67 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.962641 Aug 30 17:33:37.031305 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 998/1916] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:37.032261 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 919/1917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:36 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:37.045679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:37.046766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:37.055119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:37.057339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:37.064315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.065102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.066989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.068408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.069399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.070068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.075249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.079328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.084064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.086176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.087850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.088461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.187151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:37.195461 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-af25c73a-6159-4d39-831c-5c4c30d19da8 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1279 microversion: 2.1 time: 0.160328 Aug 30 17:33:37.198809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 920/1918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:37 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:37.206977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a8915a3-82b0-4bbc-87ca-a6c9b9d3ef4e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9cc5a310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-924700872", "description": "tempest-description-1198008043"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:37.297336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:37.300885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:37.310277 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bc8cc55-95da-4d0e-b8f9-4ab7aba2dba3 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.263212 Aug 30 17:33:37.311383 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 999/1919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:37 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:37.422536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3898b1d1-8da4-4809-8fbc-7d5eb9c0707a", "tag": "33b61bb2-9024-4dbd-8dcc-c2e478e0745e"}, {"name": "network-changed", "server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:37.468508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.469179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.469672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.491237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Creating event network-changed:33b61bb2-9024-4dbd-8dcc-c2e478e0745e for instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a on n-h1-852771-11 Aug 30 17:33:37.492198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] Creating event network-changed:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h1-852771-11 Aug 30 17:33:37.503317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-54f86511-17f0-407e-8f5b-fdaf98243dd3 req-7b566cb2-78ff-4a46-bdfa-6841c4df21cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086111 Aug 30 17:33:37.504612 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1000/1920] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:33:37.700172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:37.700995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:37.707342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.708134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.710172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.711729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:37.712361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:37.712991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:37.714530 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a8915a3-82b0-4bbc-87ca-a6c9b9d3ef4e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.511276 Aug 30 17:33:37.715137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 921/1921] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:33:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:37.752725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b HTTP/1.1 Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:37.760477 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:33:37.762408 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b'} Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:37.763419 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:33:37.765068 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:37.766542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:37.766542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48adcc3d-b08c-42be-b429-1bc2956472bf tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 404 len: 111 microversion: 2.1 time: 0.071519 Aug 30 17:33:37.773599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7dd6aedd-08c7-4417-b0b4-68b64b3d468a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d992f6940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:37.776850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1001/1922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:37 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:33:37.800159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06eb9d96-e4ce-40d6-809f-c982bfcadf15 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'create', calling method: .version_select at 0x7f2d9cd6be50>, body: {"keypair": {"name": "tempest-keypair-1649698002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoZrFvefOnpvfRfm+4ajdx7X+fjcLMoHa+lAjyaWgCfBBP9nqyZ2zPxxr/pQYidq9z5O7FLb9R5hz0EuY5sg/tjlMAex8X+Nld/byjTyUhNR/SgvQ893SQsmFuCn8i5Qw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:37.866814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-06eb9d96-e4ce-40d6-809f-c982bfcadf15 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for project c77cf8ad0921438ca137b201152c3d2c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:37.867244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7dd6aedd-08c7-4417-b0b4-68b64b3d468a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.098280 Aug 30 17:33:37.869288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 922/1923] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:37 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:37.880793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-06eb9d96-e4ce-40d6-809f-c982bfcadf15 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for user e81a00b7d1af419b8dadb0f1187ad4b7 and project c77cf8ad0921438ca137b201152c3d2c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:37.942277 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06eb9d96-e4ce-40d6-809f-c982bfcadf15 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164221 Aug 30 17:33:37.955446 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1002/1924] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:33:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:37.995859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-753661730", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "10cf8f84-a1c9-4ce9-bfa7-d94e61d6a40b"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:38.058067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:38.061863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:38.070153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.071214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.071983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:38.074558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.075556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.076795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:38.100553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] validate_networks() for [('10cf8f84-a1c9-4ce9-bfa7-d94e61d6a40b', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:38.382434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:38.400536 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca20d9be-0a1b-4290-80b4-5bfc0b75ec14 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.341217 Aug 30 17:33:38.401229 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1003/1925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:38 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:38.407010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:38.412469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:38.425871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.429553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.430291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:38.433472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.434171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.434829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:38.706061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:38.716666 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7fe5297f-8f09-41b5-b75c-208dad8a9942 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.313563 Aug 30 17:33:38.720657 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1004/1926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:38 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:38.730699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:38.731619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:38.754968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.755378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.755874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:38.762003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:38.762929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:38.764511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.123319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:39.132367 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b77c53ec-210b-478c-83b2-7b95d7d414dc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.408654 Aug 30 17:33:39.143083 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1005/1927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:38 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:39.157010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34ae9cf4-159b-4dbc-b989-cac1c5ef0af1 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9ccbb0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:39.265743 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34ae9cf4-159b-4dbc-b989-cac1c5ef0af1 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.109662 Aug 30 17:33:39.269872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1006/1928] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:39 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:39.426999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:39.427788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:39.438824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.439389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.440128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.441061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.441758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.442404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.774481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:39.775075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:39.775433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:39.776129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:39.776831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:39.799654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.801195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.807752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.808987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.809902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.811296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.885367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:39.902598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Getting quotas for project 8a152d89d8c448c590cd4d7e885c7c44. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:39.909625 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-313698f6-3931-46c5-96cc-764e611ee2dd tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.489057 Aug 30 17:33:39.910217 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1007/1929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:39 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:39.916374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:39.931318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:39.940652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Getting quotas for user 132cb6854f064d2e8b8193de1c7d5861 and project 8a152d89d8c448c590cd4d7e885c7c44. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:39.961447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.963117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.963673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.964459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:39.965157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:39.965760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:39.980528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:39.987200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:40.128678 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-20371dcf-6bb2-41df-9037-fb2df8a4b2dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142314 Aug 30 17:33:40.132863 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 923/1930] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:40.152027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e2404ea-2ea8-43e5-9f6b-303dd5c9fac3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:40.153555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e2404ea-2ea8-43e5-9f6b-303dd5c9fac3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:40.400892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e2404ea-2ea8-43e5-9f6b-303dd5c9fac3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:40.421713 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e2404ea-2ea8-43e5-9f6b-303dd5c9fac3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1215 microversion: 2.1 time: 0.281997 Aug 30 17:33:40.429970 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 924/1931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:40 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:40.549134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:40.549826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:40.586434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:40.587576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:40.588279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:40.589175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:40.590766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:40.591847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:40.678135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:40.712566 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9c02427-f7d6-48c2-a16f-c3a573f5dd77 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.794911 Aug 30 17:33:40.732215 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1008/1932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:39 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:40.745098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e64878c-66d5-4da8-895f-78b82935a15c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cdab940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:40.850917 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e64878c-66d5-4da8-895f-78b82935a15c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.117537 Aug 30 17:33:40.851922 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1009/1933] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:40 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:40.935819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:40.936851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:40.957185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:40.958898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:40.959609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:40.960664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:40.962686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:40.963461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.067007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:41.079743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2872c1a5-6f25-457c-a9d7-2914a6d9365c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.643820 Aug 30 17:33:41.083412 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 925/1934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:40 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:41.416563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d30c0d-758e-4d3f-b971-1eac3702fb40", "tag": "94d14a3c-df4b-4c47-ae70-58422f53eea1"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:41.437197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:41.437668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:41.446602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.473730 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] Creating event network-changed:94d14a3c-df4b-4c47-ae70-58422f53eea1 for instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 on n-h2-852771-11 Aug 30 17:33:41.487383 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-46cb3a9c-5cf4-4e3d-a103-4740c6d35e2b req-b00f113e-fb89-421f-b33b-84690a4c69c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076763 Aug 30 17:33:41.497293 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 926/1935] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:41.509039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:41.510466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:41.525934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:41.529803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:41.544298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:41.546541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba7f117a-1a2d-423b-b99c-d8f03154dbae tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.616902 Aug 30 17:33:41.547196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.558095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:41.559603 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1010/1936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:40 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:41.560629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:41.561440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.739835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:41.740428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:41.746482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:41.766603 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85e88175-f08d-4b9d-a054-6b9b0e9d76ab tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1219 microversion: 2.1 time: 0.265891 Aug 30 17:33:41.768626 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 927/1937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:41 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1219 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:41.785383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:41.785878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:41.786319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.787662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:41.788130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:41.788747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:41.844192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:41.868091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e9f49d7-587c-4520-ad93-b821bf3484d3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98ef8b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:41.953473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e9f49d7-587c-4520-ad93-b821bf3484d3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1452 microversion: 2.1 time: 0.090068 Aug 30 17:33:41.958243 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 928/1938] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:41 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:42.102902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:42.105194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:42.121295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.126468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.128873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:42.130906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.131616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.132246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:42.369043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:42.384860 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47314bf4-dad5-49f9-8132-f0eae4580037 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.648687 Aug 30 17:33:42.400864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1011/1939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:41 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:42.584094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:42.585172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:42.600269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.607266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.609173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:42.613980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.615976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.616639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:42.831234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:42.845533 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2fd6498-c465-4ad0-8439-7cdb57ad31ca tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.746297 Aug 30 17:33:42.849078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 929/1940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:42 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:42.868422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:42.873253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:42.894138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.894876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.896058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:42.902931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:42.902931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:42.902931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.036293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:43.046189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2bb18f87-e7b6-4a0c-8049-b89a7a097a92 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1267 microversion: 2.1 time: 0.195719 Aug 30 17:33:43.061065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 930/1941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:42 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:43.067946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-037d7e5c-420f-4a68-b7bf-73879ac80c0e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9952d4c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:43.136046 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-037d7e5c-420f-4a68-b7bf-73879ac80c0e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1461 microversion: 2.1 time: 0.073421 Aug 30 17:33:43.136780 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 931/1942] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:43 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1461 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:43.152303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:43.162709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75459882-932f-43e6-9199-d1482ec5fc1a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9909a940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:43.175186 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ab24e74-26bb-4cbd-8ea7-088315b9bf4c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.594980 Aug 30 17:33:43.177201 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1012/1943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:42 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:43.221855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75459882-932f-43e6-9199-d1482ec5fc1a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 200 len: 1461 microversion: 2.1 time: 0.065270 Aug 30 17:33:43.222829 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 932/1944] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:43 2022] GET /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 1461 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:43.239337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:43.239984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:43.246960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.248352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.248956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.249989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.250438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.251125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.412207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:43.413726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:43.422766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.423300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.424026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.424827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.425287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.425696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.574932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:43.592566 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0306dfe2-b0f1-4401-95cc-459d27856eb0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1480 microversion: 2.1 time: 0.357279 Aug 30 17:33:43.613036 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1013/1945] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:43 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1480 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:43.689367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:43.698830 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35ac0399-0e0a-42af-833e-0cad84431e5a tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.295025 Aug 30 17:33:43.704183 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 933/1946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:43 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:43.716404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-743815153", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:43.783189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] validate_networks() for [('3fe8a62b-b271-49fd-8999-906f2116a7d7', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:43.871751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:43.872757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:43.879977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.880727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.881773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:43.883766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:43.885083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:43.886009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.176856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:44.195960 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a65fc2c-237a-4d31-ace1-94dba2d6dafc tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.327563 Aug 30 17:33:44.204324 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 934/1947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:43 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:44.214991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:44.216006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:44.240130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.241931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.243164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.244655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.245585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.246876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.399884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:44.400908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:44.401552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:44.401967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:44.402385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:44.419265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.419781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.420212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.424584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.425017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.425446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.449373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:44.455239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for user e81a00b7d1af419b8dadb0f1187ad4b7 and project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:44.484330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:44.487313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:44.502030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:44.557443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b049792c-a7c1-4568-bd80-226ef273e5dd tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.851256 Aug 30 17:33:44.558687 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1014/1948] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:44.563671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:44.564662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:44.572513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.573405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.574086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.575319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.576263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.576937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.752190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:44.779582 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-daf749e7-2f47-4466-9520-23a2c92f2a39 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.571903 Aug 30 17:33:44.782217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 935/1949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:44 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:44.813828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5dd6103-699c-47c4-89cb-0dd369a903db tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:44.816969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5dd6103-699c-47c4-89cb-0dd369a903db tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:44.870372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:44.885043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-520cd024-6dff-4d1f-9edd-cda34e02e6df tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.324735 Aug 30 17:33:44.886286 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1015/1950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:44 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:44.901460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:44.902755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:44.913985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.915400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.916550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.917801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:44.918454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:44.918892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:44.995591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b5dd6103-699c-47c4-89cb-0dd369a903db tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:45.012572 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5dd6103-699c-47c4-89cb-0dd369a903db tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1224 microversion: 2.1 time: 0.211403 Aug 30 17:33:45.013187 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 936/1951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:44 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1224 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:45.035862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:45.036684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:45.044877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.045661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.046275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.047018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.047712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.048137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.163654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:45.173539 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6da28e89-5125-4745-897e-570f89a8c846 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1467 microversion: 2.1 time: 0.285129 Aug 30 17:33:45.178971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1016/1952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:44 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1467 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:45.205851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2055836093"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:45.208972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:45.218769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.219932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.220650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.222095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.223102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.223764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.506630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c91e918d-6060-4d87-806e-30f8ee5e84fa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "POST /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86/action" status: 202 len: 0 microversion: 2.1 time: 0.305118 Aug 30 17:33:45.509244 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1017/1953] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:45 2022] POST /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:33:45.515459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:45.517123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:45.527699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.528852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.529910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.530811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.531456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.531978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.652964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:45.663635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-42e4e724-41ff-41b9-b2ce-bcfd11bdf31e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.646175 Aug 30 17:33:45.670400 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 937/1954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:45 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:45.675776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c3287383-aac3-464b-84e0-7f1ef9a73a5d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc5ae50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:45.730386 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c3287383-aac3-464b-84e0-7f1ef9a73a5d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.058874 Aug 30 17:33:45.731627 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 938/1955] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:45 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:45.765259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:45.777644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a98a1015-4a52-47bb-bf0e-52e4d9dce5f2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.266921 Aug 30 17:33:45.778562 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1018/1956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:45 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:45.807908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:45.808818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:45.816505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.817009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.817440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.818352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.818861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.819346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.911164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:45.911919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:45.920782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.921330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.921871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:45.922658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:45.923447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:45.923911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.075950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:46.084586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20ca258e-b2ed-4ba8-ac39-931ba023bcf8 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1391 microversion: 2.1 time: 0.178877 Aug 30 17:33:46.085279 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1019/1957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:45 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:46.089993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:46.090770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:46.097226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.097881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.098326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.099125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.099796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.100424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.106492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:46.173780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:46.184989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e6b0f8d-2fe1-4d18-bacb-678759dd6ac6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1276 microversion: 2.1 time: 0.098481 Aug 30 17:33:46.195975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1020/1958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:46 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:46.196567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:46.205804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f14a9e47-f780-45e0-b356-258251d2abb9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.402097 Aug 30 17:33:46.206471 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 939/1959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:45 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:46.691741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:46.692953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:46.703725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.704215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.704871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.705575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.706023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.707441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.755246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1470ee8-d079-4b28-a832-0e3012ddbc3c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc5a940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:46.822753 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1470ee8-d079-4b28-a832-0e3012ddbc3c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.079367 Aug 30 17:33:46.824094 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 940/1960] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:46 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:46.829558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce90eb33-cc82-4e0c-97e1-043cf62c91c6", "tag": "c67221fe-3edb-4e3e-866e-42bdd86b3965"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:46.845244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.846950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.847629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.861478 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] Creating event network-changed:c67221fe-3edb-4e3e-866e-42bdd86b3965 for instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 on n-h1-852771-11 Aug 30 17:33:46.868404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0ce35d06-0580-4861-94bf-de58798354af req-3ae5840b-bfdb-4b7a-bdbe-5d48e252e084 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042051 Aug 30 17:33:46.870197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 941/1961] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:46.876695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:46.877846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:46.888954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.889912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.890554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:46.891847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:46.892515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:46.892939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.052009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:47.066267 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4125646-4ab1-4dc8-9a84-e70bd3ac93f0 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.378323 Aug 30 17:33:47.067391 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1021/1962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:46 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:47.106702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.107326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:47.125035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.125542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.126215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.127467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.132379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.133115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.176678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:47.188629 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b65aedd-992b-4f3c-9b46-17767d250324 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.317030 Aug 30 17:33:47.191797 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 942/1963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:46 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:47.209689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.210446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:47.217731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.218508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.218941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.219666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.220118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.220535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.417923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:47.428004 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2d8185b-de3d-48fc-b624-bd5792869b05 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1381 microversion: 2.1 time: 0.325780 Aug 30 17:33:47.443361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1022/1964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1381 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:47.443361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.443361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:47.447808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.448386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.448896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.449679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.450143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.450574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.690732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:47.701215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68233b70-4b77-4ab3-9e01-6bb74c8cea0e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.271110 Aug 30 17:33:47.702833 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1023/1965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:47.710132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3c0d774-b7b3-405d-b72b-85a2c70f7d09 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '.version_select at 0x7f2d9cd62550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.718480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c0d774-b7b3-405d-b72b-85a2c70f7d09 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.719848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c0d774-b7b3-405d-b72b-85a2c70f7d09 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.721122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c0d774-b7b3-405d-b72b-85a2c70f7d09 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.738596 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3c0d774-b7b3-405d-b72b-85a2c70f7d09 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.033292 Aug 30 17:33:47.739710 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1024/1966] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:47.752840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:47.755029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.755688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:47.763866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.764153 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df9f3d8f-becf-4e4a-91f5-d97fa9d36260 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.559145 Aug 30 17:33:47.765143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 943/1967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:47.765675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.766112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.766989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:47.767638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:47.768230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:47.837720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f351808-5794-45e4-b982-db4a22378bbe tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99002e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:47.883624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f351808-5794-45e4-b982-db4a22378bbe tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.049142 Aug 30 17:33:47.884440 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 944/1968] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:47.974149 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a8649973-702c-47e3-81b8-9bbfab2cafd4 tempest-LiveMigrationTest-1853055661 tempest-LiveMigrationTest-1853055661-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1534 microversion: 2.1 time: 0.223329 Aug 30 17:33:47.974940 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1025/1969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:47 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1534 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:48.006691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.007119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.014439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.014914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.015346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.016130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.016739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.017254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.044991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:33:48.060055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:48.090429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.091288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.097385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.098020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.098626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.099818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.100273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.100889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.135437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-343b2d30-425b-4428-b3b3-6f5ed51a78f5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 204 len: 0 microversion: 2.1 time: 0.132401 Aug 30 17:33:48.136151 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 945/1970] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:33:48 2022] DELETE /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:33:48.144286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.144979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.151145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.151659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.152196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.152882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.153328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.153740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.296258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:48.305719 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79e863fb-6575-4f5e-8947-910ce4819c84 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1387 microversion: 2.1 time: 0.164751 Aug 30 17:33:48.311577 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 946/1971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1387 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:48.324439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.325056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.337057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.338936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.339383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.340132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.340582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.341001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.500303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:48.509226 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d79d4a9-512d-4555-bbde-52de6de845dd tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1516 microversion: 2.1 time: 0.190062 Aug 30 17:33:48.510195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 947/1972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:48.540900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d30c0d-758e-4d3f-b971-1eac3702fb40", "name": "network-vif-plugged", "status": "completed", "tag": "94d14a3c-df4b-4c47-ae70-58422f53eea1"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:48.552606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.553101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.553652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.584521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] Creating event network-vif-plugged:94d14a3c-df4b-4c47-ae70-58422f53eea1 for instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 on n-h2-852771-11 Aug 30 17:33:48.591815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6bd2a3fb-365a-4835-a200-fd82ffd7f87d req-7e82a1ef-a026-473f-bd0b-28368902d3b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055422 Aug 30 17:33:48.593092 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 948/1973] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:33:48.632772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:48.646370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b95fb7a1-ce42-4d73-985d-9b21048b758c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.559775 Aug 30 17:33:48.650841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1026/1974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:48.704072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eaa00a7-84a8-4192-b6be-f7668ab3cdf6", "tag": "9875fa27-9286-4baf-a4fb-9ea97b450667"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:48.715561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.716434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.716867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.723997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.725983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.736701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.741470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.743108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.748749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.749853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.750556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.758882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] Creating event network-changed:9875fa27-9286-4baf-a4fb-9ea97b450667 for instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 on n-h1-852771-11 Aug 30 17:33:48.775615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9e488edb-c65e-4d16-969e-d60411a7b51a req-0b6dc3e9-d1ec-4831-956b-8f6c4b40324c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068983 Aug 30 17:33:48.778938 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 949/1975] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:48.797976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:48.798766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:48.812262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.816508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.817087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.817908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:48.818447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:48.819207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:48.986291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:48.994171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93604308-98ff-4c09-989c-8f79d982ee96 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.275347 Aug 30 17:33:48.994749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1027/1976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:48.999398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48fd54dc-fab5-4910-b708-7389860e2938 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd2a280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:49.002926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:49.012256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f9978cd-0fb5-4929-9861-2062d519fa16 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.219154 Aug 30 17:33:49.012836 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 950/1977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:49.045163 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48fd54dc-fab5-4910-b708-7389860e2938 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.049105 Aug 30 17:33:49.045751 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1028/1978] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:48 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:49.329362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:49.330009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:49.336884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.337371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.337810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.342067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.344607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.348436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.534265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:49.535631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:49.542822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.543669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.544356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.545356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.546045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.546737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.740564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:49.752288 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee2a97e1-3bad-4384-bbe6-97378ca33fa1 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1387 microversion: 2.1 time: 0.429043 Aug 30 17:33:49.766932 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 951/1979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:49 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1387 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:49.767179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:49.767738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:49.767738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:49.767951 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17df53a0-5f83-4b74-a749-9be3d776a3f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.235555 Aug 30 17:33:49.768404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.768901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.769843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.770742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:49.771013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:49.771441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:49.775971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1029/1980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:49 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:49.833615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:49.972522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:49.981873 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98fa8c59-f3b0-4386-8671-5f8d5ea70ebd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.227632 Aug 30 17:33:49.982458 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 952/1981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:49 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:50.015508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:50.016371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:50.023057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.024438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.026730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.027727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.028082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.028469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.038275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:50.044424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:50.056985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.057841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.058300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.060783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.062317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.062834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.174779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:50.182481 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53f2cd34-e10d-4801-9ca7-215d7a2f3c84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.170900 Aug 30 17:33:50.183067 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1030/1982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:50.187629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-854c3413-772e-4152-afdf-628fbaa8473f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc9d0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:50.214706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:50.224513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-93088be5-15b4-4b9d-8cce-c18efa2625d6 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.193765 Aug 30 17:33:50.236909 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 953/1983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:50.236909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3898b1d1-8da4-4809-8fbc-7d5eb9c0707a", "name": "network-vif-deleted", "tag": "33b61bb2-9024-4dbd-8dcc-c2e478e0745e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:50.238053 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-854c3413-772e-4152-afdf-628fbaa8473f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.053723 Aug 30 17:33:50.238786 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1031/1984] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:50.241685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.242707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.243148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.254275 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] Creating event network-vif-deleted:33b61bb2-9024-4dbd-8dcc-c2e478e0745e for instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a on n-h2-852771-11 Aug 30 17:33:50.264852 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c278246e-a3a3-4f5d-a7c9-55c99e954036 req-20b5c9ea-3061-4892-9553-14dbc5ce5b62 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Aug 30 17:33:50.265487 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 954/1985] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:50.609640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a212786-ac1b-4080-aac9-1b6bcfce5f2e", "name": "network-vif-unplugged", "status": "completed", "tag": "e51d53e0-2b99-48f8-a792-d2d0331a8aeb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:50.619085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.619584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.620007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.630396 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] Creating event network-vif-unplugged:e51d53e0-2b99-48f8-a792-d2d0331a8aeb for instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e on n-h2-852771-11 Aug 30 17:33:50.636111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8504fe7a-a566-4774-a446-b2e778c57a33 req-809eb621-b63f-4d4a-869e-6ca977ee39bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030347 Aug 30 17:33:50.636733 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1032/1986] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:50.775571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:50.776342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:50.782633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.783112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.783576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.784265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.784708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.785127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.786556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:50.787267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:50.794376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.794861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.795367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.796179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:50.796642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:50.797070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:50.858080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:50.872679 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1af975c6-6529-4b46-9652-9effa511ca94 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1345 microversion: 2.1 time: 0.102111 Aug 30 17:33:50.873358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 955/1987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:50.959854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:50.969647 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3b16c1f-f83f-47c2-adea-4490bf1ced16 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.186915 Aug 30 17:33:50.970541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1033/1988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:51.003512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.004117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:51.012031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.012517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.012951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.013655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.014104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.014558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.203973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.205087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:51.211372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.212013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.212484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.213193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.213646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.214074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.232251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:51.240912 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-137c3f4c-f2fc-4e7d-b937-0feefc4f423c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1321 microversion: 2.1 time: 0.241280 Aug 30 17:33:51.241714 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 956/1989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:50 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:51.247412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.248545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:51.279050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.279593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.280041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.280759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.281207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.281635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.364519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:51.377074 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71daf205-9ffd-491b-aca4-c131af011356 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.177642 Aug 30 17:33:51.377981 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1034/1990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:51 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:51.384849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f663ee98-824e-4697-97b8-f70643ea47fe tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd2a820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.448742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f663ee98-824e-4697-97b8-f70643ea47fe tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.068725 Aug 30 17:33:51.449502 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1035/1991] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:51 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:51.508963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:51.516780 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63114941-11b3-48f5-8db3-a4c8a5edd4ea tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.273254 Aug 30 17:33:51.517359 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 957/1992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:51 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:51.896831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.899055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:51.906090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.906724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.907156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.908094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:51.908546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:51.908960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:51.971896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:51.980271 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-992fc724-b456-4914-b86a-1dfc46ff277e tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1182 microversion: 2.1 time: 0.089881 Aug 30 17:33:51.980842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1036/1993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:51 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1182 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:51.991890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:51.992598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:51.999413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.000131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.000573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.001276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.001761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.002189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.157301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:52.167188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5efc006-ad79-481b-8a05-ac376d1d2196 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.179071 Aug 30 17:33:52.181091 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 958/1994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:51 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:52.271222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:52.272346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:52.286401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.286618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.287052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.290109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.290574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.291013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.403192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:52.404079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:52.413260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.415613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.416268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.417921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.418544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.419258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.515554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:52.534990 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a2015ec-6f12-4a42-8db8-2cae69625042 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1471 microversion: 2.1 time: 0.269276 Aug 30 17:33:52.549693 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1037/1995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:52 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:52.564095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4be187ee-daae-4dfa-918d-973528be60b4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9ccbb430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:52.620392 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4be187ee-daae-4dfa-918d-973528be60b4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.061537 Aug 30 17:33:52.621235 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1038/1996] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:52 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:52.627010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:52.627955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:52.636660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.637562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.638172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.639082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.639922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.640761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:52.723593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:52.746477 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f723c07c-9f94-4961-8087-9264fa57aa14 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.347839 Aug 30 17:33:52.747822 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 959/1997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:52 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:52.824648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:52.825996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] [instance: 2ae5b848-5cb6-4f5d-a138-975bcf7c8941] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:52.836377 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] HTTP exception thrown: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Request method failure captured: Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/2ae5b848-5cb6-4f5d-a138-975bcf7c8941/action HTTP/1.1 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknqbhLnGsoLHwYPxaZUVU17zQzWTEGHBfiNlwH0n90V9xXIoPTMTBUZ4dkhCKuSfBpTdJUUEWcmU-Qk9n82EjVQGNVNjAbpw7jD0WKUYpHomGtQygamgpSTlVMR-VkvDKNUgd1B-WbYnrAgAalAbGW-Ouj-2GPcCqxxDmvarDvrEVg Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:33:52.838387 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_899317ffd40c4754b17e1b824de22fb8"}]}] Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b906a1f35e8a4b5f8d509c79670ca5e2 Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: {"migrate": {}} Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:33:52.840026 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2ae5b848-5cb6-4f5d-a138-975bcf7c8941', 'body': {'migrate': {}}} Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:52.841123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. Aug 30 17:33:52.842773 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:52.844200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Returning 404 to user: Instance 2ae5b848-5cb6-4f5d-a138-975bcf7c8941 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:52.848084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a85407cd-9a24-456d-b167-83b73c30900f tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2ae5b848-5cb6-4f5d-a138-975bcf7c8941/action" status: 404 len: 111 microversion: 2.1 time: 0.098795 Aug 30 17:33:52.848907 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 960/1998] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:52 2022] POST /compute/v2.1/servers/2ae5b848-5cb6-4f5d-a138-975bcf7c8941/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:52.863238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:52.872835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d469cecd-7a6e-4b0b-8453-8784371844ab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.249396 Aug 30 17:33:52.874161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1039/1999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:52 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:52.929142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1299130283", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:52.965496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-plugged", "status": "completed", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:52.989389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:52.989918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:52.990301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.005866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:33:53.019151 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] Creating event network-vif-plugged:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:33:53.031010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-72eeb89f-90d8-4b4d-b6ee-df76d0d508ed req-2d121d9c-e904-4d23-a860-6f99c8b16ade service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068917 Aug 30 17:33:53.032296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1040/2000] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:33:53.037703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.039306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:53.047854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.048550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.049152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.050031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.050650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.051240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.142296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:53.153819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf9ae159-361b-4883-a611-b225c4142a7f tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1182 microversion: 2.1 time: 0.120118 Aug 30 17:33:53.154604 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1041/2001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1182 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:53.191501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.192856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:53.199600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.200874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.201485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.202378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.203020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.203795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.400988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:53.403411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:53.417783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:33:53.418770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:33:53.419519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:33:53.420170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:33:53.420590 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d1b57de-3994-4e87-9af1-74643c4b90b8 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.232886 Aug 30 17:33:53.421029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:33:53.421178 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1042/2002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:53.433004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.433839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.434512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.435760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.437213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.437940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.461100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Getting quotas for project c2fccaba9aa34bbc98b69e09baca041e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:33:53.469105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Getting quotas for user 4ff2753ae0d547589265d28f0a3bd2a6 and project c2fccaba9aa34bbc98b69e09baca041e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:33:53.474752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:53.489317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:33:53.492457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:33:53.542840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b4200d2a-8bbe-47ca-8077-b0fa553530cb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619798 Aug 30 17:33:53.544378 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 961/2003] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:33:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:33:53.555415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8bad378c-52cb-4ff8-93dd-ab18cdb506c1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.556069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8bad378c-52cb-4ff8-93dd-ab18cdb506c1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:53.628136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8bad378c-52cb-4ff8-93dd-ab18cdb506c1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:53.635950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32f808e3-b161-4f63-a559-c26d9b06af97 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9952d700>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.636725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8bad378c-52cb-4ff8-93dd-ab18cdb506c1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1222 microversion: 2.1 time: 0.085694 Aug 30 17:33:53.643522 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1043/2004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:53.694202 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32f808e3-b161-4f63-a559-c26d9b06af97 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.062088 Aug 30 17:33:53.701550 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 962/2005] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:53.768098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.770258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:53.782720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.783836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.787469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.788505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.789763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.790391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.895811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:53.896677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:53.920461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.920950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.921388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:53.925123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:53.925594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:53.926024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.074639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:54.085248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-135418e7-e492-48ac-9f0c-ec6ff950bb2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.320707 Aug 30 17:33:54.087646 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1044/2006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:54.175850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:54.176474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:54.188635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.189134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.189575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.190397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.190732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.191156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.297535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:54.326930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c3c0d89e-c0d1-45d6-abb9-43449ce2a33a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.436441 Aug 30 17:33:54.327622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:54.328534 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 963/2007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:53 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:54.347814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37f33fce-9f1e-44fe-bab3-f044ad6d4d20 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1182 microversion: 2.1 time: 0.176328 Aug 30 17:33:54.348670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1045/2008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:54 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1182 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:54.442409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:54.443019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:54.449593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.450309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.450907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.451847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.452459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.453063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.661720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:54.665468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:54.679818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:54.683713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.688899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.689469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.690316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:54.690901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:54.691429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:54.696681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:54.709402 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a150adaa-eb6a-4b5f-a338-228b3b04df70 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.270647 Aug 30 17:33:54.712249 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 964/2009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:54 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:54.718399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2b9284a-3e30-45ee-ab35-744136692d0c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99032820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:54.801067 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2b9284a-3e30-45ee-ab35-744136692d0c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.087028 Aug 30 17:33:54.810996 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 965/2010] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:54 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:54.875438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:54.885441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1288535f-42d9-4c88-87e9-23176eb035f1 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1274 microversion: 2.1 time: 0.227330 Aug 30 17:33:54.886421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1046/2011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:54 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:55.067055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce90eb33-cc82-4e0c-97e1-043cf62c91c6", "name": "network-vif-plugged", "status": "completed", "tag": "c67221fe-3edb-4e3e-866e-42bdd86b3965"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:55.092097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.092584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.093075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.112443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.113684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:55.113841 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] Creating event network-vif-plugged:c67221fe-3edb-4e3e-866e-42bdd86b3965 for instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 on n-h1-852771-11 Aug 30 17:33:55.121017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ae277576-5237-4447-b0f6-b259d075b8dd req-5862e243-927d-4f1b-81b9-ac01c4fcecc4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060195 Aug 30 17:33:55.122673 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 966/2012] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:55.128830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.129431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.129918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.130776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.131233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.131699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.350381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.352660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:55.375113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.378750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.381197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.383753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.384547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.385175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.414663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:55.423360 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ed2cf4a-6686-4c49-a474-219069b0399f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.315112 Aug 30 17:33:55.427346 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1047/2013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:55.438982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:33:55.440582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.441680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:55.456402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.457472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.458592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.459924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.467241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.468595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.637853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:55.654524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0306f796-0d1d-495f-a76b-bd9284317efb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1182 microversion: 2.1 time: 0.222790 Aug 30 17:33:55.659128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1048/2014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1182 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:55.721630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:55.735412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f86d4274-0ba0-4703-bb56-f3ced1067393 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.390470 Aug 30 17:33:55.736432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.738820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:55.742473 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 967/2015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:55.760945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.761454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.761903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.762627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.763086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.764793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.822399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e0fb93e-a765-4fd8-a061-d92503f825f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99032160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.900117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e0fb93e-a765-4fd8-a061-d92503f825f3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.086158 Aug 30 17:33:55.907603 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 968/2016] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:55.915711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:55.916653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:55.923938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.924647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.925343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:55.926225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:55.926880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:55.927571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.019191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:56.032292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-23661489-82ce-4ead-bba8-3cc6450152ec tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1280 microversion: 2.1 time: 0.123125 Aug 30 17:33:56.032572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:56.035627 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 969/2017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:56.042475 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23f587ed-d92d-4864-b5f6-435b7ab0018b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.310105 Aug 30 17:33:56.047092 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1049/2018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:55 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:56.450845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:56.452188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:56.460113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.461574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.462180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.463070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.463709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.464357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.622254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:56.637856 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19970ec2-1bf0-4bbf-b009-baa05b9c608e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1315 microversion: 2.1 time: 0.195431 Aug 30 17:33:56.643339 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 970/2019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:56 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:56.685115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:56.688387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:56.715595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.716086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.720595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.721372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.721835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.722265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.758527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:56.759543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:56.776308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.779936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.781085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.782545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:56.785269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:56.789417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:56.979964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:56.999207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0763808-b95f-456e-adb5-913f0d1f5a09 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1182 microversion: 2.1 time: 0.316692 Aug 30 17:33:57.011582 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1050/2020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:56 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1182 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:57.020223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b367ccb-5d66-4c74-a2a0-acba8de1cea2 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd93430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:57.123432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b367ccb-5d66-4c74-a2a0-acba8de1cea2 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.122473 Aug 30 17:33:57.124659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1051/2021] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:56 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:57.126593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:57.135235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:57.152228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:57.156947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09ca1234-d744-4c70-b3f4-e383084e4ccb tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.403261 Aug 30 17:33:57.164238 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 971/2022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:56 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:57.174712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.175510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.178271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:57.179109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.180096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:57.180253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.181835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.185975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.200412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.202882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.203418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.204434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.205268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.207053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.438774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:57.449079 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94354712-d7ea-4189-a27c-a46977757402 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.283503 Aug 30 17:33:57.450080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 972/2023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:57 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:57.455709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1e958-79f8-4165-82b0-4e62d28b2d65", "name": "network-vif-plugged", "status": "completed", "tag": "64d4e4fe-cbb4-47ba-9da4-c572ab158f95"}, {"server_uuid": "3eaa00a7-84a8-4192-b6be-f7668ab3cdf6", "name": "network-vif-plugged", "status": "completed", "tag": "9875fa27-9286-4baf-a4fb-9ea97b450667"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:57.470921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.471795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.472471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.497851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Creating event network-vif-plugged:64d4e4fe-cbb4-47ba-9da4-c572ab158f95 for instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 on n-h2-852771-11 Aug 30 17:33:57.499125 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] Creating event network-vif-plugged:9875fa27-9286-4baf-a4fb-9ea97b450667 for instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 on n-h1-852771-11 Aug 30 17:33:57.508477 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f5802e10-ab89-442c-a56c-e4e0c7cdec8e req-d94cca67-6f83-46ad-a1e4-d2cccb988433 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055848 Aug 30 17:33:57.509643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 973/2024] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:57.570982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:57.579460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b4fea7d-5e0f-4139-90f0-fc2e41042a08 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.453484 Aug 30 17:33:57.585917 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1052/2025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:57 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:57.670909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:57.671984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:57.692097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.692579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.693026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:57.693705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:57.694150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:57.694592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.028797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:58.029421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:58.045624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.049501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.050031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.050793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.051268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.051739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.051955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:58.064107 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9f560d3c-eb2c-468a-9c5a-9f26b7e08347 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1503 microversion: 2.1 time: 0.407675 Aug 30 17:33:58.064107 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 974/2026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:57 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:58.089350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1258694162"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:58.089879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:58.112036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.112553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.112992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.114046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.114543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.114980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.115432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lazy-loading 'fault' on Instance uuid 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:33:58.117699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.118206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.118648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.184155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:58.193928 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08834e29-8f31-4aac-ab37-e9de5180f3d7 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 200 len: 1187 microversion: 2.1 time: 0.169371 Aug 30 17:33:58.198497 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1053/2027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:58 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 1187 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:58.204083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b47be5c-098a-4255-80ba-bfe5081904c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9ccd05e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:58.299899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b47be5c-098a-4255-80ba-bfe5081904c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.099864 Aug 30 17:33:58.302137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1054/2028] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:58 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:58.309594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:58.310403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:58.328335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.331545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.332350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.333636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.336610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.337280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.456501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.network.security_group_api [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Adding security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 to port c67221fe-3edb-4e3e-866e-42bdd86b3965 Aug 30 17:33:58.615932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:58.630973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ac19858-0e08-48c5-b1bb-739d02d69a05 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1324 microversion: 2.1 time: 0.325620 Aug 30 17:33:58.631837 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1055/2029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:58 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:58.645394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9347dc-da13-443a-b470-7f0d1edd5a87", "tag": "b2c65f7c-6630-48da-954c-a4acfc9ce341"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:58.667455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.668248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.670735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.699470 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] Creating event network-changed:b2c65f7c-6630-48da-954c-a4acfc9ce341 for instance bc9347dc-da13-443a-b470-7f0d1edd5a87 on n-h1-852771-11 Aug 30 17:33:58.707511 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-61a06f58-2771-4652-b208-4044e825ce2f req-206a9307-3782-4bda-9eab-cf50c46731c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071894 Aug 30 17:33:58.709641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1056/2030] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:58.722997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:58.724035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:58.741076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.747184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.747891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:58.748819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:58.749446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:58.750212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.068648 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03400061-d92f-4059-9dfe-6f97d3fa6477 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action" status: 202 len: 0 microversion: 2.1 time: 0.981540 Aug 30 17:33:59.069344 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 975/2031] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:58 2022] POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:59.073263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:59.074420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.075042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:59.087932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.088423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.088852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.091026 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb85501d-00cd-4376-83d0-8e697c87a396 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1522 microversion: 2.1 time: 0.372137 Aug 30 17:33:59.093192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.093682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.094190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.094768 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1057/2032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:58 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:59.104179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cc9dc10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.471222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use.", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:33:59.471887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.471887 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.472786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7 HTTP/1.1 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:33:59.473858 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: exception: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.475678 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '03b7c02c-74cf-4ff8-8270-8c2fa37440a7'} Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:59.477321 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.478822 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.480308 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 400 to user: Security Group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 in use. Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-5993da2b-5022-4782-8d49-49ace5910c03'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5e3e55c-e7d0-4cd5-8f02-c0a217cced24 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7" status: 400 len: 185 microversion: 2.1 time: 0.378576 Aug 30 17:33:59.483715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1058/2033] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:33:59 2022] DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7 => generated 185 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:33:59.486435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce90eb33-cc82-4e0c-97e1-043cf62c91c6", "tag": "c67221fe-3edb-4e3e-866e-42bdd86b3965"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:59.493187 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50cfaaaa-7de7-453b-bac0-abf8231a46cd tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.422348 Aug 30 17:33:59.496063 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 976/2034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:59 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:59.529397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.529899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.530339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.530740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.531970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:59.551329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.555583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.557407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.558236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.560921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.563075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.582077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] Creating event network-changed:c67221fe-3edb-4e3e-866e-42bdd86b3965 for instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 on n-h1-852771-11 Aug 30 17:33:59.609792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ceddf2f7-47e7-4d7d-81bd-c2427258d5c0 req-f009895a-e712-4300-9b09-3c53f63fa73c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130899 Aug 30 17:33:59.611073 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1059/2035] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:33:59.618437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cae97922-d85f-4907-b7c7-f03ef3d5acfa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cdab160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.624954 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] HTTP exception thrown: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Request method failure captured: Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a HTTP/1.1 Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhL1JpVwAhjhV5MAc93jYFQcKTZLqofY0NPgkvt5YXQ4c40bjTNzY7q8ohqaLeQWt5ADNj-xWIPjWr991vmJdR_P12PEfCBol_DOgy0R-73xkq_GXyhNdNqiKw_DXx9nVcFmhvRlQrzB5OUX35rChqFV9CvFkYBtpegqny5oQf-OcY Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:33:59.650083 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75c6078a31ba4cafb47564e45e877c1f"}]}] Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationTest-1450711586 Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationTest-1450711586-project Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 5fa0c244b665489ab32553dd33c47518 Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationTest-1450711586-project Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. Aug 30 17:33:59.652066 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3898b1d1-8da4-4809-8fbc-7d5eb9c0707a'} Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:33:59.653119 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. Aug 30 17:33:59.654833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:33:59.658347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Returning 404 to user: Instance 3898b1d1-8da4-4809-8fbc-7d5eb9c0707a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:33:59.666272 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-784dbf06-2133-4c0a-a39d-edcd0fae0158 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a" status: 404 len: 111 microversion: 2.1 time: 0.166010 Aug 30 17:33:59.672860 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 977/2036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:59 2022] GET /compute/v2.1/servers/3898b1d1-8da4-4809-8fbc-7d5eb9c0707a => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:33:59.687545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:59.694664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:59.707055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.709504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.712353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.715660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.718269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.718723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.720017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cae97922-d85f-4907-b7c7-f03ef3d5acfa tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.107379 Aug 30 17:33:59.720723 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1060/2037] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:33:59 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:59.735111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.743309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:59.767896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.768770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.772071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.774072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:59.781744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:59.784074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:59.953199 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e47dc9f-61a4-48b2-82c3-ec2965d40dee tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action" status: 202 len: 0 microversion: 2.1 time: 0.275360 Aug 30 17:33:59.961456 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 978/2038] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:33:59 2022] POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:33:59.982165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:59.983937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.004462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.005148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.005598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.009344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.010051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.010764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.111726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:00.123384 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be8f3d61-3e82-44a1-a270-296174d3290b tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1520 microversion: 2.1 time: 0.399833 Aug 30 17:34:00.124672 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1061/2039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:59 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:00.158990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:00.160020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.169049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.169951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.170681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.171663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.172378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.173188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.370434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:00.383971 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea6fc3c3-2596-4150-879d-83ebeeaa5e89 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1574 microversion: 2.1 time: 0.415496 Aug 30 17:34:00.385062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 979/2040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:59 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1574 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:00.399423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:00.400438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.406724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.409086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.409806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.420195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.421447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.422626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.436480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:00.448651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01fe6a50-4db7-4c42-8316-83959e45dd1a tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1520 microversion: 2.1 time: 0.294421 Aug 30 17:34:00.463502 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1062/2041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:00 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:00.476941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-974449411"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:00.479565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.495803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.496590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.497241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.498245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.498890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.499525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.612700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:00.622639 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1a49e04-6300-47cc-ad5b-777d7b0922a5 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1507 microversion: 2.1 time: 0.236222 Aug 30 17:34:00.623918 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 980/2042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:00 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:00.628754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:00.629629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.637232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.638121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.639312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.640358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.641051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.641702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.878850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:00.879350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07fb53b4-daa0-428d-881a-d5a7dfc17184 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6/action" status: 202 len: 0 microversion: 2.1 time: 0.407904 Aug 30 17:34:00.890608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e7e8f48-7ec1-486c-b76a-bb64c684111f tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.264594 Aug 30 17:34:00.897998 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 981/2043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:00 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:00.898235 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1063/2044] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:00 2022] POST /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:34:00.898376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:00.898939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:00.900477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6f9d66e-2b39-4143-bdf4-c2f0130f109f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc57dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:00.943511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.944020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.945075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:00.946052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:00.946517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:00.946951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.001510 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6f9d66e-2b39-4143-bdf4-c2f0130f109f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.107270 Aug 30 17:34:01.002185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1064/2045] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:00 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:01.018345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86822f06-3122-4b4a-8b13-58a8244dc346 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d9ccc6310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:01.300518 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86822f06-3122-4b4a-8b13-58a8244dc346 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748" status: 204 len: 0 microversion: 2.1 time: 0.297240 Aug 30 17:34:01.304501 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1065/2046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:01 2022] DELETE /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:01.309504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b3e1802-7815-4f54-8483-9d9ada0b7144 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d9cd2aa60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:01.339583 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4b3e1802-7815-4f54-8483-9d9ada0b7144 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Image not found. Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b3e1802-7815-4f54-8483-9d9ada0b7144 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748 HTTP/1.1 Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:01.343079 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bc537404-19b9-4c92-ae46-1ec9f7263748'} Aug 30 17:34:01.344760 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:34:01.345734 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bc537404-19b9-4c92-ae46-1ec9f7263748 Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:34:01.348186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc537404-19b9-4c92-ae46-1ec9f7263748 could not be found. Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:01.351807 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:34:01.354484 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:01.357116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b3e1802-7815-4f54-8483-9d9ada0b7144 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:01.357913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b3e1802-7815-4f54-8483-9d9ada0b7144 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748" status: 404 len: 62 microversion: 2.1 time: 0.052131 Aug 30 17:34:01.361853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1066/2047] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:01 2022] GET /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:01.401401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:01.402254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:01.421325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.421824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.422260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.422973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.423431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.423883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.426918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:01.708878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:01.719346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d1e694b-5eda-4df5-a062-56238bedb847 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 200 len: 1507 microversion: 2.1 time: 0.825801 Aug 30 17:34:01.720404 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 982/2048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:00 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 1507 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:01.725267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:01.726481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:01.734560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.735177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.735648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.736346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.745572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.752216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.790070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:01.799761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9eaf718b-2c6f-491d-bf6f-8ad8cf1568d7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1532 microversion: 2.1 time: 0.435407 Aug 30 17:34:01.812401 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1067/2049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:01 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1532 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:01.824972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:01.825835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:01.853536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.854426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.855120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.856147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:01.856839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:01.857545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:01.925715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:02.110648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f5dbfc5-007c-4171-95a6-ebc0e994dc5b tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 204 len: 0 microversion: 2.1 time: 0.296436 Aug 30 17:34:02.111909 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1068/2050] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:01 2022] DELETE /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:02.118436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:02.127998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:02.140546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:02.159003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.159419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.159890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.168054 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-324ee48d-c250-4fa3-a6b9-d551354557f6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1574 microversion: 2.1 time: 0.438481 Aug 30 17:34:02.175398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.176045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.176496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.184478 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 983/2051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:01 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1574 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:02.196209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a3802f59-21a8-4960-971f-291822c99dc5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99327d30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:02.270348 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a3802f59-21a8-4960-971f-291822c99dc5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.082423 Aug 30 17:34:02.270961 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 984/2052] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:02 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:02.297232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:02.302762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:02.309299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Searching by: {'deleted': False, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:34:02.325711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.326197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.327864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.327864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.327864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.328224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.505209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:02.514138 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-768a1f8f-367f-4071-9f6d-8779e5596c8c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.400721 Aug 30 17:34:02.517695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1069/2053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:02 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:02.537433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-669901994", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "5cbe98ac-21be-43d9-bb02-1945a3517c1d"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:02.562756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:02.564789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:34:02.627201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] validate_networks() for [('5cbe98ac-21be-43d9-bb02-1945a3517c1d', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:34:02.704182 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24fa7259-15c5-46cb-8736-c9128bb93d4e tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.419348 Aug 30 17:34:02.713211 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 985/2054] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:34:02 2022] GET /compute/v2.1/servers => generated 334 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:02.720930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:02.726788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:02.727599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Searching by: {'deleted': False, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:34:02.735664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.736151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.736587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.737314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:02.737763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:02.738183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:02.889483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:34:02.892615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:03.016925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=19 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:03.020600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:03.031259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.032012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.032607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.250263 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48fd3616-9628-4841-b0e0-94e42cdcd7c0 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.535829 Aug 30 17:34:03.251200 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 986/2055] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:34:02 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:03.267614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:03.268288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:03.278293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.278957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.280813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.281176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.283709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.284378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.488064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:03.502942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-483ba6c2-aa18-40fd-850c-9853ae267af9 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1538 microversion: 2.1 time: 0.250711 Aug 30 17:34:03.503646 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 987/2056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:03 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1538 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:03.523103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:03.524022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:03.552056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.552548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.553087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.554666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.555322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.555792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.636198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:03.737166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:34:03.737890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:34:03.738562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:34:03.739163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:34:03.739828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:34:03.753574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.754313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.754936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.755901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:03.756548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:03.757874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:03.779889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:03.787248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Getting quotas for user dadf1246d7264e3ba4f840a27b1f4aad and project 9afa023006894034b07e5ea18652e34f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:03.815978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:34:03.818576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:34:03.821369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:03.836082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fffa03cc-9c58-4775-9ccc-83f8e9ce1812 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1574 microversion: 2.1 time: 0.317056 Aug 30 17:34:03.857681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 988/2057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:03 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1574 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:03.873120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17ddb26d-df7d-4377-b011-efa478c1ef61 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:03.901288 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17ddb26d-df7d-4377-b011-efa478c1ef61 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040991 Aug 30 17:34:03.910972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 989/2058] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:34:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:03.918521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e21dac07-f044-439d-abb6-fd021e1a30f5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98ed93a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:03.951874 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-759e7b46-f49d-4c2c-a331-403cb623462f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417648 Aug 30 17:34:03.953237 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1070/2059] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:34:03.958078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:03.964538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:04.013939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.014780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.015520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.016436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.020058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.020742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.032029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e21dac07-f044-439d-abb6-fd021e1a30f5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.119581 Aug 30 17:34:04.032553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 990/2060] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:03 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:04.061490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-255469c8-6344-432e-9fa0-7b2c838b25c0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:04.062220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-255469c8-6344-432e-9fa0-7b2c838b25c0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:04.299991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-255469c8-6344-432e-9fa0-7b2c838b25c0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:04.308881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-255469c8-6344-432e-9fa0-7b2c838b25c0 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1217 microversion: 2.1 time: 0.275277 Aug 30 17:34:04.309472 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 991/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:04 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:04.338542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:04.339038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:04.369267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:04.387374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.387906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.388346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.388497 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee8e87fb-f937-4fe7-be4e-a729974ac346 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.433233 Aug 30 17:34:04.389049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.389429 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1071/2062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:03 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:04.402800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.403282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.477756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:04.533688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:04.534452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:04.554728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.555164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.556557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.561068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.561587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.563576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.714647 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97858fd6-8244-4fc5-b35b-058ecfcd0f98 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 204 len: 0 microversion: 2.1 time: 0.379948 Aug 30 17:34:04.719508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 992/2063] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:04 2022] DELETE /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:04.743609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:04.744383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:04.766583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.767077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.767540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:04.768272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:04.768714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:04.775979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.063711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:05.080226 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fbdb22a-295f-4c69-8ff1-dd95613c2677 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1520 microversion: 2.1 time: 0.556988 Aug 30 17:34:05.097454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1072/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:04 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:05.119346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:05.120563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:05.143101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.146503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.150386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.151413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.152510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.154205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.284806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:05.296110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbb1662f-c8d0-4a09-8eda-cbf4c6f02542 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1701 microversion: 2.1 time: 0.572200 Aug 30 17:34:05.305282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 993/2065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:04 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1701 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:05.332105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-da4c970f-6f98-4d1a-8b27-ed65e888375a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9872ee50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:05.452045 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-da4c970f-6f98-4d1a-8b27-ed65e888375a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.145411 Aug 30 17:34:05.462674 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 994/2066] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:05 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:05.469693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:05.470417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:05.486049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.490742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.494724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.496595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.496898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.497334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.566725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:05.588807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:05.599341 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3dec979-34c5-478f-96be-233b9305f415 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1572 microversion: 2.1 time: 0.500303 Aug 30 17:34:05.601179 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1073/2067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:05 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1572 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:05.612480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:05.613396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:05.635598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.636576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.637355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.638270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.646662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.648250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.772502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:05.783096 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b075d48-2135-4c59-8258-9dc5d4e46ef1 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1221 microversion: 2.1 time: 0.180526 Aug 30 17:34:05.784001 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1074/2068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:05 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:05.801238 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96ce69f4-6463-4246-9e39-98adde8e3a35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 204 len: 0 microversion: 2.1 time: 0.337158 Aug 30 17:34:05.802366 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 995/2069] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:05 2022] DELETE /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:05.805237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:05.806662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:05.810128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1e958-79f8-4165-82b0-4e62d28b2d65", "name": "network-vif-deleted", "tag": "64d4e4fe-cbb4-47ba-9da4-c572ab158f95"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:05.816741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.817446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.818082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.818996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.820404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.821041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.822518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.823073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.823595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.839924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] Creating event network-vif-deleted:64d4e4fe-cbb4-47ba-9da4-c572ab158f95 for instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 on n-h2-852771-11 Aug 30 17:34:05.845090 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0c7adb3e-6c92-4f85-85c6-f35fd4ea3374 req-98588d54-6fce-4484-b245-01279fc62308 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040922 Aug 30 17:34:05.853140 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 996/2070] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:05.860816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-924700872"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:05.861847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:05.872302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.873149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.873804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:05.874712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:05.875744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:05.876459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:06.135136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:06.148471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52371549-5cb3-4f54-b446-f412908b1c81 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.351117 Aug 30 17:34:06.153413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1075/2071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:05 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:06.159883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:06.161936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:06.181321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:06.181715 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.network.security_group_api [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Adding security group 3df7c835-d71f-4082-a871-1c34cc809baa to port c67221fe-3edb-4e3e-866e-42bdd86b3965 Aug 30 17:34:06.182246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:06.183392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:06.184300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:06.185263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:06.185957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:06.492874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:06.521063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d40b4f77-1701-4a1a-a3da-ca93f7255568 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1526 microversion: 2.1 time: 0.365052 Aug 30 17:34:06.524575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1076/2072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:06 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1526 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:06.531007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:06.531977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:06.561668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:06.563568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:06.565917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:06.569260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:06.570359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:06.570907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:07.423271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:07.431258 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c97a8722-a3cc-47db-a6e6-164a584e6256 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1701 microversion: 2.1 time: 0.904817 Aug 30 17:34:07.443572 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1077/2073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:06 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1701 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:07.443572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7b6ad83-f111-4fa6-b42c-905fd39d6b0c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc57280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:07.498554 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7b6ad83-f111-4fa6-b42c-905fd39d6b0c tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.065103 Aug 30 17:34:07.499802 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1078/2074] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:07 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:07.505297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:07.506177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:07.517431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:07.517925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:07.518361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:07.519069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:07.519535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:07.519963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:07.732167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:07.748660 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f0eb7c08-374f-44fe-8cf9-a004452cf320 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1269 microversion: 2.1 time: 0.244573 Aug 30 17:34:07.767103 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1079/2075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:07 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:07.783256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:07.785292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:07.798706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:07.800074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:07.802243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:07.805997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:07.806898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:07.807650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:07.878800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:08.145901 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-389a53ca-5708-4071-8fa5-1875a0f84413 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 204 len: 0 microversion: 2.1 time: 0.376869 Aug 30 17:34:08.150869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1080/2076] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:07 2022] DELETE /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:08.156138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:08.156766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:08.182390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.182902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.183340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.184150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.184611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.185081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.201851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b237dfbd-b2bc-4291-af21-e34c5906a9c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action" status: 202 len: 0 microversion: 2.1 time: 2.346956 Aug 30 17:34:08.202705 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 997/2077] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:05 2022] POST /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6/action => generated 0 bytes in 2349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:08.208712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:08.210272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:08.231151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.232223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.233762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.238649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.239786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.242373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.919620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:08.936840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-524e9a8c-435c-457d-8f23-fad45bceac1e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.784714 Aug 30 17:34:08.952703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1081/2078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:08 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:08.958049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:08.958982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:08.965558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.966324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.967111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.968347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:08.969195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:08.969844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:08.976494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:09.239807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:09.263416 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5d6aa67-a9ba-4a9c-9008-569107755563 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 200 len: 1526 microversion: 2.1 time: 1.058215 Aug 30 17:34:09.282182 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 998/2079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:08 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 1526 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:09.295573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cca6940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:09.297634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:09.310022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc1edff1-2623-463d-980d-033ccdda53eb tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1668 microversion: 2.1 time: 0.355761 Aug 30 17:34:09.323405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1082/2080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:08 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:09.323405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce90eb33-cc82-4e0c-97e1-043cf62c91c6", "tag": "c67221fe-3edb-4e3e-866e-42bdd86b3965"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:09.349358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:09.350004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:09.351058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:09.367980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] Creating event network-changed:c67221fe-3edb-4e3e-866e-42bdd86b3965 for instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 on n-h1-852771-11 Aug 30 17:34:09.387503 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b4b8bd4e-9ed3-48e1-a6ae-135308d545a5 req-bd25ecff-54cd-4215-a5c9-2a5957c25fa5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075027 Aug 30 17:34:09.388537 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1083/2081] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:09.405443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:09.406277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:09.427524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:09.428036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:09.428542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:09.439624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:09.440346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:09.441998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:09.569056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e96a97ef7748f99a0a71e456c91276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab904bdc06b24b34ac4b151b44bb6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:09.582507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e3eee2f-271c-4a94-bc5e-a1cdb7461d8a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 200 len: 1633 microversion: 2.1 time: 0.191906 Aug 30 17:34:09.596594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1084/2082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:09 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 1633 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:09.596594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fb3a98b-e474-4f7e-a456-51ff37444e6e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc57dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:09.670539 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fb3a98b-e474-4f7e-a456-51ff37444e6e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.085758 Aug 30 17:34:09.672622 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1085/2083] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:09 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:09.690968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:09.691741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:09.700808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:09.701571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:09.702488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:09.703974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:09.704448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:09.704880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.133273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:10.150514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-258b906c-acf4-4588-a083-270f63fbc0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1275 microversion: 2.1 time: 0.474695 Aug 30 17:34:10.163510 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1086/2084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:09 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1275 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:10.164790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaa00a7-84a8-4192-b6be-f7668ab3cdf6", "name": "network-vif-deleted", "tag": "9875fa27-9286-4baf-a4fb-9ea97b450667"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:10.192961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.193368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.193832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.224185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] Creating event network-vif-deleted:9875fa27-9286-4baf-a4fb-9ea97b450667 for instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 on n-h1-852771-11 Aug 30 17:34:10.237790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-16b4eabc-ba7c-460e-bc2d-5d122dda647a req-9c4b3a5b-5763-4ecf-9d11-88ab6c6c940b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082862 Aug 30 17:34:10.239369 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1087/2085] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:10.254195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9347dc-da13-443a-b470-7f0d1edd5a87", "name": "network-vif-plugged", "status": "completed", "tag": "b2c65f7c-6630-48da-954c-a4acfc9ce341"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:10.293671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.302516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.303010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.335447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] Creating event network-vif-plugged:b2c65f7c-6630-48da-954c-a4acfc9ce341 for instance bc9347dc-da13-443a-b470-7f0d1edd5a87 on n-h1-852771-11 Aug 30 17:34:10.347615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b5fa8cb6-4e9e-490d-b196-6b1442701aa7 req-3787364b-28fb-4fdb-aa15-ab21cad52fee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104844 Aug 30 17:34:10.348733 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1088/2086] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:10.382636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:10.387669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:10.405625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.406948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.407394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.411307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.411835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.412332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.552637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use.", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:10.555349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.555349 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa HTTP/1.1 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:10.559267 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: exception: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.561133 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3df7c835-d71f-4082-a871-1c34cc809baa'} Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:10.562211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.564108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.565633 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] Aug 30 17:34:10.567559 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.585652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 400 to user: Security Group 3df7c835-d71f-4082-a871-1c34cc809baa in use. Aug 30 17:34:10.585652 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-2f4d67a4-90a6-4a4d-9ec6-da3c80a393d4'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:10.589087 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2942e5d-cbb8-4594-baf7-cdf76e1d3bac tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa" status: 400 len: 185 microversion: 2.1 time: 1.305231 Aug 30 17:34:10.611749 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 999/2087] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:09 2022] DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa => generated 185 bytes in 1321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:10.624729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:10.625620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:10.638510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.639452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.640132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.642174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.643246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.644032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.684225 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 HTTP/1.1 Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:10.686162 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:10.687819 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3eaa00a7-84a8-4192-b6be-f7668ab3cdf6'} Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:10.688724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:10.690140 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:10.691415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:10.691415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5154ccb9-2780-47b7-a795-764870cdbc75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 404 len: 111 microversion: 2.1 time: 0.075857 Aug 30 17:34:10.712554 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1000/2088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:10 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:10.726738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:10.727383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:10.744854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.752955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.753520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.754272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.754734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.755152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.932068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:10.943070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bcd2a280-08b0-4f2a-ab8f-c654e5dde92e tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.590180 Aug 30 17:34:10.944081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1089/2089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:10 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:10.948926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:10.950032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:10.959026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.960457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.960898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:10.961784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:10.962242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:10.963286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.010191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:11.168567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4840cecb-05e2-4452-a503-18ff5f9a0e63 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 204 len: 0 microversion: 2.1 time: 0.223037 Aug 30 17:34:11.170185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1090/2090] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:10 2022] DELETE /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:11.176327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:11.177364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] [instance: 60c4e35d-5257-4de7-9113-1ede40fa41b8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:11.188934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.189891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.190616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.191700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.192404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.193080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.209948 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] HTTP exception thrown: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Request method failure captured: Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 HTTP/1.1 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkm1RD-YoeujfclPRupPzpYjKUyNdb2CQognYs9cxYYCQH0eFhIScdbO1KDBwuZRyTapV5IOQpQktfbVHpkHAEUePCW9vxCLWW1yGEcVWOU_0scObDIzof83v0SUL7xCoOjDuzsjOFpG9AaJwLqnQjIMhi-IWonhuWS7d47csX49Dww Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ab904bdc06b24b34ac4b151b44bb6944 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-626310874 Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:11.211890 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab904bdc06b24b34ac4b151b44bb6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab904bdc06b24b34ac4b151b44bb6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab904bdc06b24b34ac4b151b44bb6944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab904bdc06b24b34ac4b151b44bb6944"}]}] Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-626310874 Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ab904bdc06b24b34ac4b151b44bb6944 Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-626310874 Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-626310874-project Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 19e96a97ef7748f99a0a71e456c91276 Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-626310874-project Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. Aug 30 17:34:11.213746 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '60c4e35d-5257-4de7-9113-1ede40fa41b8'} Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:11.214806 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. Aug 30 17:34:11.216657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:11.218293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Returning 404 to user: Instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:11.218785 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-28c6d2c2-deb6-4c1c-bc6e-6a147e4090e4 tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8" status: 404 len: 111 microversion: 2.1 time: 0.045729 Aug 30 17:34:11.219780 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1091/2091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:11 2022] GET /compute/v2.1/servers/60c4e35d-5257-4de7-9113-1ede40fa41b8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:11.224451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9356c56-ef10-490a-aabe-e4d6c847225d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc5c280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:11.288749 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9356c56-ef10-490a-aabe-e4d6c847225d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.067004 Aug 30 17:34:11.292922 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1092/2092] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:11 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:11.298771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-152898303", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:11.363672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] validate_networks() for [('3fe8a62b-b271-49fd-8999-906f2116a7d7', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:34:11.439208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:11.453355 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0aba6480-5bc9-4316-aee1-b1c60350a6d2 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1668 microversion: 2.1 time: 0.739234 Aug 30 17:34:11.453951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1001/2093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:10 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1668 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:11.459098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:11.460330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:11.466896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.467781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.468426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.469311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.469937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.470540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.922092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:34:11.922092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:34:11.922092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:34:11.922092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:34:11.922849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:34:11.925180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:11.935068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.935710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.936251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.937108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.937728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.938252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.938484 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12d673c2-823b-4965-bd0d-f145ef06dc69 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.479627 Aug 30 17:34:11.945188 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1002/2094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:11 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:11.950214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:11.952174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:11.966840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.968120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.968782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.970025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:11.970659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:11.976914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:11.977697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:11.985156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Getting quotas for user e81a00b7d1af419b8dadb0f1187ad4b7 and project c77cf8ad0921438ca137b201152c3d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:12.002808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:34:12.005905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:34:12.076785 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e57a946-2db6-4875-a27f-ccb508ef1c37 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.782329 Aug 30 17:34:12.082926 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1093/2095] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:34:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:34:12.091518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-203cdee0-b337-48f9-be41-536e857a694a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] Calling method '.version_select at 0x7f2d9cc57430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.170366 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-203cdee0-b337-48f9-be41-536e857a694a tempest-ServersTestJSON-626310874 tempest-ServersTestJSON-626310874-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504879311" status: 202 len: 0 microversion: 2.1 time: 0.084817 Aug 30 17:34:12.175286 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1094/2096] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504879311 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:12.201214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4e35d-5257-4de7-9113-1ede40fa41b8", "name": "network-vif-deleted", "tag": "6cce652b-7ed1-42af-b33e-7ddfcc1668b1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:12.241698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.245397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.245991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.281417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] Creating event network-vif-deleted:6cce652b-7ed1-42af-b33e-7ddfcc1668b1 for instance 60c4e35d-5257-4de7-9113-1ede40fa41b8 on n-h2-852771-11 Aug 30 17:34:12.294765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f322afe0-ef03-49d2-b2f8-6c355360b427 req-30bbea34-0672-48fc-bb6b-15340b65350a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117090 Aug 30 17:34:12.296009 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1095/2097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:12.311765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.314030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:12.334435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.335088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.338868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.339593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.340200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.340745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.545635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:12.559705 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe8f6ca7-a181-4280-911f-77eda7767564 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1646 microversion: 2.1 time: 0.613068 Aug 30 17:34:12.565240 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1003/2098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:11 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1646 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:12.580867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ed8ee74-22e0-4c4e-81d7-dec128e736c7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.581704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ed8ee74-22e0-4c4e-81d7-dec128e736c7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:12.775689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:12.786021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:12.788534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8ed8ee74-22e0-4c4e-81d7-dec128e736c7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:12.797379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ed8ee74-22e0-4c4e-81d7-dec128e736c7 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1224 microversion: 2.1 time: 0.230790 Aug 30 17:34:12.800187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c054fd4f-ab06-44f9-b9ad-fbf9077efb36 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1322 microversion: 2.1 time: 0.501709 Aug 30 17:34:12.801170 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1004/2099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:12 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1224 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:12.807022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1096/2100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:12 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:12.816553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44c77edd-d3d4-4142-bce8-6e2c9db10e0f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cb983a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.826873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.827975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:12.840088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.842803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.843642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.844618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.850993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.852137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.916713 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44c77edd-d3d4-4142-bce8-6e2c9db10e0f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.114145 Aug 30 17:34:12.917870 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1005/2101] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:12 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:12.964072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:12.964795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:12.971903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.972394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.972829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:12.973569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:12.973984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:12.976749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:13.184143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:13.202479 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c958c890-9dcf-4432-a899-5c486e1b70e0 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 200 len: 1600 microversion: 2.1 time: 0.390862 Aug 30 17:34:13.203128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1097/2102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:12 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 1600 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:13.589623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:13.590596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:13.610889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:13.612468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:13.613777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:13.615282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:13.617781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:13.618413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.151313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:14.161654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:14.174412 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ab5f128-9b71-4b90-8594-7ef246683803 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1646 microversion: 2.1 time: 0.594055 Aug 30 17:34:14.175746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c1160167-e2c3-4ef8-8932-a5aff5a35424 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 1.215397 Aug 30 17:34:14.179838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1006/2103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:12 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:14.199641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1098/2104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:13 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1646 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:14.208151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:14.220433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:14.230780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:14.234902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.236431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.239034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.240233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.241759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.242825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:14.243510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:14.243638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.252675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.253765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.268604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.270821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.271514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.272668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.493504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:14.498371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:14.510769 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d187b712-bce8-4016-956d-42954c3ac067 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1276 microversion: 2.1 time: 0.329568 Aug 30 17:34:14.529183 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1007/2105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:14 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:14.534757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-42241a01-9153-41ab-9a9e-80d673077b0d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9851bd30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:14.617266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-42241a01-9153-41ab-9a9e-80d673077b0d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.086764 Aug 30 17:34:14.619146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1008/2106] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:14 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:14.629458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:14.630053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2afbaf50-34c4-41d7-9bca-5e8c16386de1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:14.655983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.656480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.656918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.657643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.658093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.658516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.698213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] HTTP exception thrown: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Request method failure captured: Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 HTTP/1.1 Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhL1JpVwAhjhV5MAc93jYFQcKTZLqofY0NPgkvt5YXQ4c40bjTNzY7q8ohqaLeQWt5ADNj-xWIPjWr991vmJdR_P12PEfCBol_DOgy0R-73xkq_GXyhNdNqiKw_DXx9nVcFmhvRlQrzB5OUX35rChqFV9CvFkYBtpegqny5oQf-OcY Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:14.714586 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75c6078a31ba4cafb47564e45e877c1f"}]}] Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 5fa0c244b665489ab32553dd33c47518 Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. Aug 30 17:34:14.716400 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2afbaf50-34c4-41d7-9bca-5e8c16386de1'} Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:14.717553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. Aug 30 17:34:14.719254 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:14.733171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Returning 404 to user: Instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:14.734339 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11034112-c041-4833-a990-d61436c6002b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1" status: 404 len: 111 microversion: 2.1 time: 0.114219 Aug 30 17:34:14.736122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1009/2107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:14 2022] GET /compute/v2.1/servers/2afbaf50-34c4-41d7-9bca-5e8c16386de1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:14.749678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afbaf50-34c4-41d7-9bca-5e8c16386de1", "name": "network-vif-deleted", "tag": "5acd22a2-188e-4861-81f4-f46157e794f5"}, {"name": "network-changed", "server_uuid": "f9bfd72d-e206-4e8f-983b-5a0737a855ed", "tag": "7bd88ef8-b053-45dc-9fed-606b6a70b0f0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:14.794913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.795751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.796433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.819838 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Creating event network-vif-deleted:5acd22a2-188e-4861-81f4-f46157e794f5 for instance 2afbaf50-34c4-41d7-9bca-5e8c16386de1 on n-h1-852771-11 Aug 30 17:34:14.829230 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] Creating event network-changed:7bd88ef8-b053-45dc-9fed-606b6a70b0f0 for instance f9bfd72d-e206-4e8f-983b-5a0737a855ed on n-h2-852771-11 Aug 30 17:34:14.851529 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d18333fa-79e4-4df7-b208-b40127afaf54 req-00fdb7fa-1560-4c2e-bec2-aa78a21517a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.113827 Aug 30 17:34:14.852927 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1010/2108] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:14.866162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c140a164-f8a4-4ad2-b9df-0dda49645f23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '.version_select at 0x7f2d98ef80d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:14.907097 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c140a164-f8a4-4ad2-b9df-0dda49645f23 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326200053" status: 202 len: 0 microversion: 2.1 time: 0.052738 Aug 30 17:34:14.908465 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1011/2109] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326200053 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:14.908843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:14.916673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d60bbdd4-79ed-46e5-835f-a99b62f17f80 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1471 microversion: 2.1 time: 0.715194 Aug 30 17:34:14.917237 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1099/2110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:14 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1471 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:14.951365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:14.951945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:14.964974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.965530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.973411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:14.975068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:14.975854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:14.976566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.010580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lazy-loading 'flavor' on Instance uuid bc9347dc-da13-443a-b470-7f0d1edd5a87 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:15.158519 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-60b936b7-b933-4841-b91b-249b44ce5c3b tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87/action" status: 202 len: 0 microversion: 2.1 time: 0.209488 Aug 30 17:34:15.164255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1012/2111] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:14 2022] POST /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:15.173970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:15.174588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:15.181923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.182411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.182864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.183617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.184058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.184481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.203625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:15.204858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:15.231699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.232169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.232600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.233562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.234000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.234448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.700059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb9d2e7b-b35d-4891-92b6-fd1ec0487930 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1632 microversion: 2.1 time: 0.534336 Aug 30 17:34:15.700649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1100/2112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:15 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1632 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:15.714818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:15.718364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:15.727236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.728044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.728959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.730253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:15.730887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:15.731821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:15.953284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:15.972026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-81fbbccf-5e26-43e5-bfdb-c6a3008ef33e tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.774235 Aug 30 17:34:15.972291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:15.989382 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1013/2113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:15 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:15.989814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01205fa3-a444-408e-b3fc-cec294630b84 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1646 microversion: 2.1 time: 0.278885 Aug 30 17:34:15.989978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:15.989978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:15.999609 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1101/2114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:15 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1646 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:16.001083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.001602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.005767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.007268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.014729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.015206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.017908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aae03b0e-940f-45ac-b0ba-2cac81d5327d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc451f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:16.086120 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aae03b0e-940f-45ac-b0ba-2cac81d5327d tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1453 microversion: 2.1 time: 0.085293 Aug 30 17:34:16.087060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1102/2115] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:15 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:16.119499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:16.120707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:16.122726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:16.134291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.135046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.135814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.136920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.138355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.138800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.263175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:16.290244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbc0e972-c250-4385-8c35-3d17f77fe058 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1282 microversion: 2.1 time: 0.310161 Aug 30 17:34:16.307668 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1014/2116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:15 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:16.653321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:16.691598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-327bb0e6-e704-4fc2-8470-3fbbbdeeeff2 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 2346 microversion: 2.25 time: 0.575917 Aug 30 17:34:16.704634 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1103/2117] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:16 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 2346 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:34:16.721282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:16.721895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:16.725495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:16.732681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.737282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.738693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.742833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.744897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.745827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.750518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.755857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.757546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.758860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.764712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.766004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.836586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a327858-8b40-43de-a93a-71b5c246947b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.124340 Aug 30 17:34:16.839447 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1015/2118] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 30 17:34:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:34:16.903817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce90eb33-cc82-4e0c-97e1-043cf62c91c6", "name": "network-vif-deleted", "tag": "c67221fe-3edb-4e3e-866e-42bdd86b3965"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:16.917925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:16.918772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:16.919403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:16.939987 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] Creating event network-vif-deleted:c67221fe-3edb-4e3e-866e-42bdd86b3965 for instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 on n-h1-852771-11 Aug 30 17:34:16.954024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b96239dd-36fa-46d2-8088-8659937bb704 req-48032694-44d8-4a37-a5ce-4e7003e3a626 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056510 Aug 30 17:34:16.958014 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1016/2119] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:17.002214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.005288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:17.024194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.025134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.026573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.030021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.031979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.033658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.095147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:17.098723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c06216a7-a723-4078-8386-3381c7eeb590 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1615 microversion: 2.1 time: 0.381224 Aug 30 17:34:17.113753 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1104/2120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:16 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1615 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:17.128036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.128991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:17.138591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.139678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.140292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.141528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.142350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.143341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.187787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.188545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.189196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.189871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lazy-loading 'fault' on Instance uuid ce90eb33-cc82-4e0c-97e1-043cf62c91c6 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:17.291378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:17.309045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7d486bf-369b-43f0-979a-bf452b00c5b3 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 200 len: 1305 microversion: 2.1 time: 0.193875 Aug 30 17:34:17.312928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1105/2121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:17 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:17.322298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.323155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:17.361646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.362492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.363235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.365755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.369265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.370115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.388965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:17.403398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b710be0-4f40-49e9-9b7c-e583ecf8e2ee tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.409803 Aug 30 17:34:17.408909 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1017/2122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:16 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:17.419792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e10bd1c3-ed4d-4111-8b55-592ab7f10bd9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9876f160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.451864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:17.599196 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e10bd1c3-ed4d-4111-8b55-592ab7f10bd9 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1462 microversion: 2.1 time: 0.187893 Aug 30 17:34:17.609472 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1018/2123] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:17 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1462 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:17.616587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:17.617696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:17.635838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.637457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.639067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.641645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.643934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.644877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.751960 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] HTTP exception thrown: Cannot 'migrate' instance bc9347dc-da13-443a-b470-7f0d1edd5a87 while it is in vm_state suspended Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Request method failure captured: Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87/action HTTP/1.1 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknqbhLnGsoLHwYPxaZUVU17zQzWTEGHBfiNlwH0n90V9xXIoPTMTBUZ4dkhCKuSfBpTdJUUEWcmU-Qk9n82EjVQGNVNjAbpw7jD0WKUYpHomGtQygamgpSTlVMR-VkvDKNUgd1B-WbYnrAgAalAbGW-Ouj-2GPcCqxxDmvarDvrEVg Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:34:17.758533 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_899317ffd40c4754b17e1b824de22fb8"}]}] Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b906a1f35e8a4b5f8d509c79670ca5e2 Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: {"migrate": {}} Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:17.760498 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'migrate' instance bc9347dc-da13-443a-b470-7f0d1edd5a87 while it is in vm_state suspended Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bc9347dc-da13-443a-b470-7f0d1edd5a87', 'body': {'migrate': {}}} Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 in vm_state suspended. Cannot resize while the instance is in this state. Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.761675 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance bc9347dc-da13-443a-b470-7f0d1edd5a87 while it is in vm_state suspended Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:17.763360 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:17.764975 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:17.764975 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:17.764975 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance bc9347dc-da13-443a-b470-7f0d1edd5a87 while it is in vm_state suspended Aug 30 17:34:17.764975 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.769940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Returning 409 to user: Cannot 'migrate' instance bc9347dc-da13-443a-b470-7f0d1edd5a87 while it is in vm_state suspended {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:17.773475 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-52ecf261-84a3-4ab2-941e-db48088e9848 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87/action" status: 409 len: 148 microversion: 2.1 time: 0.162608 Aug 30 17:34:17.776846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1019/2124] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:17 2022] POST /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87/action => generated 148 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:17.800158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.804823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:17.808386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4113b95a-d55b-45ef-bec6-7ab02b4a1aad tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 204 len: 0 microversion: 2.1 time: 0.489612 Aug 30 17:34:17.812277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1106/2125] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:17 2022] DELETE /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:17.829544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e0ff66f-3049-4f30-b329-28d01389b09b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cde2160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:17.835223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.836689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.837373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.852951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:17.853432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:17.853868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:17.955432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e0ff66f-3049-4f30-b329-28d01389b09b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 200 len: 1462 microversion: 2.1 time: 0.140949 Aug 30 17:34:17.964882 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1107/2126] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:17 2022] GET /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 1462 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:17.977662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6707e95-da66-4ac7-b8b8-856d8db888a8 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6707e95-da66-4ac7-b8b8-856d8db888a8 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Request method failure captured: Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action HTTP/1.1 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 39 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknqbhLnGsoLHwYPxaZUVU17zQzWTEGHBfiNlwH0n90V9xXIoPTMTBUZ4dkhCKuSfBpTdJUUEWcmU-Qk9n82EjVQGNVNjAbpw7jD0WKUYpHomGtQygamgpSTlVMR-VkvDKNUgd1B-WbYnrAgAalAbGW-Ouj-2GPcCqxxDmvarDvrEVg Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:34:17.989866 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_899317ffd40c4754b17e1b824de22fb8"}]}] Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b906a1f35e8a4b5f8d509c79670ca5e2 Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: {"os-resetState": {"state": "invalid"}} Aug 30 17:34:17.992316 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a0d30c0d-758e-4d3f-b971-1eac3702fb40', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:17.993465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:34:17.996389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 17:34:17.999636 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.004590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6707e95-da66-4ac7-b8b8-856d8db888a8 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:18.005684 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6707e95-da66-4ac7-b8b8-856d8db888a8 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action" status: 400 len: 144 microversion: 2.1 time: 0.048594 Aug 30 17:34:18.006939 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1108/2127] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:17 2022] POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action => generated 144 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:18.020249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:18.021595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:18.041055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.041896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.042779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.043825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.044720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.045385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.345906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:18.355436 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb401fd1-b51b-4eee-9abd-246fea93fd5b tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1484 microversion: 2.1 time: 0.346995 Aug 30 17:34:18.359404 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1109/2128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:18 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1484 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:18.364161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:18.364770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:18.385861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.386476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.386915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.387953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.388408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.388831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.472196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:18.485357 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e10bef37-ad8b-497e-920c-5fd346796c75 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.704581 Aug 30 17:34:18.486300 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1020/2129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:17 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:18.503507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a38672a-dbe3-4f8f-a10a-fe6f7ea30457 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a38672a-dbe3-4f8f-a10a-fe6f7ea30457 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Request method failure captured: Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action HTTP/1.1 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 31 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknqbhLnGsoLHwYPxaZUVU17zQzWTEGHBfiNlwH0n90V9xXIoPTMTBUZ4dkhCKuSfBpTdJUUEWcmU-Qk9n82EjVQGNVNjAbpw7jD0WKUYpHomGtQygamgpSTlVMR-VkvDKNUgd1B-WbYnrAgAalAbGW-Ouj-2GPcCqxxDmvarDvrEVg Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 17:34:18.508546 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_899317ffd40c4754b17e1b824de22fb8"}]}] Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b906a1f35e8a4b5f8d509c79670ca5e2 Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: {"os-resetState": {"state": 1}} Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:18.510167 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a0d30c0d-758e-4d3f-b971-1eac3702fb40', 'body': {'os-resetState': {'state': 1}}} Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 1 Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:18.511108 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 17:34:18.512729 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.516717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a38672a-dbe3-4f8f-a10a-fe6f7ea30457 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:18.516717 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a38672a-dbe3-4f8f-a10a-fe6f7ea30457 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action" status: 400 len: 120 microversion: 2.1 time: 0.022563 Aug 30 17:34:18.516717 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1021/2130] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:18 2022] POST /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40/action => generated 120 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:18.521197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:18.521838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:18.539814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.540297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.540730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.541426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.542135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.542777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.559913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 HTTP/1.1 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:18.561860 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:18.563372 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ce90eb33-cc82-4e0c-97e1-043cf62c91c6'} Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:18.564271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:18.565685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.569301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:18.570650 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-480d9077-605b-40b9-b931-e631c1c6fbad tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 404 len: 111 microversion: 2.1 time: 0.055439 Aug 30 17:34:18.574782 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1022/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:18 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:18.584474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:18.586067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:18.610239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.611255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.611966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.612921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:18.613747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:18.614265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:18.901711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:18.910556 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12988ed0-18db-4c1b-b4c6-4c49fa200de7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1468 microversion: 2.1 time: 0.550003 Aug 30 17:34:18.911850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1110/2132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:18 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:18.917503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:18.920134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Failed to fetch instance by id 999 {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:34:18.920878 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Request method failure captured: Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 37 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknqbhLnGsoLHwYPxaZUVU17zQzWTEGHBfiNlwH0n90V9xXIoPTMTBUZ4dkhCKuSfBpTdJUUEWcmU-Qk9n82EjVQGNVNjAbpw7jD0WKUYpHomGtQygamgpSTlVMR-VkvDKNUgd1B-WbYnrAgAalAbGW-Ouj-2GPcCqxxDmvarDvrEVg Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:34:18.929538 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/899317ffd40c4754b17e1b824de22fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_899317ffd40c4754b17e1b824de22fb8"}]}] Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 899317ffd40c4754b17e1b824de22fb8 Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1570724617 Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: b906a1f35e8a4b5f8d509c79670ca5e2 Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1570724617-project-admin Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: {"os-resetState": {"state": "error"}} Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:18.931124 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 999 could not be found. Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:18.932237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 17:34:18.933727 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:18.936674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:18.937780 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c8dafb3-7b36-44b5-af12-5c4a6b5af831 tempest-ServersAdminNegativeTestJSON-1570724617 tempest-ServersAdminNegativeTestJSON-1570724617-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.024009 Aug 30 17:34:18.938888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1111/2133] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Aug 30 17:34:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:18.947793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87f85aff-00c1-40a6-9925-d5e395a7003a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cd33040>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:19.430066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87f85aff-00c1-40a6-9925-d5e395a7003a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7" status: 202 len: 0 microversion: 2.1 time: 0.489541 Aug 30 17:34:19.431794 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1112/2134] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:18 2022] DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:19.437717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-19cd7bf9-b322-43e4-914d-2bafa7b7cff5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd33f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:19.577170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:19.596404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe9e7ef3-0983-41ff-a7c8-96183ee15f3c tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 1.020374 Aug 30 17:34:19.598367 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1023/2135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:18 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:19.626041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:19.627198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:19.635440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-19cd7bf9-b322-43e4-914d-2bafa7b7cff5 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?changes-since=2022-08-30T17%3A32%3A04Z" status: 200 len: 2375 microversion: 2.1 time: 0.201568 Aug 30 17:34:19.636377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1113/2136] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Aug 30 17:34:19 2022] GET /compute/v2.1/images?changes-since=2022-08-30T17%3A32%3A04Z => generated 2375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:19.638884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:19.641405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:19.642406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:19.642567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:19.645342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:19.648754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:19.651456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:19.652190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:19.655824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:19.656518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:19.657119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:19.658201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:19.658837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:19.659427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:19.725347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:19.883556 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6da0661c-bb8a-4abc-9fd1-7560f4423c37 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 204 len: 0 microversion: 2.1 time: 0.279074 Aug 30 17:34:19.884574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1024/2137] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:19 2022] DELETE /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:19.896514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de13511f-ce0e-48cb-b829-843b77923b5e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d986dcca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:20.025954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:20.041010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-28a4eca3-f423-43f7-979b-1774d1981668 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1484 microversion: 2.1 time: 0.403322 Aug 30 17:34:20.041600 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1114/2138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:19 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1484 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:20.049384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:20.050996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:20.066079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.066497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.067117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.068073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.068772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.069206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.351242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:20.363103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1782c3c1-f0c0-4398-9f03-311a4d3d2197 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.317227 Aug 30 17:34:20.364953 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de13511f-ce0e-48cb-b829-843b77923b5e tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa" status: 202 len: 0 microversion: 2.1 time: 0.474627 Aug 30 17:34:20.365378 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1115/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:20 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:20.370008 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1025/2140] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:19 2022] DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:20.382591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9a1d0b2-329b-4728-aab8-0a4bed4b65d7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dcd430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:20.382870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c98b7e4c-ae79-4cb5-a22d-c0408ed79120", "device": "/dev/xvdb"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:20.392333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:20.407889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.409790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.410408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.411361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.428357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.431161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.487554 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9a1d0b2-329b-4728-aab8-0a4bed4b65d7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-979405678" status: 200 len: 484 microversion: 2.1 time: 0.120648 Aug 30 17:34:20.488128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1116/2141] 10.222.0.50 () {58 vars in 1229 bytes} [Tue Aug 30 17:34:20 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-979405678 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:20.493051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:20.493854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:20.500814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.501304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.501743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.502593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.502885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.503309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.720222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:20.733116 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad566389-1a2e-4be6-91c4-8fe799579a38 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1468 microversion: 2.1 time: 0.243065 Aug 30 17:34:20.734111 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1117/2142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:20 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:20.741201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cb6f81-b378-40c3-be46-471c3ae34d18", "tag": "de04bc09-cb50-4af3-b8fe-65b06cc70040"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:20.759583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:20.760110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:20.760594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:20.771942 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] Creating event network-changed:de04bc09-cb50-4af3-b8fe-65b06cc70040 for instance d7cb6f81-b378-40c3-be46-471c3ae34d18 on n-h1-852771-11 Aug 30 17:34:20.776704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6d5b84f3-457f-404e-acb8-d1b84556061b req-ceee5a0f-4ac4-4b29-b59e-4d44c861cef2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041017 Aug 30 17:34:20.777626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1118/2143] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:20.782707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2677127-ffed-4d29-a9b0-5179e2954e33 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'create', calling method: .version_select at 0x7f2d9cd9baf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-165962377", "description": "tempest-description-1933646820"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:20.945059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2677127-ffed-4d29-a9b0-5179e2954e33 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.166111 Aug 30 17:34:20.945667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1119/2144] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:34:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:20.950455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9107e343-babe-4cde-a96c-3d4ca0269167 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cc45820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.083686 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9107e343-babe-4cde-a96c-3d4ca0269167 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?server=1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 957 microversion: 2.1 time: 0.131992 Aug 30 17:34:21.084387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1120/2145] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 30 17:34:20 2022] GET /compute/v2.1/images?server=1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 957 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:21.098567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.101484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:21.120332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.122358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.123088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.124664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.125231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.126331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.342770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:21.353935 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0f4f5ccf-7e4e-474b-a53e-7dcb44456c49 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.268160 Aug 30 17:34:21.356085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1121/2146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:21.362725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-14a38130-606f-4e79-8a05-68fb2a551864 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Action: 'update', calling method: .version_select at 0x7f2d98dcd280>, body: {"security_group": {"name": "tempest-sg-hth-642930821", "description": "tempest-description-hth-844693216"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:21.415907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c0645be-acc2-45c5-911e-a219d1b2e216 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.045873 Aug 30 17:34:21.424384 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1026/2147] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 30 17:34:20 2022] POST /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:34:21.433790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.435420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:21.447373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.448706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.450568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.451578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.452411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.453381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.508827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.509390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.525658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.526186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lazy-loading 'fault' on Instance uuid bbf96994-a6ac-4549-8ba3-d002fd4b1110 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:21.593635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:21.605534 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0681f370-d60c-4696-a857-3cb5815a6c15 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 200 len: 1300 microversion: 2.1 time: 0.178400 Aug 30 17:34:21.606832 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1027/2148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:21.614389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2445f6a-4fe1-4d8a-afc9-1c2f082362b4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d985333a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.667355 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-14a38130-606f-4e79-8a05-68fb2a551864 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363" status: 200 len: 216 microversion: 2.1 time: 0.309936 Aug 30 17:34:21.668590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1122/2149] 10.222.0.50 () {60 vars in 1290 bytes} [Tue Aug 30 17:34:21 2022] PUT /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363 => generated 216 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:21.673617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.674608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:21.690191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.690679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.691131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.692360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.692360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.695296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.748388 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2445f6a-4fe1-4d8a-afc9-1c2f082362b4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 484 microversion: 2.1 time: 0.138083 Aug 30 17:34:21.749061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1028/2150] 10.222.0.50 () {58 vars in 1317 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 484 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:21.768550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b95f06e6-8504-40ae-8d3a-f7723c2bdba9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98533d30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.886395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:21.898241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03733ee4-0b63-4d01-9fdf-d9fa3febdd20 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.228290 Aug 30 17:34:21.898837 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1123/2151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:21.916974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.917996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:21.931877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.932554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.933220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.933934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:21.934387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:21.935404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:21.969655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:21.981943 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b95f06e6-8504-40ae-8d3a-f7723c2bdba9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363" status: 200 len: 216 microversion: 2.1 time: 0.231792 Aug 30 17:34:21.983379 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1029/2152] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363 => generated 216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:21.995354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a41faf3-389d-4faf-8ddb-31b46429812e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d984d1550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:21.996949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:22.062355 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a41faf3-389d-4faf-8ddb-31b46429812e tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 484 microversion: 2.1 time: 0.077754 Aug 30 17:34:22.063788 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1030/2153] 10.222.0.50 () {58 vars in 1303 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 484 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:22.082373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3265b47a-30ef-4845-be89-9d60c9e5550a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98533b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.226583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:22.238659 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cfac8ef-a305-400a-a0fe-c9fcca13886c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1468 microversion: 2.1 time: 0.325466 Aug 30 17:34:22.239738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1124/2154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:21 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:22.256022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82578e9a-0581-4916-96c5-ddbb45e67a49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cca9af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.405318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82578e9a-0581-4916-96c5-ddbb45e67a49 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.163849 Aug 30 17:34:22.420010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1125/2155] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:34:22 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:22.425404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.426020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:22.435699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.436682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.437408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.439682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.440322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.440919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.631925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:22.650447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac2863a3-00db-4bc4-bd10-e07cd3162919 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.229648 Aug 30 17:34:22.663984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1126/2156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:22 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:22.663984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d767b9d3-aee9-4a82-b9fe-aa9f319ce46a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cda1ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.796832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:22.812244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3265b47a-30ef-4845-be89-9d60c9e5550a tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363" status: 202 len: 0 microversion: 2.1 time: 0.747317 Aug 30 17:34:22.813140 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1031/2157] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:22 2022] DELETE /compute/v2.1/os-security-groups/2797b219-3a5d-4a7a-85a8-1ba81700b363 => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:22.820918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.821436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: bbf96994-a6ac-4549-8ba3-d002fd4b1110] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:22.826670 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d767b9d3-aee9-4a82-b9fe-aa9f319ce46a tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.174041 Aug 30 17:34:22.830429 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1127/2158] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:34:22 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:22.830864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.831351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.831826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.832526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.832976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.833401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.848273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf96994-a6ac-4549-8ba3-d002fd4b1110", "name": "network-vif-deleted", "tag": "1bb6904e-a9ec-49c6-b728-e8ee4971db77"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:22.875756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:22.876962 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] HTTP exception thrown: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. Aug 30 17:34:22.882442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.882944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.883391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Request method failure captured: Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 HTTP/1.1 Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhL1JpVwAhjhV5MAc93jYFQcKTZLqofY0NPgkvt5YXQ4c40bjTNzY7q8ohqaLeQWt5ADNj-xWIPjWr991vmJdR_P12PEfCBol_DOgy0R-73xkq_GXyhNdNqiKw_DXx9nVcFmhvRlQrzB5OUX35rChqFV9CvFkYBtpegqny5oQf-OcY Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:22.887331 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75c6078a31ba4cafb47564e45e877c1f"}]}] Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 5fa0c244b665489ab32553dd33c47518 Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. Aug 30 17:34:22.888974 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bbf96994-a6ac-4549-8ba3-d002fd4b1110'} Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:22.889838 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. Aug 30 17:34:22.891212 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.892555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Returning 404 to user: Instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:22.892555 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14576713-4564-4570-a2c5-a7577310cfaf tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110" status: 404 len: 111 microversion: 2.1 time: 0.074839 Aug 30 17:34:22.892555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1032/2159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:22 2022] GET /compute/v2.1/servers/bbf96994-a6ac-4549-8ba3-d002fd4b1110 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:22.904623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.905131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:22.919368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] Creating event network-vif-deleted:1bb6904e-a9ec-49c6-b728-e8ee4971db77 for instance bbf96994-a6ac-4549-8ba3-d002fd4b1110 on n-h1-852771-11 Aug 30 17:34:22.920388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.920878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.921307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.922011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.922454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.922874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.938744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-12dd4083-7879-476b-a98a-d2458d3dcdb5 req-07ce357d-15fb-4f59-85d9-5ad26d346d08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096640 Aug 30 17:34:22.944930 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1128/2160] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:22.956773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-55c25408-bc0d-49f2-86e9-75ae57e49cbd tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cd93e50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.959191 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 HTTP/1.1 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:22.964075 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:22.965660 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ce90eb33-cc82-4e0c-97e1-043cf62c91c6'} Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:22.966527 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:22.967966 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:22.969418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:22.969418 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5e71e8a-df48-4ddd-9d9a-a6c03d45dd2c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 404 len: 111 microversion: 2.1 time: 0.072050 Aug 30 17:34:22.973808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1033/2161] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:22 2022] DELETE /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:22.980034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:22.980535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:22.996181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.996673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.997108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:22.997821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:22.998273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:22.998696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.064860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:23.120271 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-55c25408-bc0d-49f2-86e9-75ae57e49cbd tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.173825 Aug 30 17:34:23.126422 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1129/2162] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:34:22 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:23.154150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.155362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:23.196819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.199002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.202429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.204464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.206062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.209242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.303212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6519db2b-4747-41e8-85cd-08029daf8e2c tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 204 len: 0 microversion: 2.1 time: 0.327639 Aug 30 17:34:23.303857 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1034/2163] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:22 2022] DELETE /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:23.324780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.325673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: ce90eb33-cc82-4e0c-97e1-043cf62c91c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:23.335034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.335543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.337017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.339077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.340177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.340619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.368748 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 HTTP/1.1 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:23.370454 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:23.372341 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ce90eb33-cc82-4e0c-97e1-043cf62c91c6'} Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:23.373401 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. Aug 30 17:34:23.375311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.377913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Instance ce90eb33-cc82-4e0c-97e1-043cf62c91c6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:23.377913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e723e0ea-e50a-4e79-b67c-7957aaa9f0d2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6" status: 404 len: 111 microversion: 2.1 time: 0.051852 Aug 30 17:34:23.377913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1035/2164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/servers/ce90eb33-cc82-4e0c-97e1-043cf62c91c6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:23.382347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac64677c-a6d2-485b-802f-23c81b0d0468 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d984d15e0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.527245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac64677c-a6d2-485b-802f-23c81b0d0468 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?changes-since=2022-08-30T17%3A31%3A59Z" status: 200 len: 6327 microversion: 2.1 time: 0.149764 Aug 30 17:34:23.529153 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1036/2165] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-30T17%3A31%3A59Z => generated 6327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:23.545108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.546418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:23.557419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.558389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.559340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.561529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.562643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.563355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.606808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.607914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.608414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.608924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lazy-loading 'fault' on Instance uuid bc9347dc-da13-443a-b470-7f0d1edd5a87 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:23.660269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:23.671790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14544ab2-f63e-42e4-a118-153e6b9a06e4 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1312 microversion: 2.1 time: 0.140972 Aug 30 17:34:23.672573 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1037/2166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:23.676978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.678113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:23.682458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:23.708050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.708539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.709278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.709992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.710474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.710850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.716192 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c30c83c-f3de-443f-ab68-da9754541e1d tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.568816 Aug 30 17:34:23.716848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1130/2167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:23.728206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9cd93280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.759248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:23.760508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 3df7c835-d71f-4082-a871-1c34cc809baa not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:23.761310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.761310 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa HTTP/1.1 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:23.764319 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.765885 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3df7c835-d71f-4082-a871-1c34cc809baa'} Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:23.766954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:23.768919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.772658 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] Aug 30 17:34:23.776485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:23.779995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 3df7c835-d71f-4082-a871-1c34cc809baa does not exist Aug 30 17:34:23.779995 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-9ef03d55-f4aa-4d8c-b6cb-9a4fe1e04dad'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:23.781041 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bfb30f3a-5b92-42e0-892f-05b1125187dc tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa" status: 404 len: 194 microversion: 2.1 time: 0.058971 Aug 30 17:34:23.782621 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1131/2168] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:23 2022] DELETE /compute/v2.1/os-security-groups/3df7c835-d71f-4082-a871-1c34cc809baa => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:23.790700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bfd72d-e206-4e8f-983b-5a0737a855ed", "name": "network-vif-plugged", "status": "completed", "tag": "7bd88ef8-b053-45dc-9fed-606b6a70b0f0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:23.802231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.803843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.804506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.829277 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] Creating event network-vif-plugged:7bd88ef8-b053-45dc-9fed-606b6a70b0f0 for instance f9bfd72d-e206-4e8f-983b-5a0737a855ed on n-h2-852771-11 Aug 30 17:34:23.834846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-29ac5567-e7ff-49be-b15b-efbe12ff9069 req-23d215dd-38f1-4c76-8585-7e9b965b1aeb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048982 Aug 30 17:34:23.835934 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1132/2169] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:23.841750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-043ec4cc-9968-4846-adac-a6339bbad2eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cda11f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.947247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-043ec4cc-9968-4846-adac-a6339bbad2eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-979405678" status: 200 len: 664 microversion: 2.1 time: 0.109956 Aug 30 17:34:23.948016 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1133/2170] 10.222.0.50 () {58 vars in 1250 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-979405678 => generated 664 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:23.952859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:23.953909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:23.963436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.964200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.964551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:23.965526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:23.966429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:23.967077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.049118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:24.060406 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08857832-ae89-4b8e-8d09-1e0b17019eb5 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1500 microversion: 2.1 time: 0.386567 Aug 30 17:34:24.075726 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1038/2171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1500 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.081077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98ef8550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.125607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:24.136263 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7e79d25-eb1a-4589-a6da-8dbf3be84bac tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.186789 Aug 30 17:34:24.137296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:24.138115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:24.138301 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1134/2172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:23 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.138827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.138827 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7 HTTP/1.1 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:24.141644 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.143225 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '03b7c02c-74cf-4ff8-8270-8c2fa37440a7'} Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.144209 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:24.145577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.146909 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] Aug 30 17:34:24.149371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.152279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 03b7c02c-74cf-4ff8-8270-8c2fa37440a7 does not exist Aug 30 17:34:24.152279 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-8c253d6f-e7a8-4239-8e6b-1ada04ac7a33'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:24.152623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5d40328-cb8b-4833-a28b-bcf9d9d6e926 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dcd160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.153826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b689bd95-f2fd-43bd-ad62-798e46916e2d tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7" status: 404 len: 194 microversion: 2.1 time: 0.076743 Aug 30 17:34:24.154909 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1039/2173] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/os-security-groups/03b7c02c-74cf-4ff8-8270-8c2fa37440a7 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:24.165646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98533af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.200386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:24.204157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:24.204762 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.204762 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a HTTP/1.1 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:24.208884 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.210722 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '938260aa-08ce-4ed2-8180-f3ff1c433e0a'} Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.211797 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:24.213339 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.214978 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 938260aa-08ce-4ed2-8180-f3ff1c433e0a does not exist Aug 30 17:34:24.216957 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-06ae7ce8-9462-47e7-ae3f-ad0fd376dedf'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:24.217780 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bfcabbe0-6b7c-4659-8f82-07a6c3abee43 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a" status: 404 len: 194 microversion: 2.1 time: 0.057167 Aug 30 17:34:24.221946 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1040/2174] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/os-security-groups/938260aa-08ce-4ed2-8180-f3ff1c433e0a => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:34:24.223327 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5d40328-cb8b-4833-a28b-bcf9d9d6e926 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1464 microversion: 2.1 time: 0.082876 Aug 30 17:34:24.225003 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1135/2175] 10.222.0.50 () {58 vars in 1338 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1464 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.237759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d99002700>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.239199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-805843b4-d270-4374-b8da-0d9c91b4922b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cde2ee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.287715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:24.294417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:24.295029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.295029 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936 HTTP/1.1 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:24.296927 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.298437 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5839fe1a-2222-4589-8c2b-95c5dc3cb936'} Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.299376 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:24.301615 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.305438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 5839fe1a-2222-4589-8c2b-95c5dc3cb936 does not exist Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-7813c71b-c6b6-4e75-8ab1-cce6281b4c94'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8948e082-a79f-43b8-b46a-6f9ba2fe1fe5 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936" status: 404 len: 194 microversion: 2.1 time: 0.076125 Aug 30 17:34:24.311259 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1041/2176] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/os-security-groups/5839fe1a-2222-4589-8c2b-95c5dc3cb936 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:24.312979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-805843b4-d270-4374-b8da-0d9c91b4922b tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1464 microversion: 2.1 time: 0.072304 Aug 30 17:34:24.312979 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1136/2177] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1464 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.314692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d985330d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.325004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f16a907-c22b-4523-ad43-64e2e880b52f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d989e1a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.353015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:24.353859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group a1c890fb-c684-4a2c-9021-465f66f7aab0 not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:24.354547 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.354547 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0 HTTP/1.1 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:24.356748 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.358839 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a1c890fb-c684-4a2c-9021-465f66f7aab0'} Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.360005 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:24.362485 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.368887 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group a1c890fb-c684-4a2c-9021-465f66f7aab0 does not exist Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-ba510397-c83c-45c6-a225-627fc908da10'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5df02d97-feaf-4ce4-a3e5-9714748658ff tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0" status: 404 len: 194 microversion: 2.1 time: 0.056308 Aug 30 17:34:24.376799 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1042/2178] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/os-security-groups/a1c890fb-c684-4a2c-9021-465f66f7aab0 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:24.378743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98533280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.436047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:34:24.436746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Neutron security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:34:24.437369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.437369 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd HTTP/1.1 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:24.439385 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.441312 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '49b0f9f9-7104-4ab5-84f2-5cca3718a5cd'} Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.445898 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:34:24.448064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.449608 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Security group 49b0f9f9-7104-4ab5-84f2-5cca3718a5cd does not exist Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-4efa97d7-4939-4454-a2c4-ee4f0fd7d464'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b07205c3-668a-48b1-98f9-c99ecf785e5f tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd" status: 404 len: 194 microversion: 2.1 time: 0.072832 Aug 30 17:34:24.451291 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1043/2179] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/os-security-groups/49b0f9f9-7104-4ab5-84f2-5cca3718a5cd => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:34:24.453906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.460000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:24.474911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.475753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.479517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.480516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.481282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.481894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.492896 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f16a907-c22b-4523-ad43-64e2e880b52f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.167142 Aug 30 17:34:24.493548 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1137/2180] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.514440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a2ff5c27-2365-4e06-a30a-844b633419d7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dcdd30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.538928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:24.642757 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a2ff5c27-2365-4e06-a30a-844b633419d7 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.132469 Aug 30 17:34:24.649568 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1138/2181] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.661120 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e29a680-227c-4f9d-90b3-380b5f183cc8 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 204 len: 0 microversion: 2.1 time: 0.214596 Aug 30 17:34:24.663566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1044/2182] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:24 2022] DELETE /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:34:24.667307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cdec7a0-fb9d-4794-93b9-17628a8378cf tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cde2f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.672858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.673556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:24.680937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.681825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.682433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.683312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.683780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.684418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.733556 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cdec7a0-fb9d-4794-93b9-17628a8378cf tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515" status: 200 len: 784 microversion: 2.1 time: 0.070720 Aug 30 17:34:24.734297 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1139/2183] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515 => generated 784 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:34:24.749441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.750319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:24.763434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.764304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.766089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.770181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.770946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.771872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.799625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:24.847295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:24.848265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:24.848953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:24.850378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lazy-loading 'fault' on Instance uuid bc9347dc-da13-443a-b470-7f0d1edd5a87 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:24.950092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:24.964957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ddf9cbd-5563-4ea8-9009-1250890ba92b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 200 len: 1312 microversion: 2.1 time: 0.227682 Aug 30 17:34:24.966519 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1140/2184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:24.994509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:24.995128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:25.012779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.013272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.013980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.014950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.015661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.016337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.336359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:25.349165 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfe2a9c9-7490-48ac-b5ed-810c21badf35 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.361799 Aug 30 17:34:25.349777 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1141/2185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:25.358091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd330be2-7e36-4bca-b523-b651836d1437 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cda11f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:25.451399 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd330be2-7e36-4bca-b523-b651836d1437 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.100418 Aug 30 17:34:25.452322 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1142/2186] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:34:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:25.465689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:25.466550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:25.475675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.483076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.483813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.484738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.485377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.487917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.527130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:25.539937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14f5a68d-b262-4a75-a913-c3397b5fe328 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1647 microversion: 2.1 time: 0.868163 Aug 30 17:34:25.540578 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1045/2187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:24 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1647 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:25.563701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:25.565159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:25.577222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.579875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.580495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.581365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.582070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.586955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.647974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa0c244b665489ab32553dd33c47518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c6078a31ba4cafb47564e45e877c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:25.672891 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3b60453-4052-436d-a5c3-1becfc2dcc17 tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 200 len: 1458 microversion: 2.1 time: 0.219175 Aug 30 17:34:25.674139 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1143/2188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:25 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:25.690170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9347dc-da13-443a-b470-7f0d1edd5a87", "name": "network-vif-deleted", "tag": "b2c65f7c-6630-48da-954c-a4acfc9ce341"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:25.715400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.718447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.719163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.746113 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] Creating event network-vif-deleted:b2c65f7c-6630-48da-954c-a4acfc9ce341 for instance bc9347dc-da13-443a-b470-7f0d1edd5a87 on n-h1-852771-11 Aug 30 17:34:25.765606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-778e7a0d-a023-44a3-bbbc-6f2733ac7938 req-c7e89185-733c-4984-842a-52ed9081d93c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089869 Aug 30 17:34:25.769900 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1144/2189] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:25.780405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb9b3477-9a50-47dc-8ed8-22b64b4fece8 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d9cde2820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:25.845896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:25.880183 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de821460-c07a-4c27-9071-56d142fee0d9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1317 microversion: 2.1 time: 0.333049 Aug 30 17:34:25.883703 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1046/2190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:25 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:25.899800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-unplugged", "status": "completed", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:25.913990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:25.916182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:25.918980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:25.939624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] Creating event network-vif-unplugged:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:34:25.946691 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2431dfc4-4a4d-476d-8656-61e41edf34af req-3f1a9ca9-a48a-4cbc-b36e-8b8782a53717 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060864 Aug 30 17:34:25.954281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1047/2191] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:26.000177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.000868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: bc9347dc-da13-443a-b470-7f0d1edd5a87] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.013436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.015223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.016152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.017180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.017961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.018696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.066008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] HTTP exception thrown: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Request method failure captured: Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 HTTP/1.1 Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknpEHpQtcmDotrExESM1SWTBhk02OcM9Gw8inbwf2Wo7GNxcnixF6TDJgfjg3z8M1tVOeKk3o_y8F5Guu1lK4ZXA_H4h_rcpqArSVkeXfnSiIb9AfmM0QFcAbirz53R0k_D0f24D4_it41fp5l5Ncqr-hwdwe61D76VZGm3fbKpXJg Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c2fccaba9aa34bbc98b69e09baca041e Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:26.067740 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c2fccaba9aa34bbc98b69e09baca041e"}]}] Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c2fccaba9aa34bbc98b69e09baca041e Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-2082318857-project Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4ff2753ae0d547589265d28f0a3bd2a6 Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2082318857-project Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. Aug 30 17:34:26.070660 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bc9347dc-da13-443a-b470-7f0d1edd5a87'} Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:26.072224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. Aug 30 17:34:26.075578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:26.078647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Returning 404 to user: Instance bc9347dc-da13-443a-b470-7f0d1edd5a87 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:26.078647 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94341ad9-9aa1-4335-8317-bcd153b0febf tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87" status: 404 len: 111 microversion: 2.1 time: 0.081340 Aug 30 17:34:26.078647 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1048/2192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:25 2022] GET /compute/v2.1/servers/bc9347dc-da13-443a-b470-7f0d1edd5a87 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:26.083956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.084559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.100431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.100927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.101575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.102751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.103564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.104013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.166033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:26.385967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b27888ac-e903-45b9-b40c-9a5b32d8a273 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 204 len: 0 microversion: 2.1 time: 0.310725 Aug 30 17:34:26.386540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1049/2193] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:26 2022] DELETE /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:26.408117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.408838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.430932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.431453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.431942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.432787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.433618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.433618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.687579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:26.697439 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ccfa6dcc-b07a-4d8b-8199-3556f4f9471e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.309535 Aug 30 17:34:26.698280 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1050/2194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:26 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:26.703279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.704454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.711293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.712050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.712696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.713620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.714423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.715175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.773743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:26.916010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb9b3477-9a50-47dc-8ed8-22b64b4fece8 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645" status: 204 len: 0 microversion: 2.1 time: 1.144634 Aug 30 17:34:26.916853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1145/2195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:25 2022] DELETE /compute/v2.1/images/d5eee6a6-1e29-499e-97c6-86b468fca645 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:26.921560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.922300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.937509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.939204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.940042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.941337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:26.941666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.942491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.943886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.951642 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71f63124-54b4-4e44-a40b-1d3c1bb3498c tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1477 microversion: 2.1 time: 0.251979 Aug 30 17:34:26.952549 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1051/2196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:26 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:26.968462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:26.969083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] [instance: 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:26.975513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.976246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.976852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.977757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:26.978429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:26.979022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:26.997918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] HTTP exception thrown: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Request method failure captured: Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 HTTP/1.1 Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkhL1JpVwAhjhV5MAc93jYFQcKTZLqofY0NPgkvt5YXQ4c40bjTNzY7q8ohqaLeQWt5ADNj-xWIPjWr991vmJdR_P12PEfCBol_DOgy0R-73xkq_GXyhNdNqiKw_DXx9nVcFmhvRlQrzB5OUX35rChqFV9CvFkYBtpegqny5oQf-OcY Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:27.000049 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75c6078a31ba4cafb47564e45e877c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75c6078a31ba4cafb47564e45e877c1f"}]}] Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 75c6078a31ba4cafb47564e45e877c1f Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveMigrationTest-1450711586 Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 5fa0c244b665489ab32553dd33c47518 Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveMigrationTest-1450711586-project Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. Aug 30 17:34:27.001839 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0'} Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:27.002856 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. Aug 30 17:34:27.004649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:27.009677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] Returning 404 to user: Instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:27.010819 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31432f81-f74b-42f7-ba8e-6b5a8393dfec tempest-LiveMigrationTest-1450711586 tempest-LiveMigrationTest-1450711586-project] 10.222.0.50 "GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0" status: 404 len: 111 microversion: 2.1 time: 0.056959 Aug 30 17:34:27.011637 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1052/2197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:26 2022] GET /compute/v2.1/servers/2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:27.026216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:27.026897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:27.037808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:27.038886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:27.039588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:27.040683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:27.041615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:27.042266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:27.098232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:27.524740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:27.535273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e7bbc04-774d-4e5a-b20d-a83078a2f985 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1507 microversion: 2.1 time: 0.522542 Aug 30 17:34:27.537152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1053/2198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:27 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1507 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:27.554008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92e443f4-dff6-4ede-a98c-26a9693abce6 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98532d30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:27.771341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:27.787937 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6044e3d1-1e9d-490d-a2ae-9ae65b2a66c6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1647 microversion: 2.1 time: 0.869950 Aug 30 17:34:27.788529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1146/2199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:26 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1647 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:27.797771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:27.798392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:27.823742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:27.824243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:27.824680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:27.825548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:27.826008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:27.826432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.355369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92e443f4-dff6-4ede-a98c-26a9693abce6 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9" status: 204 len: 0 microversion: 2.1 time: 0.816644 Aug 30 17:34:28.356161 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1054/2200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:27 2022] DELETE /compute/v2.1/images/3a1c1a4e-9c40-448e-8a95-444c75952ab9 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:28.375096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:28.375981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:28.391050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:28.396511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:28.396966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.403741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:28.404300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:28.404743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.421762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:28.437507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a34d669-f31e-4b1a-b230-7af0adacda1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1507 microversion: 2.1 time: 0.646139 Aug 30 17:34:28.441236 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1147/2201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:27 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:28.455683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:28.456549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:28.474566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:28.484824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:28.486436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.488137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:28.488876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:28.490262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.876276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:28.891997 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c02b1627-1ab6-4691-8a61-e6b72ad2ae67 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1477 microversion: 2.1 time: 0.449406 Aug 30 17:34:28.896958 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1148/2202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:28 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1477 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:28.905583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0", "name": "network-vif-deleted", "tag": "aa64c42e-d2b6-4cfe-9ee3-615ee331a08d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:28.925450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:28.928421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:28.932145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:28.952566 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] Creating event network-vif-deleted:aa64c42e-d2b6-4cfe-9ee3-615ee331a08d for instance 2d47fb68-bc43-45c0-bd1a-8c6acb5f83d0 on n-h1-852771-11 Aug 30 17:34:28.971663 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4d66b647-9f90-410b-b5f8-a8845b212278 req-cb1421b8-06a0-4e13-908f-cc7c8a78b3c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071235 Aug 30 17:34:28.972482 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1149/2203] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:28.981200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ffd307d6-afde-4c66-ae0d-286fd965c9ce tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d990580d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:29.060861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:29.070563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1704a49-974b-461e-8a03-2ce40750e817 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.709094 Aug 30 17:34:29.084275 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1055/2204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:28 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:29.089768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:29.092532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:29.095632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:29.100502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.101138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.101745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.102614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.103210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.103826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.217636 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00bd156c-99f7-4e72-978d-8c276c49a9d2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "PUT /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1079 microversion: 2.1 time: 0.132064 Aug 30 17:34:29.235095 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1056/2205] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:34:29 2022] PUT /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1079 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:29.242529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:29.243289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:29.250596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.251229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.251834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.252750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.253343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.253921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.404685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:29.436835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1595a004-5d33-463f-ab21-220ba492b5d9 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1468 microversion: 2.1 time: 0.200310 Aug 30 17:34:29.460647 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1057/2206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:29 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:29.475591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cb6f81-b378-40c3-be46-471c3ae34d18", "name": "network-vif-plugged", "status": "completed", "tag": "de04bc09-cb50-4af3-b8fe-65b06cc70040"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:29.510220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.510947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.511396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.544760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] Creating event network-vif-plugged:de04bc09-cb50-4af3-b8fe-65b06cc70040 for instance d7cb6f81-b378-40c3-be46-471c3ae34d18 on n-h1-852771-11 Aug 30 17:34:29.558761 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-85c4f792-56c5-440e-9c76-8e3bd52f6fe1 req-9cb1b78d-55e0-4a8c-8595-eb021f46fd52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095060 Aug 30 17:34:29.561250 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1058/2207] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:29.574341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:29.575230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:29.584197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.584997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.585734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.586709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.587956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.588683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.752908 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ffd307d6-afde-4c66-ae0d-286fd965c9ce tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe" status: 204 len: 0 microversion: 2.1 time: 0.778879 Aug 30 17:34:29.754345 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1150/2208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:28 2022] DELETE /compute/v2.1/images/5a1da744-533f-4344-90b1-5df81057adfe => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:29.763116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:29.765201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:29.774193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.774959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.775628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.777064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:29.777657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:29.778607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:29.814420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:30.033183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb589f29-84be-480c-8ea8-2c5868aff892 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 204 len: 0 microversion: 2.1 time: 0.273919 Aug 30 17:34:30.033935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1151/2209] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:29 2022] DELETE /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:34:30.053111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:30.055621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:30.084923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.085705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.086454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.088118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.088866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.089636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.300431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:30.313440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1da9ccf-417c-4c24-aead-4ae2bc1ffe1f tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1505 microversion: 2.1 time: 0.750788 Aug 30 17:34:30.314569 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1059/2210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:29 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:30.330989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:30.340688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57fb8a82-926d-46e5-bb8d-9a8f6559a844 tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1477 microversion: 2.1 time: 0.305310 Aug 30 17:34:30.341296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:30.342219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:30.354461 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1152/2211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:30 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:30.361027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.361848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.362053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:30.362641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:30.362952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.363921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.364546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.365577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.369825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.370321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.370758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.371464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.371950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.372426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.645774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:30.665983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a7c5bd1d-6b59-4693-ba38-a5ba42701c0e tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1324 microversion: 2.1 time: 0.310238 Aug 30 17:34:30.672432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1153/2212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:30 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:30.679296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:30.680378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:30.690271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.691083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.691817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.692700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.693931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.694594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.757777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:30.771094 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e544e35-5781-4898-ab5a-eebff82db6e3 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1473 microversion: 2.1 time: 0.448905 Aug 30 17:34:30.775615 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1060/2213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:30 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1473 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:30.794013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:30.795099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:30.803588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.804429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.805693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.806974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.819876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.828295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.873197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:30.873920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:30.874581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:30.875233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lazy-loading 'fault' on Instance uuid d0f7cb06-6bca-40c3-b2f6-1c07eae493bd {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:31.015758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:31.033250 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2e640bf-fceb-4e3b-9f58-fc4f3464bed9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1505 microversion: 2.1 time: 0.356588 Aug 30 17:34:31.034988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:31.046827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-845c836f-91ee-4141-9ea5-2360867da1a6 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1305 microversion: 2.1 time: 0.264911 Aug 30 17:34:31.047698 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1061/2214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:30 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1305 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:31.048244 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1154/2215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:30 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:31.054926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f7cb06-6bca-40c3-b2f6-1c07eae493bd", "name": "network-vif-deleted", "tag": "9da007b3-7d71-47af-9e7a-f72289b2a381"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:31.055352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:31.058693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:31.071037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.071782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.072438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.073365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.074120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.074699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.089777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.095729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.096474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.129384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] Creating event network-vif-deleted:9da007b3-7d71-47af-9e7a-f72289b2a381 for instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd on n-h2-852771-11 Aug 30 17:34:31.142254 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7c126162-d8c5-4705-9d2d-72ddcaf8d757 req-3426f497-3976-46de-8de4-fb3390baf62e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090493 Aug 30 17:34:31.143072 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1062/2216] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:31.241497 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f70d6536-3ab8-4ad8-993c-504dbbb137f4 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "PUT /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1081 microversion: 2.1 time: 0.190771 Aug 30 17:34:31.242514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1155/2217] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:34:31 2022] PUT /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1081 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:31.268092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:31.268796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:31.280302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.280936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.281374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.291125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.292049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.292640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.367057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:31.367869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:31.382360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.382858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.383300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.397793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.398415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.399022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.678094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff2753ae0d547589265d28f0a3bd2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fccaba9aa34bbc98b69e09baca041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:31.689809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e733607-ff81-497a-aa4a-aacafe2109bb tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 200 len: 1306 microversion: 2.1 time: 0.327101 Aug 30 17:34:31.691091 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1156/2218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:31 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 1306 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:31.696395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:31.698497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:31.707872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.710246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.710854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.712797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:31.713421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:31.714009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:31.927455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:31.950310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-730683b0-18dd-48bc-ac3b-4bc9d40cb621 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1507 microversion: 2.1 time: 0.691686 Aug 30 17:34:31.960947 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1063/2219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:31 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:31.969187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:31.969806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.000221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:32.000584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.001227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.001672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.002403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.002846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.005170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.018638 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ae64588-4ea7-449c-b0cc-52f5589a75a1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1521 microversion: 2.1 time: 0.326254 Aug 30 17:34:32.020063 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1157/2220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:31 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:32.027363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.028627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.039787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.040515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.041104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.041976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.043224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.044000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.433484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:32.436625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:32.446102 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3b2ec6f-58e3-4423-b112-56ecef10d850 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1507 microversion: 2.1 time: 0.423486 Aug 30 17:34:32.446871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1158/2221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:32 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:32.452036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.452815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.460826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.461689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.462366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.463188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.463675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.464108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.484386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:32.494309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-056562a5-780d-4e5c-8a99-84b344980f64 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1473 microversion: 2.1 time: 0.531970 Aug 30 17:34:32.494892 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1064/2222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:31 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1473 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:32.538197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.539035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.552500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:32.558082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.564339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.566527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.569975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.570447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.573736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.675171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.677762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.678217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.678674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lazy-loading 'fault' on Instance uuid d0f7cb06-6bca-40c3-b2f6-1c07eae493bd {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:32.772580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132cb6854f064d2e8b8193de1c7d5861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a152d89d8c448c590cd4d7e885c7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:32.790177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c851d86-d247-4f30-8454-ca69858a8159 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 200 len: 1305 microversion: 2.1 time: 0.294228 Aug 30 17:34:32.790976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1065/2223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:32 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 1305 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:32.798038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.798721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.808804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.809866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.810363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.811130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.811989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-735b8a57-1307-4f9e-a663-8c10973bd9dc tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 204 len: 0 microversion: 2.1 time: 0.363511 Aug 30 17:34:32.812818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.813237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.817049 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1159/2224] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:32 2022] DELETE /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:32.828656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.830250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] [instance: a0d30c0d-758e-4d3f-b971-1eac3702fb40] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.851635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.852607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:32.852899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.853414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.854152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.854618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.855130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.877519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] HTTP exception thrown: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Request method failure captured: Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 HTTP/1.1 Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknpEHpQtcmDotrExESM1SWTBhk02OcM9Gw8inbwf2Wo7GNxcnixF6TDJgfjg3z8M1tVOeKk3o_y8F5Guu1lK4ZXA_H4h_rcpqArSVkeXfnSiIb9AfmM0QFcAbirz53R0k_D0f24D4_it41fp5l5Ncqr-hwdwe61D76VZGm3fbKpXJg Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c2fccaba9aa34bbc98b69e09baca041e Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:32.881489 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c2fccaba9aa34bbc98b69e09baca041e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c2fccaba9aa34bbc98b69e09baca041e"}]}] Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c2fccaba9aa34bbc98b69e09baca041e Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2082318857 Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminNegativeTestJSON-2082318857-project Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4ff2753ae0d547589265d28f0a3bd2a6 Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2082318857-project Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. Aug 30 17:34:32.882915 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a0d30c0d-758e-4d3f-b971-1eac3702fb40'} Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:32.883697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. Aug 30 17:34:32.885550 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:32.888742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] Returning 404 to user: Instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:32.889786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8376a41-2b7e-47a1-9fda-6d3e47d9f91b tempest-ServersAdminNegativeTestJSON-2082318857 tempest-ServersAdminNegativeTestJSON-2082318857-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40" status: 404 len: 111 microversion: 2.1 time: 0.070338 Aug 30 17:34:32.891435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1160/2225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:32 2022] GET /compute/v2.1/servers/a0d30c0d-758e-4d3f-b971-1eac3702fb40 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:32.914131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:32.914800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:32.930101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.930601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.931036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.935000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:32.935527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:32.936017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:32.993404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2b338c7-99cd-4177-9379-c02c06854a76 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 204 len: 0 microversion: 2.1 time: 0.200151 Aug 30 17:34:32.994713 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1066/2226] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:32 2022] DELETE /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:33.312507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:33.335738 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b2a78ce-9284-453e-843b-928896bf6757 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1527 microversion: 2.1 time: 0.437901 Aug 30 17:34:33.336357 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1161/2227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:32 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:33.346397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:33.346832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:33.366349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:33.366928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:33.367837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:33.368236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:33.369007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:33.369452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:33.481727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:33.585870 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.compute.api [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Instance is already in deleting state, ignoring this request Aug 30 17:34:33.587438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f5c7eee1-95d8-4c99-927b-2ff4f765dba2 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 204 len: 0 microversion: 2.1 time: 0.249494 Aug 30 17:34:33.591704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1162/2228] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:33 2022] DELETE /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:33.598116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d30c0d-758e-4d3f-b971-1eac3702fb40", "name": "network-vif-deleted", "tag": "94d14a3c-df4b-4c47-ae70-58422f53eea1"}, {"server_uuid": "1a212786-ac1b-4080-aac9-1b6bcfce5f2e", "name": "network-vif-deleted", "tag": "e51d53e0-2b99-48f8-a792-d2d0331a8aeb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:33.620614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:33.621233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:33.621682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:33.653392 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Creating event network-vif-deleted:94d14a3c-df4b-4c47-ae70-58422f53eea1 for instance a0d30c0d-758e-4d3f-b971-1eac3702fb40 on n-h2-852771-11 Aug 30 17:34:33.653986 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] Creating event network-vif-deleted:e51d53e0-2b99-48f8-a792-d2d0331a8aeb for instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e on n-h2-852771-11 Aug 30 17:34:33.664900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e29f660b-df4b-4c42-9190-da75ddb59436 req-5414fe46-33cb-43ef-86ca-bf9d438c2007 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071828 Aug 30 17:34:33.665532 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1163/2229] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:33.673368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:33.674285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:33.684073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1131827712", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "35ec3db1-8ecb-4b4e-bfde-21991f53efff"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:33.701589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:33.709508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:33.709508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:33.709895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:33.710709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:33.711082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:33.719281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:33.822070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] validate_networks() for [('35ec3db1-8ecb-4b4e-bfde-21991f53efff', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:34:34.219373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:34.233228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0462b8c-d185-4894-8a2d-864fbde299c0 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 200 len: 1431 microversion: 2.1 time: 0.566064 Aug 30 17:34:34.234630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1164/2230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:33 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 1431 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:34.249187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:34.250088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:34.260231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.261533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.263271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:34.264901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.265547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.266218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:34.607258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:34.615639 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36f15a7b-1660-4736-b6ce-9ded64bb79f9 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1513 microversion: 2.1 time: 0.378653 Aug 30 17:34:34.632565 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1165/2231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:34 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:34.637615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:34.638256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] [instance: d0f7cb06-6bca-40c3-b2f6-1c07eae493bd] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:34.658530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.659119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.659628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:34.660363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.660828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.661352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:34.700103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] HTTP exception thrown: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Request method failure captured: Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd HTTP/1.1 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknN_wTZJ8cYsVlq_4Iz4ALKPa6IYq9kSlr76naOnLrugRTaDh_cOXuEMo1IMQPNL2XtXN0KfBZeNwUJXo0nc_E_H3cCBiOn_a0TbBsU-2Bd0VjDRPS_wO5oCjb2yhJ_9ik4hQI1GVfRZ6dpuxt-sbarRuZCl0djNQWLYCsQITPBFCw Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:34.702819 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a152d89d8c448c590cd4d7e885c7c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a152d89d8c448c590cd4d7e885c7c44"}]}] Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8a152d89d8c448c590cd4d7e885c7c44 Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-320764154 Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 132cb6854f064d2e8b8193de1c7d5861 Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsTestJSON-320764154-project Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. Aug 30 17:34:34.705616 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'd0f7cb06-6bca-40c3-b2f6-1c07eae493bd'} Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:34.706258 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. Aug 30 17:34:34.707494 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:34.709414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Returning 404 to user: Instance d0f7cb06-6bca-40c3-b2f6-1c07eae493bd could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:34.710315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67fa8c8a-b624-4fed-84cd-09b0eb05b0a2 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd" status: 404 len: 111 microversion: 2.1 time: 0.076642 Aug 30 17:34:34.711063 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1166/2232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:34 2022] GET /compute/v2.1/servers/d0f7cb06-6bca-40c3-b2f6-1c07eae493bd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:34.729222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:34.729849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:34.738789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.739431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.739987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:34.740773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:34.741249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:34.741673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:35.272568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:35.289557 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65c69a5b-7267-4cea-b3b4-3c63fd138348 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1527 microversion: 2.1 time: 0.564325 Aug 30 17:34:35.291010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1167/2233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:34 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1527 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:35.297116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-857bf620-71cf-4b80-8aa9-514af3d2f23c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d9939f940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:35.654196 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-857bf620-71cf-4b80-8aa9-514af3d2f23c tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e04dfd4e-cf80-4b61-bff9-75c0f45059cc" status: 202 len: 0 microversion: 2.1 time: 0.361741 Aug 30 17:34:35.655461 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1168/2234] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:35 2022] DELETE /compute/v2.1/os-security-groups/e04dfd4e-cf80-4b61-bff9-75c0f45059cc => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:35.660499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:35.661924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1a212786-ac1b-4080-aac9-1b6bcfce5f2e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:35.674900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:35.684574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:35.685689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:35.722905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:35.731217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:35.731707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:35.782508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] HTTP exception thrown: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Request method failure captured: Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e HTTP/1.1 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkmO1r3Q2rfXWBfdbwTCV8dSpqlsRmPkJOPwEuYinWNouQeLXTkt_xK3xHsb40W7rVC3gis9A9qpF31zJ4NJ4JT3bUzgScoN-094pZqJAA3O_OWqb7ksptIDUBGHS8Sq4y7egkc1ant7GP0YIdm85ulb8_bNRRrGeuA8wAj5Ng6xupY Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c83f7d6d5ba648cfb8144d776625ecb0 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:35.785209 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c83f7d6d5ba648cfb8144d776625ecb0"}]}] Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c83f7d6d5ba648cfb8144d776625ecb0 Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListImageFiltersTestJSON-910908464-project Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 60bf4b69be994c5080597a25ece2eeeb Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListImageFiltersTestJSON-910908464-project Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. Aug 30 17:34:35.786418 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1a212786-ac1b-4080-aac9-1b6bcfce5f2e'} Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:35.787056 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. Aug 30 17:34:35.788118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:35.797301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Returning 404 to user: Instance 1a212786-ac1b-4080-aac9-1b6bcfce5f2e could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:35.798726 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20e1dbe9-b0d3-49ed-b066-ef413bf43c8f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e" status: 404 len: 111 microversion: 2.1 time: 0.141952 Aug 30 17:34:35.800419 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1169/2235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:35 2022] GET /compute/v2.1/servers/1a212786-ac1b-4080-aac9-1b6bcfce5f2e => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:35.822689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:35.825312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:35.839449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:35.840191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:35.840398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:35.841634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:35.842388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:35.843010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:36.299416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:36.320593 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45c2992c-4f9e-4a0d-b14c-80bde0d2641a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1513 microversion: 2.1 time: 0.514902 Aug 30 17:34:36.321953 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1170/2236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:35 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:36.349911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-054ec031-10c7-4170-9290-3751f98ad445 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] Calling method '.version_select at 0x7f2d98dc3820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:36.544318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:34:36.546443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:34:36.546956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:34:36.547373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:34:36.547821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:34:36.570565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:36.573498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:36.574074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:36.574887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:36.576032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:36.576757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:36.615793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Getting quotas for project b9714a0044b14192a2e72db67b87d1b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:36.622742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Getting quotas for user 3d8d31e1d8194f70b7b8e4949d58bad2 and project b9714a0044b14192a2e72db67b87d1b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:36.649705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:34:36.663366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:34:36.829442 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-356ec633-f8b8-4ee5-92d8-ceb82d08114c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.830832 Aug 30 17:34:36.832756 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1067/2237] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:34:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:34:36.841344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:36.842322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:36.869269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:36.869877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:36.870332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:36.871279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:36.886518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:36.887634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.000241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:34:37.129780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:37.290554 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b56158dc-2014-4f85-b430-ad73daa061eb tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 204 len: 0 microversion: 2.1 time: 0.451896 Aug 30 17:34:37.292365 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1068/2238] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:36 2022] DELETE /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:37.319563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cb6f81-b378-40c3-be46-471c3ae34d18", "name": "network-vif-deleted", "tag": "de04bc09-cb50-4af3-b8fe-65b06cc70040"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:37.352030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.353593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.354192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.379960 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] Creating event network-vif-deleted:de04bc09-cb50-4af3-b8fe-65b06cc70040 for instance d7cb6f81-b378-40c3-be46-471c3ae34d18 on n-h1-852771-11 Aug 30 17:34:37.388058 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ed80cf2c-1578-4c92-badb-749148be31e4 req-4fb37e16-34fa-4473-8b82-f9deb7ae9bce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092927 Aug 30 17:34:37.397349 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1069/2239] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:37.402702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:37.403857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:37.415693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.418230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.420216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.421177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.421790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.422424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.538798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.540970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.541835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.544372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lazy-loading 'fault' on Instance uuid d7cb6f81-b378-40c3-be46-471c3ae34d18 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:37.629689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-054ec031-10c7-4170-9290-3751f98ad445 tempest-SecurityGroupsTestJSON-320764154 tempest-SecurityGroupsTestJSON-320764154-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/10b8d8c0-5f20-422d-8287-1c617ad04a8f" status: 202 len: 0 microversion: 2.1 time: 1.303920 Aug 30 17:34:37.631082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1171/2240] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:36 2022] DELETE /compute/v2.1/os-security-groups/10b8d8c0-5f20-422d-8287-1c617ad04a8f => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:37.636129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:37.636766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:37.651936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.653399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.656027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.656794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.657270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.657710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.894237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a00b7d1af419b8dadb0f1187ad4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77cf8ad0921438ca137b201152c3d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:37.916153 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea25166e-615a-417b-81f9-71bb41218077 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 200 len: 1314 microversion: 2.1 time: 0.517399 Aug 30 17:34:37.917205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1070/2241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:37 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:37.937841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:37.941945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:37.944866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:37.980280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.981378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.983255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:37.988225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:37.988897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:37.992180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.019013 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6990845c-4e5c-4e9d-90f9-9c703f929755 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 2424 microversion: 2.25 time: 0.376637 Aug 30 17:34:38.022251 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1172/2242] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:37 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 2424 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:38.028120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:38.028941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:38.037614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.038942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.039858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.041768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.042468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.043501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.374560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:38.385369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:38.396635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0051ec87-7d31-4a30-896a-d6eeaba524ea tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1221 microversion: 2.1 time: 0.477097 Aug 30 17:34:38.397410 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a21f752-77ea-486f-89d0-4d70d6c06508 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1474 microversion: 2.1 time: 0.373908 Aug 30 17:34:38.412943 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1173/2243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:38 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:38.413382 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1071/2244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:37 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1221 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:38.420098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-11", "block_migration": "auto"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:38.431521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:38.432037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:38.436686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:38.451408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.451945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.452387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.453107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.456656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.457102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.462249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.462902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.466819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.467712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.468286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.468807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.531101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'flavor' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:38.559345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Going to try to live migrate instance to n-h2-852771-11 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:34:38.562678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.563316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.563868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.564440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lazy-loading 'fault' on Instance uuid f9bfd72d-e206-4e8f-983b-5a0737a855ed {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:38.636569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadf1246d7264e3ba4f840a27b1f4aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa023006894034b07e5ea18652e34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:38.644738 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c93c586-0b76-453d-a7ba-f4a3fbae2873 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 200 len: 1307 microversion: 2.1 time: 0.225960 Aug 30 17:34:38.647332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1174/2245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:38 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:38.946215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:38.948484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: d7cb6f81-b378-40c3-be46-471c3ae34d18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:38.960901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.962595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.963292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:38.964362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:38.965393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:38.969981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.003730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 HTTP/1.1 Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:39.005857 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. Aug 30 17:34:39.007398 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'd7cb6f81-b378-40c3-be46-471c3ae34d18'} Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.008152 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. Aug 30 17:34:39.009327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.010363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance d7cb6f81-b378-40c3-be46-471c3ae34d18 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.013837 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fdddb9f6-bdc5-4074-bcb2-2fa6f4baccb1 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18" status: 404 len: 111 microversion: 2.1 time: 0.076505 Aug 30 17:34:39.014627 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1175/2246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:38 2022] GET /compute/v2.1/servers/d7cb6f81-b378-40c3-be46-471c3ae34d18 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:39.197307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Action: 'update', calling method: .version_select at 0x7f2d99058af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:39.201780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.202302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.202750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.222497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.224958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.227172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.275599 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] HTTP exception thrown: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Request method failure captured: Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a HTTP/1.1 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 56 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkouC-qzacAaNFST6aU2p3y8zavCVOV12JHSskls7cUoPOM8VckB79rYSigLSZGcKYKxs09gaxxt1AlCIhMstEQ7i50sExf-qjrHAWH89Hn1GQNSKCiQLhyRh2lGWr7p3YqCh65cZx9etJSPONLuN2ET-lwc0UDBz4-IWbogL5fzBJI Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:34:39.283104 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}] Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0b04e0d9e96e4349928dea960d6da8fa Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:39.284511 n-d-852771-11 devstack@n-api.service[122124]: exception: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '61ea8d68-3712-4be2-8bb9-b335585f941a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.285306 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.286649 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.287804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.287804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.287804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.287804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Returning 404 to user: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.287804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-589ef86e-66da-489f-aace-2f45fd1d80e6 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a" status: 404 len: 110 microversion: 2.53 time: 0.271742 Aug 30 17:34:39.288319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1176/2247] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 30 17:34:39 2022] PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a => generated 110 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:39.294104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd8b34cf-4f46-4c05-9e19-725aa8315e0f tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d9cc5c4c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:39.318894 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-bd8b34cf-4f46-4c05-9e19-725aa8315e0f tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Image not found. Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd8b34cf-4f46-4c05-9e19-725aa8315e0f tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748 HTTP/1.1 Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:39.321483 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bc537404-19b9-4c92-ae46-1ec9f7263748'} Aug 30 17:34:39.322826 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bc537404-19b9-4c92-ae46-1ec9f7263748 to delete Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.323671 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc537404-19b9-4c92-ae46-1ec9f7263748 could not be found. Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.324931 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd8b34cf-4f46-4c05-9e19-725aa8315e0f tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.326331 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd8b34cf-4f46-4c05-9e19-725aa8315e0f tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748" status: 404 len: 62 microversion: 2.1 time: 0.033691 Aug 30 17:34:39.327070 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1177/2248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:39 2022] DELETE /compute/v2.1/images/bc537404-19b9-4c92-ae46-1ec9f7263748 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:39.329483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Action: 'update', calling method: .version_select at 0x7f2d98f70310>, body: {"status": "disabled"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:39.334790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.335290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.335771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.341541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.342030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.342477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.348247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] HTTP exception thrown: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Request method failure captured: Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a HTTP/1.1 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 22 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkouC-qzacAaNFST6aU2p3y8zavCVOV12JHSskls7cUoPOM8VckB79rYSigLSZGcKYKxs09gaxxt1AlCIhMstEQ7i50sExf-qjrHAWH89Hn1GQNSKCiQLhyRh2lGWr7p3YqCh65cZx9etJSPONLuN2ET-lwc0UDBz4-IWbogL5fzBJI Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:34:39.350678 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}] Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0b04e0d9e96e4349928dea960d6da8fa Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: {"status": "disabled"} Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: exception: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.352094 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '61ea8d68-3712-4be2-8bb9-b335585f941a', 'body': {'status': 'disabled'}} Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.352876 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.354398 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.355527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.355527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.360683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Returning 404 to user: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.361808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-275435c9-14e5-4876-978c-e1593739759a tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a" status: 404 len: 110 microversion: 2.53 time: 0.037343 Aug 30 17:34:39.362546 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1178/2249] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 30 17:34:39 2022] PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:39.369567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:39.370298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:39.377232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.377916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.378936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.379857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.381338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.381893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.401143 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 HTTP/1.1 Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:39.403250 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.404502 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3eaa00a7-84a8-4192-b6be-f7668ab3cdf6'} Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.405171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.406439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.407974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.409312 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b08046c0-8d85-4349-99f6-e6162f571312 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 404 len: 111 microversion: 2.1 time: 0.045511 Aug 30 17:34:39.413800 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1179/2250] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:39 2022] DELETE /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:39.420218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Action: 'update', calling method: .version_select at 0x7f2d98e7cb80>, body: {"status": "enabled"} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:39.429071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.429943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.430768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.438723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.439785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.440619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.444684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:39.450397 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] HTTP exception thrown: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Request method failure captured: Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a HTTP/1.1 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 21 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkouC-qzacAaNFST6aU2p3y8zavCVOV12JHSskls7cUoPOM8VckB79rYSigLSZGcKYKxs09gaxxt1AlCIhMstEQ7i50sExf-qjrHAWH89Hn1GQNSKCiQLhyRh2lGWr7p3YqCh65cZx9etJSPONLuN2ET-lwc0UDBz4-IWbogL5fzBJI Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:34:39.452748 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ef9b5aa3ffe4f9bb97e3bd29bbf8999"}]}] Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ef9b5aa3ffe4f9bb97e3bd29bbf8999 Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602 Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0b04e0d9e96e4349928dea960d6da8fa Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: {"status": "enabled"} Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: exception: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.454108 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '61ea8d68-3712-4be2-8bb9-b335585f941a', 'body': {'status': 'enabled'}} Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.455039 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.456236 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.457330 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. Aug 30 17:34:39.457330 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.457734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Returning 404 to user: Service 61ea8d68-3712-4be2-8bb9-b335585f941a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.459420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86b41f92-97d8-4a32-9f61-db4519ef0d85 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a" status: 404 len: 110 microversion: 2.53 time: 0.046747 Aug 30 17:34:39.460639 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1180/2251] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 30 17:34:39 2022] PUT /compute/v2.1/os-services/61ea8d68-3712-4be2-8bb9-b335585f941a => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:34:39.468077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:39.469015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:39.485340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.486364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.487653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.489025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.490563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.491359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.511042 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 HTTP/1.1 Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:39.514857 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.516112 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3eaa00a7-84a8-4192-b6be-f7668ab3cdf6'} Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:39.516741 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. Aug 30 17:34:39.517726 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:39.522674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:39.523702 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ef899a2-8ede-4ff6-9ea7-96f42e5cfcc8 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6" status: 404 len: 111 microversion: 2.1 time: 0.061682 Aug 30 17:34:39.524371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1181/2252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:39 2022] GET /compute/v2.1/servers/3eaa00a7-84a8-4192-b6be-f7668ab3cdf6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:39.531303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:39.533862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:39.541063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.541894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.542628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.543674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.544309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.544909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.794138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:39.810060 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d41f2a4e-09b5-41d3-aaa0-31b80c469988 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1474 microversion: 2.1 time: 0.283663 Aug 30 17:34:39.811047 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1182/2253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:39 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:39.827839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:39.828695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:39.837410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.840401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.841007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.842871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:39.844015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:39.846648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:39.987748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:40.002097 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1dfc6eef-7f64-4443-9de2-ad063f8605a0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1275 microversion: 2.1 time: 0.189386 Aug 30 17:34:40.003045 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1183/2254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:39 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:40.009069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.016195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.016865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.017466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.018740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.019368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.022700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.058892 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c6fdbd98-5e9f-4883-a62b-ce2bfbb13484 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.054699 Aug 30 17:34:40.060093 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1184/2255] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:40.071583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bfd72d-e206-4e8f-983b-5a0737a855ed", "name": "network-vif-deleted", "tag": "7bd88ef8-b053-45dc-9fed-606b6a70b0f0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:40.081606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.082078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.082507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.095304 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] Creating event network-vif-deleted:7bd88ef8-b053-45dc-9fed-606b6a70b0f0 for instance f9bfd72d-e206-4e8f-983b-5a0737a855ed on n-h2-852771-11 Aug 30 17:34:40.100766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e8623d2c-e330-4f78-bc1c-09ff6ad4888d req-bbaded31-43db-408a-841f-4e892e7a5ac1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039281 Aug 30 17:34:40.101541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1185/2256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:40.107457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4fc24971-246e-4253-9ce5-6a133ddd78ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d99058af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.134745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4fc24971-246e-4253-9ce5-6a133ddd78ef tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649698002" status: 202 len: 0 microversion: 2.1 time: 0.031503 Aug 30 17:34:40.136034 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1186/2257] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649698002 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:40.144081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.145216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f9bfd72d-e206-4e8f-983b-5a0737a855ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.153031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.153753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.154642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.155579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.156169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.156730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.173764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] HTTP exception thrown: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Request method failure captured: Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed HTTP/1.1 Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklswqGckfLdCtw7gTO_nDFSXLiPZXQQPsFQe1oPL_iQO_6alQ2Z3XhhV375dL5lTf-IZWD2Ko4Mmx_49Ri7IQfYCPuwabAgw42Gpc7Eh4Zyz285PRpmppRaTmyXMgyAar-Enn00BsncMiS5NT02xPD9bJ_Ym8C2kbW6VV_775s4IlA Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.176225 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9afa023006894034b07e5ea18652e34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9afa023006894034b07e5ea18652e34f"}]}] Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dadf1246d7264e3ba4f840a27b1f4aad Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. Aug 30 17:34:40.178272 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f9bfd72d-e206-4e8f-983b-5a0737a855ed'} Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.179213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. Aug 30 17:34:40.180525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.182624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Returning 404 to user: Instance f9bfd72d-e206-4e8f-983b-5a0737a855ed could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.183766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97ca2246-e713-41d7-b84b-49823c24e255 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed" status: 404 len: 111 microversion: 2.1 time: 0.046384 Aug 30 17:34:40.185060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1187/2258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/servers/f9bfd72d-e206-4e8f-983b-5a0737a855ed => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:40.190001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.194653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.195641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.196244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.197135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.197763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.198335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.228255 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cee32f09-3337-47c3-87e1-a3448d8b1dfb tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.041858 Aug 30 17:34:40.229094 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1188/2259] 10.222.0.50 () {60 vars in 1211 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:40.242275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.243087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.250744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.251400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.252011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.253005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.254136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.254697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.273095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] HTTP exception thrown: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Request method failure captured: Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 HTTP/1.1 Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklswqGckfLdCtw7gTO_nDFSXLiPZXQQPsFQe1oPL_iQO_6alQ2Z3XhhV375dL5lTf-IZWD2Ko4Mmx_49Ri7IQfYCPuwabAgw42Gpc7Eh4Zyz285PRpmppRaTmyXMgyAar-Enn00BsncMiS5NT02xPD9bJ_Ym8C2kbW6VV_775s4IlA Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.275902 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9afa023006894034b07e5ea18652e34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9afa023006894034b07e5ea18652e34f"}]}] Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dadf1246d7264e3ba4f840a27b1f4aad Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.277227 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c3c1e958-79f8-4165-82b0-4e62d28b2d65'} Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.277953 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.279168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.283738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Returning 404 to user: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.285198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a7baa016-4051-4623-9a4b-14b126d07b28 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 404 len: 111 microversion: 2.1 time: 0.054885 Aug 30 17:34:40.287037 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1189/2260] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:40 2022] DELETE /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:40.292638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.296893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.297579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.298173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.299130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.299806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.300396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.328545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f876d2fb-e224-4401-b80c-a13c03129e9d tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040257 Aug 30 17:34:40.329712 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1190/2261] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:40.341168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.342354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: c3c1e958-79f8-4165-82b0-4e62d28b2d65] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.349802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.350288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.350719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.351524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.352443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.353013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.368586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] HTTP exception thrown: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Request method failure captured: Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 HTTP/1.1 Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklswqGckfLdCtw7gTO_nDFSXLiPZXQQPsFQe1oPL_iQO_6alQ2Z3XhhV375dL5lTf-IZWD2Ko4Mmx_49Ri7IQfYCPuwabAgw42Gpc7Eh4Zyz285PRpmppRaTmyXMgyAar-Enn00BsncMiS5NT02xPD9bJ_Ym8C2kbW6VV_775s4IlA Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.371003 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9afa023006894034b07e5ea18652e34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9afa023006894034b07e5ea18652e34f"}]}] Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dadf1246d7264e3ba4f840a27b1f4aad Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.372109 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c3c1e958-79f8-4165-82b0-4e62d28b2d65'} Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.372715 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. Aug 30 17:34:40.373680 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.377998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Returning 404 to user: Instance c3c1e958-79f8-4165-82b0-4e62d28b2d65 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.379587 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-036d6586-f682-47da-943d-a6abab48d851 tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65" status: 404 len: 111 microversion: 2.1 time: 0.048270 Aug 30 17:34:40.380717 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1191/2262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/servers/c3c1e958-79f8-4165-82b0-4e62d28b2d65 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:40.385456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.389863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.390593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.391272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.392290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.392962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.393596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.420679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c319131-1478-4cd2-8590-343613b4a8d3 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852771-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038449 Aug 30 17:34:40.429988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1192/2263] 10.222.0.50 () {60 vars in 1237 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services?host=n-d-852771-11&binary=xxx => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:40.435622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.436441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.444518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.448405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.448908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.449763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.450115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.456289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.477490 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] HTTP exception thrown: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Request method failure captured: Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 HTTP/1.1 Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklswqGckfLdCtw7gTO_nDFSXLiPZXQQPsFQe1oPL_iQO_6alQ2Z3XhhV375dL5lTf-IZWD2Ko4Mmx_49Ri7IQfYCPuwabAgw42Gpc7Eh4Zyz285PRpmppRaTmyXMgyAar-Enn00BsncMiS5NT02xPD9bJ_Ym8C2kbW6VV_775s4IlA Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.480372 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9afa023006894034b07e5ea18652e34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9afa023006894034b07e5ea18652e34f"}]}] Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dadf1246d7264e3ba4f840a27b1f4aad Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.481665 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f95a51d3-bee7-4607-9481-7572fbecb5f8'} Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.482378 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.486766 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.491691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Returning 404 to user: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.492578 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98685775-a884-4ebe-87ec-28732c8821ef tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 404 len: 111 microversion: 2.1 time: 0.061116 Aug 30 17:34:40.494498 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1193/2264] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:40 2022] DELETE /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:40.498018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.501480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.501985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.502423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.503926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.504414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.504826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.534732 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-199c8eda-dd4e-4ea6-8693-dfed3b63bc00 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040497 Aug 30 17:34:40.535384 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1194/2265] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:40.548184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.548815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] [instance: f95a51d3-bee7-4607-9481-7572fbecb5f8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.556871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.557309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.557778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.558510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.558932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.559358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.575535 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] HTTP exception thrown: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Request method failure captured: Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 HTTP/1.1 Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDklswqGckfLdCtw7gTO_nDFSXLiPZXQQPsFQe1oPL_iQO_6alQ2Z3XhhV375dL5lTf-IZWD2Ko4Mmx_49Ri7IQfYCPuwabAgw42Gpc7Eh4Zyz285PRpmppRaTmyXMgyAar-Enn00BsncMiS5NT02xPD9bJ_Ym8C2kbW6VV_775s4IlA Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.577140 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9afa023006894034b07e5ea18652e34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9afa023006894034b07e5ea18652e34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9afa023006894034b07e5ea18652e34f"}]}] Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9afa023006894034b07e5ea18652e34f Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-28698266 Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dadf1246d7264e3ba4f840a27b1f4aad Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-28698266-project Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.578263 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f95a51d3-bee7-4607-9481-7572fbecb5f8'} Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.578903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. Aug 30 17:34:40.584168 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.585990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] Returning 404 to user: Instance f95a51d3-bee7-4607-9481-7572fbecb5f8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.585990 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b998940-f955-4ede-9d8f-7431cffb987a tempest-ServerDiskConfigTestJSON-28698266 tempest-ServerDiskConfigTestJSON-28698266-project] 10.222.0.50 "GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8" status: 404 len: 111 microversion: 2.1 time: 0.034356 Aug 30 17:34:40.585990 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1195/2266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/servers/f95a51d3-bee7-4607-9481-7572fbecb5f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:40.585990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.589967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.590546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.591059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.592090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.592570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.593069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.628208 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df892b94-0754-45f5-ae1e-df43d8f17e43 tempest-ServicesAdminNegativeV253TestJSON-1884378602 tempest-ServicesAdminNegativeV253TestJSON-1884378602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.046484 Aug 30 17:34:40.629271 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1196/2267] 10.222.0.50 () {60 vars in 1239 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:40.797169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85a97f02-8103-4965-83bf-42d38c5186c1 tempest-ServicesAdminNegativeV253TestJSON-2076247551 tempest-ServicesAdminNegativeV253TestJSON-2076247551-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.803033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85a97f02-8103-4965-83bf-42d38c5186c1 tempest-ServicesAdminNegativeV253TestJSON-2076247551 tempest-ServicesAdminNegativeV253TestJSON-2076247551-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '507725d4a48e48ada5c13bc385fcb7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc7c24d91944711abab6896113cf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85a97f02-8103-4965-83bf-42d38c5186c1 tempest-ServicesAdminNegativeV253TestJSON-2076247551 tempest-ServicesAdminNegativeV253TestJSON-2076247551-project] Request method failure captured: Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkotUPGc45gA-Tz-TfvYekUlyK8SP9OBuiYYmul-EHREkdW48RUWf_7_gvybHpJBCw-d_VU1f4dw8ReNHsx9b5T5HchOuNc1cFuAxLBHtP9Bu2FVhSm7svBRIQemsHprPu65RtSKAPAnTwF4xMo9Dm1FRl8FG7hAtBc5qTTyhLvOgRE Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 0dc7c24d91944711abab6896113cf509 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2076247551 Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:40.805657 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0dc7c24d91944711abab6896113cf509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0dc7c24d91944711abab6896113cf509"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0dc7c24d91944711abab6896113cf509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0dc7c24d91944711abab6896113cf509"}]}] Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2076247551 Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 0dc7c24d91944711abab6896113cf509 Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2076247551 Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2076247551-project Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 507725d4a48e48ada5c13bc385fcb7c1 Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2076247551-project Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:34:40.806801 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:34:40.807488 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 17:34:40.808537 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:40.809549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85a97f02-8103-4965-83bf-42d38c5186c1 tempest-ServicesAdminNegativeV253TestJSON-2076247551 tempest-ServicesAdminNegativeV253TestJSON-2076247551-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:40.809549 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85a97f02-8103-4965-83bf-42d38c5186c1 tempest-ServicesAdminNegativeV253TestJSON-2076247551 tempest-ServicesAdminNegativeV253TestJSON-2076247551-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.167561 Aug 30 17:34:40.809549 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1197/2268] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:34:40.838538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:40.839757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:40.856501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.857048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.857504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:40.860762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:40.865464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:40.866830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:41.552661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:41.577433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-809a837d-88e1-4c45-afce-33b7d4061d16 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1474 microversion: 2.1 time: 0.744810 Aug 30 17:34:41.578636 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1198/2269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:40 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1474 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:41.605354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:41.616868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:41.630976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:41.632464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:41.632464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:41.632654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:41.638088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:41.638931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:41.760634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:41.773420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a84db816-7840-41f1-bf28-8eaa6f7aa3ba tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1275 microversion: 2.1 time: 0.192876 Aug 30 17:34:41.774318 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1199/2270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:41 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:42.240172 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1f4fbc7-0ff9-43d4-9233-bb5df0555c53 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/action" status: 202 len: 0 microversion: 2.25 time: 3.825214 Aug 30 17:34:42.244145 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1072/2271] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:34:38 2022] POST /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/action => generated 0 bytes in 3830 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:42.249672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:42.250948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:42.258884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.259983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.260653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.262070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.262767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.263604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.370747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415dde5-0089-4bd1-8306-78e99c6a4f86", "name": "network-vif-deleted", "tag": "10df3cbc-9fd2-4670-b5b2-76b284b4742f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:42.395007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.409562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.410246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.430470 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] Creating event network-vif-deleted:10df3cbc-9fd2-4670-b5b2-76b284b4742f for instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 on n-h2-852771-11 Aug 30 17:34:42.439065 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6bf5577e-75c0-4ff0-948f-115d3aed705b req-19390c4f-da6c-48ca-9fd4-86cdbc62f180 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074362 Aug 30 17:34:42.440439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1073/2272] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:34:42.610456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:42.613230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:42.653092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.654723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.655572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.656514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.657816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.658506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.735835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.736499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.736914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.737378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lazy-loading 'fault' on Instance uuid 1415dde5-0089-4bd1-8306-78e99c6a4f86 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:34:42.882362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:42.893263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:42.894693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:42.896883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-834a45a1-c1e0-497b-8be1-542bfd066543 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.651046 Aug 30 17:34:42.898049 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1200/2273] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:42 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:42.923526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bf4b69be994c5080597a25ece2eeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f7d6d5ba648cfb8144d776625ecb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:42.924375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:42.925118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:42.936184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.937205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.937916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.938770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:42.939589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:42.940731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:42.942491 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e92f3145-63b8-440b-9742-d59f118c439f tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 200 len: 1308 microversion: 2.1 time: 0.344020 Aug 30 17:34:42.943812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1074/2274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:42 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:42.961391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-050e62e6-a252-4074-8d83-ad1818297074 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '.version_select at 0x7f2d985780d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:42.996711 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-050e62e6-a252-4074-8d83-ad1818297074 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Image not found. Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-050e62e6-a252-4074-8d83-ad1818297074 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/dbd04c08-7325-4f89-afa6-a505bbf9a584 HTTP/1.1 Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:42.998600 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'dbd04c08-7325-4f89-afa6-a505bbf9a584'} Aug 30 17:34:42.999876 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dbd04c08-7325-4f89-afa6-a505bbf9a584 to delete Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.000667 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dbd04c08-7325-4f89-afa6-a505bbf9a584 could not be found. Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:43.004758 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-050e62e6-a252-4074-8d83-ad1818297074 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:43.006342 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-050e62e6-a252-4074-8d83-ad1818297074 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/images/dbd04c08-7325-4f89-afa6-a505bbf9a584" status: 404 len: 62 microversion: 2.1 time: 0.051280 Aug 30 17:34:43.007093 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1075/2275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:42 2022] DELETE /compute/v2.1/images/dbd04c08-7325-4f89-afa6-a505bbf9a584 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:43.012495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:43.012998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:43.029563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.030289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.030909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.031963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.032643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.033590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.052953 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b HTTP/1.1 Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:43.054631 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.056175 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b'} Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:43.056878 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.058123 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.059437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:43.059437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-308599ba-ee5c-4b40-b57e-b877b1016ef3 tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 404 len: 111 microversion: 2.1 time: 0.048486 Aug 30 17:34:43.060310 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1076/2276] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:34:43 2022] DELETE /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:43.069562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:43.070354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] [instance: 73364f13-0808-4670-9ac4-9ba19b74df5b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:43.078420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.078924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.079414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.080975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.081440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.081870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.121198 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] HTTP exception thrown: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Request method failure captured: Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b HTTP/1.1 Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDknMy-s13YJJbTrGGjF6bRDk9POQVBe98DbxVPhg8cgDeoT467Fcem4YP03Htcp5RO-VNM7ooOXBvp7xDpxGXAacnY2jfikB5zrdPDvAh3LWFA0nEchJQtmz6iRZNnDYsjpVXpw3RbyUeX-BEcsyOBNvoi-Cj96GVBOUWZfQOt1zRPQ Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:43.123388 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c77cf8ad0921438ca137b201152c3d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c77cf8ad0921438ca137b201152c3d2c"}]}] Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c77cf8ad0921438ca137b201152c3d2c Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-517017182 Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e81a00b7d1af419b8dadb0f1187ad4b7 Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-517017182-project Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.124768 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '73364f13-0808-4670-9ac4-9ba19b74df5b'} Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:43.125479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. Aug 30 17:34:43.126573 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:43.143633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] Returning 404 to user: Instance 73364f13-0808-4670-9ac4-9ba19b74df5b could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:43.149253 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-702e7301-5c8f-4ab4-8511-5d418b407dab tempest-ImagesOneServerNegativeTestJSON-517017182 tempest-ImagesOneServerNegativeTestJSON-517017182-project] 10.222.0.50 "GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b" status: 404 len: 111 microversion: 2.1 time: 0.086066 Aug 30 17:34:43.150499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1077/2277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:43 2022] GET /compute/v2.1/servers/73364f13-0808-4670-9ac4-9ba19b74df5b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:43.537775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:43.547717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-579d5bd4-58f0-491a-af38-d1494ab6675b tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.647858 Aug 30 17:34:43.548517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1201/2278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:42 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:43.928170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:43.934158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:43.952587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.953590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.956117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.957190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.957857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.958843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.965727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:43.966349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] [instance: 1415dde5-0089-4bd1-8306-78e99c6a4f86] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:43.978431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.979214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.979885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:43.980784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:43.987148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:43.987863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:44.009629 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] HTTP exception thrown: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Request method failure captured: Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 HTTP/1.1 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkmO1r3Q2rfXWBfdbwTCV8dSpqlsRmPkJOPwEuYinWNouQeLXTkt_xK3xHsb40W7rVC3gis9A9qpF31zJ4NJ4JT3bUzgScoN-094pZqJAA3O_OWqb7ksptIDUBGHS8Sq4y7egkc1ant7GP0YIdm85ulb8_bNRRrGeuA8wAj5Ng6xupY Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c83f7d6d5ba648cfb8144d776625ecb0 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:34:44.011719 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c83f7d6d5ba648cfb8144d776625ecb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c83f7d6d5ba648cfb8144d776625ecb0"}]}] Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c83f7d6d5ba648cfb8144d776625ecb0 Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-910908464 Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListImageFiltersTestJSON-910908464-project Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 60bf4b69be994c5080597a25ece2eeeb Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListImageFiltersTestJSON-910908464-project Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. Aug 30 17:34:44.013225 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1415dde5-0089-4bd1-8306-78e99c6a4f86'} Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:44.013950 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. Aug 30 17:34:44.015143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:34:44.017032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Returning 404 to user: Instance 1415dde5-0089-4bd1-8306-78e99c6a4f86 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:44.018179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-31f086b3-96a5-4a62-9f19-7fcb9e066005 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86" status: 404 len: 111 microversion: 2.1 time: 0.056394 Aug 30 17:34:44.019218 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1202/2279] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:43 2022] GET /compute/v2.1/servers/1415dde5-0089-4bd1-8306-78e99c6a4f86 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:34:44.028405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e4c466f-ac10-4029-a3dc-59077b527168 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d98dc3790>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:44.472406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:44.500614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:44.503276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:44.504908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f726ba3-0186-4db9-8d36-8a69da8c7420 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.587223 Aug 30 17:34:44.519830 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1078/2280] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:43 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:44.577993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:44.579118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:44.590514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e4c466f-ac10-4029-a3dc-59077b527168 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b" status: 204 len: 0 microversion: 2.1 time: 0.565918 Aug 30 17:34:44.593661 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1203/2281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:44 2022] DELETE /compute/v2.1/images/869128de-efb2-4c29-b3a6-cbc92446bc1b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:34:44.596134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:44.599373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:44.600021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:44.605413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:44.605713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1bb96d9-2638-41cc-a6e9-38eaa5441cd6 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d992021f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:44.606748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:44.608337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:44.999878 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1bb96d9-2638-41cc-a6e9-38eaa5441cd6 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45" status: 204 len: 0 microversion: 2.1 time: 0.402087 Aug 30 17:34:45.000814 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1204/2282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:44 2022] DELETE /compute/v2.1/images/d3eeff46-634a-4848-a603-2875a81e4a45 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:34:45.009683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f181d0f0-c0c8-4482-bdde-4e615e003fc4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] Calling method '.version_select at 0x7f2d99210d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:45.310691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f181d0f0-c0c8-4482-bdde-4e615e003fc4 tempest-ListImageFiltersTestJSON-910908464 tempest-ListImageFiltersTestJSON-910908464-project] 10.222.0.50 "DELETE /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50" status: 204 len: 0 microversion: 2.1 time: 0.305592 Aug 30 17:34:45.314340 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1205/2283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:45 2022] DELETE /compute/v2.1/images/0c2f3161-a200-49b8-a5ce-a6122dd4ca50 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:34:45.340432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:45.404217 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53708272-123f-4115-a6a3-e187eed9ff33 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.826013 Aug 30 17:34:45.405689 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1079/2284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:44 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:45.532929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:45.533567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:45.573259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:45.574082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:45.575391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:45.577831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:45.579028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:45.581190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:46.306286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1b2d82-9f0c-4776-befd-b35a47f54b4f", "tag": "c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:46.327366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:46.329206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:46.332839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:46.359119 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] Creating event network-changed:c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb for instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f on n-h1-852771-11 Aug 30 17:34:46.375747 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-db126bb9-7940-4b95-a43b-ba08f678d1b4 req-db86a822-a4bf-485e-bdaa-5fda06182e7f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073844 Aug 30 17:34:46.376915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1080/2285] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:34:46.429189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:46.430686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:46.450414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:46.457842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:46.459951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:46.461867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:46.462504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:46.463085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:46.605015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:46.632410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:46.851978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:46.875679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:46.877803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:46.879045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4a28f1c-33bb-45da-af1b-3b0f5bd12dbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 1.351387 Aug 30 17:34:46.905293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1206/2286] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:45 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:47.283927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:47.296508 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b12d0b3-9633-4325-9e3a-0f37944ed0b6 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.873983 Aug 30 17:34:47.310100 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1081/2287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:46 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:34:47.906321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:47.908231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:47.924885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:47.925433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:47.928350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:47.929809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:47.930617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:47.938647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:48.320022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:48.321357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:48.336383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:48.337107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:48.338023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:48.339106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:48.339813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:48.340657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:48.611696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:48.622095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:48.628662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:48.630279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e611fbc1-dbeb-4714-ad47-90f5f93ba481 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.727824 Aug 30 17:34:48.651704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1207/2288] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:47 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:48.835181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:48.849803 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e428d14c-7ea8-496d-b083-7fa29b051d2a tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.536158 Aug 30 17:34:48.852889 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1082/2289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:48 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:49.665436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:49.666321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:49.694620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:49.695939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:49.697084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:49.699303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:49.700883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:49.704430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:49.885152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:49.888087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:49.909713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:49.910217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:49.912369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:49.914308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:49.919328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:49.919981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:50.458097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:50.476005 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aff9b7b0-5fec-4ba2-95da-5e730a319d98 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.596229 Aug 30 17:34:50.477790 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1083/2290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:49 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:50.599912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:50.667574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:50.719100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:50.763199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:50.764812 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8be5d1f-ba56-45cf-8309-c77f15e27bd8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 1.104339 Aug 30 17:34:50.768585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a4fb5f8c-8a57-4d39-9c0e-2ec50e670f2f tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] Calling method '.version_select at 0x7f2d984bd3a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:50.781856 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1208/2291] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:49 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:50.910837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a4fb5f8c-8a57-4d39-9c0e-2ec50e670f2f tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] 10.222.0.50 "GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515" status: 200 len: 784 microversion: 2.1 time: 0.429861 Aug 30 17:34:50.911740 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1084/2292] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 30 17:34:50 2022] GET /compute/v2.1/images/565db0f0-616b-43a3-8762-95a8e129a515 => generated 784 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:50.929789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c5725b1-d0e2-46a0-ad4f-40d61928171b tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] Calling method '.version_select at 0x7f2d991b9790>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:51.061798 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c5725b1-d0e2-46a0-ad4f-40d61928171b tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.136400 Aug 30 17:34:51.078531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67c2b888-8a0f-431f-9829-a6829f3e7fae tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] Calling method '.version_select at 0x7f2d9851bdc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:51.084924 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1209/2293] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 30 17:34:50 2022] GET /compute/v2.1/images => generated 445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:51.140243 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67c2b888-8a0f-431f-9829-a6829f3e7fae tempest-ListImagesTestJSON-107477505 tempest-ListImagesTestJSON-107477505-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.067026 Aug 30 17:34:51.152347 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1085/2294] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:34:51 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:51.500497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:51.501479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:51.516367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:51.517396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:51.518436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:51.519410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:51.520097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:51.520815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:51.792370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:51.793144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:51.807214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:51.812247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:51.813986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:51.821676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:51.822450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:51.823103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:52.310884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:52.336234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:52.338072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:52.346982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aedc2560-7776-45a3-84cc-56bd65832c0e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.555666 Aug 30 17:34:52.351984 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1086/2295] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:51 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:52.432209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:52.441869 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee60f1bb-1e6f-4cc4-8db5-ac95214c4e45 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.946975 Aug 30 17:34:52.457830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1210/2296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:51 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:53.372971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:53.374174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:53.389707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:53.392273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:53.392724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:53.398690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:53.399199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:53.399732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:53.467231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:53.467892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:53.491711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:53.492262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:53.497237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:53.498046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:53.503667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:53.508651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:54.043861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:54.057962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:54.064041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:54.065559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad219484-21d7-47dc-b340-98585013e954 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.698581 Aug 30 17:34:54.071253 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1087/2297] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:53 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:54.215101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:54.229938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5680559e-ab51-4759-b780-5f98fed93c38 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.767996 Aug 30 17:34:54.230544 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1211/2298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:53 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:54.656566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-535884631", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:54.737058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:34:55.129132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:55.130657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:55.151517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.152058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.152855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.154091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.154715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.156399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.495907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:34:55.496337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:34:55.496888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:34:55.497997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:34:55.498421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:34:55.514718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.515597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.516267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.517833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.518961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.519611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.560392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:55.566578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:55.568898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for user c2ec4dfcb09b45d7b8fe7319077cc12a and project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:55.588126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:34:55.594702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:55.597720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:55.600398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:34:55.613010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:55.619761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:55.621901 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8bae3bcb-88b1-4fbb-bef8-d707b51dce90 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.517857 Aug 30 17:34:55.622986 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1212/2299] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:55 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:55.641907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:55.642697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:55.652259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.653094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.654296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.656902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:55.660065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:55.660821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:55.757346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b36b118-af19-439a-a36f-c867cec686d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684694 Aug 30 17:34:55.764920 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1088/2300] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:34:56.358423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:56.368757 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bba98b82-ef33-41a1-976d-1644685eff95 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.742293 Aug 30 17:34:56.375570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1213/2301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:55 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:56.381279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-148918640", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:56.459540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f17d2af-9415-45f4-b103-571c93243740 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d984cd310>, body: {"keypair": {"name": "tempest-keypair-780419804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwogeLtMduWxgokM+0zQ09opKNnFh13P2F9E3UEUZxCXc8fJkKxITedcQyCWXeNU+KcfF3OpUl8DasXEFiv35kpaNcizm1PiFUawAwFXIvZEDwCnAdYzNM8T83h3wMp6g=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:56.487860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:34:56.519519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2f17d2af-9415-45f4-b103-571c93243740 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:56.538283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2f17d2af-9415-45f4-b103-571c93243740 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:56.610338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f17d2af-9415-45f4-b103-571c93243740 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.523790 Aug 30 17:34:56.611377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1089/2302] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:34:56.624214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-47404147-4fc7-4f39-8e25-7b31bbb8c62b tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d984cdee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:56.663495 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-47404147-4fc7-4f39-8e25-7b31bbb8c62b tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-780419804" status: 200 len: 497 microversion: 2.1 time: 0.037691 Aug 30 17:34:56.664621 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1090/2303] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 30 17:34:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-780419804 => generated 497 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:56.683169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:56.685454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:56.713806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:56.714577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:56.715776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:56.718355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:56.719681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:56.721266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:56.783933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.003422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:34:57.004445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:34:57.005905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:34:57.006559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:34:57.007201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:34:57.019945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:57.024656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.027174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.027869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.028838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.031018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:57.031299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.031935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.043688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:57.045075 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be5f570e-ce10-4e01-8adf-6aaed653a2a3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.377177 Aug 30 17:34:57.045721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1091/2304] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:56 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:57.062601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a42fe66d-7dda-470a-a82d-be5c4108ff7d tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d98455dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.099921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:57.110928 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a42fe66d-7dda-470a-a82d-be5c4108ff7d tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780419804" status: 202 len: 0 microversion: 2.1 time: 0.061751 Aug 30 17:34:57.111566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1092/2305] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780419804 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:57.122535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.123583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1b2d82-9f0c-4776-befd-b35a47f54b4f", "name": "network-vif-plugged", "status": "completed", "tag": "c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.124449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for user c2ec4dfcb09b45d7b8fe7319077cc12a and project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:57.144622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.145097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.146323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.171178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:34:57.176860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:34:57.178051 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] Creating event network-vif-plugged:c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb for instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f on n-h1-852771-11 Aug 30 17:34:57.189112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5a5d70b7-8375-4696-bd04-5ecbc3daf865 req-43751ff7-e272-4d85-8d27-40b16e6b96fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074637 Aug 30 17:34:57.192558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1093/2306] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:57.199943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25459eea-5122-4ef3-846a-ebcf9ba6269f tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d984cda60>, body: {"keypair": {"name": "tempest-keypair-1977374200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApK8RYcEwFZWc89J/pxNEP5xrZJ2vgPMI7uvqj8iwPHTruN8lON6N12oBxCh7KD+3/hckcyC75RMcmOJLLLwEHy11ldjc1q9IGIu8yvMxowempr55ZR2j70Px9SgSEz3g=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.241917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-25459eea-5122-4ef3-846a-ebcf9ba6269f tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:57.249814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-25459eea-5122-4ef3-846a-ebcf9ba6269f tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:57.287981 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9932b908-01be-43c3-82fc-093edf85f803 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911089 Aug 30 17:34:57.294263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1214/2307] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:34:57.310670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2496bdcc-ed80-45f5-931d-0fcde2afae1c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.311302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2496bdcc-ed80-45f5-931d-0fcde2afae1c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:57.322399 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25459eea-5122-4ef3-846a-ebcf9ba6269f tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127871 Aug 30 17:34:57.324537 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1094/2308] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:57.340450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fc483c2-6221-4d1e-ac48-a1da53d6051b tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d98461ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.385918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fc483c2-6221-4d1e-ac48-a1da53d6051b tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977374200" status: 202 len: 0 microversion: 2.1 time: 0.053332 Aug 30 17:34:57.390142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1095/2309] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977374200 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:57.410347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.412703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:57.447421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.447938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.456314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.460125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.462485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.466039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.545635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2496bdcc-ed80-45f5-931d-0fcde2afae1c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:57.558379 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2496bdcc-ed80-45f5-931d-0fcde2afae1c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1213 microversion: 2.1 time: 0.252662 Aug 30 17:34:57.560957 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1215/2310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:57 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:57.577297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24a4ced8-d714-4bab-b2ba-036a254281b7 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d98dcc9d0>, body: {"keypair": {"name": "tempest-keypair-1465420620", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.613323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24a4ced8-d714-4bab-b2ba-036a254281b7 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:57.628992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24a4ced8-d714-4bab-b2ba-036a254281b7 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:57.685970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24a4ced8-d714-4bab-b2ba-036a254281b7 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.123960 Aug 30 17:34:57.686613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1216/2311] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:57.698050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-898201a0-b89b-4334-94a2-1910579b1301 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d99210d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.735823 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-898201a0-b89b-4334-94a2-1910579b1301 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465420620" status: 202 len: 0 microversion: 2.1 time: 0.041699 Aug 30 17:34:57.736427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1217/2312] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465420620 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:34:57.751418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee429d44-c442-477c-97da-3dd354cc3f7a tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d98b33670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1905042517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgwvw0pPglej8OjXB6+iy4bElJnXW4Zd1K9nueCUw+SR8oAzyzWgA43N6gNpz3s6IcHAtKCaxw3eNDt6+U74NNYc5SJVZ03pI4pm1y6y2UybJFoeTZb5Uqox8KBaMg66Q=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.809688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ee429d44-c442-477c-97da-3dd354cc3f7a tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:57.824814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ee429d44-c442-477c-97da-3dd354cc3f7a tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:57.879402 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee429d44-c442-477c-97da-3dd354cc3f7a tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.130387 Aug 30 17:34:57.881662 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1218/2313] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:57.903456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0aca59e-121e-4f00-842d-9e2787c1c1f2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d991064c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-713042298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqxNljGNSxePDeG4cPbBTuztoMH3pfSafKVMzUtKANVIDoYjyhppZhfy7XpSL3NarTJn3uPJZRyP7b9M5ENUaJROEhF9YrsSMEZVnRfde0Duef67fZEeQgyolu7Ge8yRQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.953912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c0aca59e-121e-4f00-842d-9e2787c1c1f2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:57.968910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c0aca59e-121e-4f00-842d-9e2787c1c1f2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:58.044834 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0aca59e-121e-4f00-842d-9e2787c1c1f2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.152491 Aug 30 17:34:58.046316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1219/2314] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:58.064418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a6ee27c-f8a0-4b7e-b50c-be544c87cd83 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Action: 'create', calling method: .version_select at 0x7f2d9cd93af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-97034737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVTkwbgN1By7zPorP/W4im0V1Mx5VmnFeCY6K4Ep3S9a4nQDEErO9L1NiWRYT5Hh/w4TJbdIuFCIhdPrk96X//b8CJ3RS0iyRV4REL3F0zaHH8u9mj745d+sqJgnI9gVw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:58.066582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:58.078680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7119ff3-567e-4984-8afe-715e694e6e54 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1317 microversion: 2.1 time: 0.685302 Aug 30 17:34:58.083590 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1096/2315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:57 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:58.096620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.102460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:58.122529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6a6ee27c-f8a0-4b7e-b50c-be544c87cd83 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:58.128820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.129319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.129770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:58.130543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.134774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6a6ee27c-f8a0-4b7e-b50c-be544c87cd83 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Getting quotas for user c284038c526a4a498a18c3e223f1d569 and project b74a4fe710a14062b9400a707f321285. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:58.135084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.135847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:58.228792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a6ee27c-f8a0-4b7e-b50c-be544c87cd83 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.172979 Aug 30 17:34:58.229393 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1220/2316] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:34:58.246223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95f5a472-4bc6-4792-bb47-afb6a470ee50 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d98dcc9d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.250263 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-95f5a472-4bc6-4792-bb47-afb6a470ee50 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:34:58.257640 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95f5a472-4bc6-4792-bb47-afb6a470ee50 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.021340 Aug 30 17:34:58.258793 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1221/2317] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:34:58 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:58.272485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-184610f2-1453-4ba8-9417-92c67b41fd50 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d99318ee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.339650 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-184610f2-1453-4ba8-9417-92c67b41fd50 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-97034737" status: 202 len: 0 microversion: 2.1 time: 0.074081 Aug 30 17:34:58.340969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1222/2318] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-97034737 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:58.352789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3fda984-0ee1-4d0e-9980-20a36ee20df2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d98a03a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.402655 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3fda984-0ee1-4d0e-9980-20a36ee20df2 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-713042298" status: 202 len: 0 microversion: 2.1 time: 0.056977 Aug 30 17:34:58.403575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1223/2319] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-713042298 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:58.415238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-711b4904-2581-45f9-ab94-3be1051034b6 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] Calling method '.version_select at 0x7f2d9924e160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.469868 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-711b4904-2581-45f9-ab94-3be1051034b6 tempest-KeyPairsV2TestJSON-88473532 tempest-KeyPairsV2TestJSON-88473532-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1905042517" status: 202 len: 0 microversion: 2.1 time: 0.058013 Aug 30 17:34:58.471865 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1224/2320] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 17:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1905042517 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:58.580884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.581692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:58.608990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.611873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.612341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:58.613095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.618722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.619231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:58.779432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:58.794455 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59332e5c-7c3a-4707-810d-8c829f7e38d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1217 microversion: 2.1 time: 0.217605 Aug 30 17:34:58.808041 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1225/2321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:58 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:59.076192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:59.091066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:59.095945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:59.103469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:59.104474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:59.111340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e3bcf56a-7e3a-434c-94cd-c0c8849705c9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 1.026388 Aug 30 17:34:59.115166 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1097/2322] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:34:58 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:34:59.119451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:59.120689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:59.122706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:59.126767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:59.127545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:59.128145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:59.528267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17b96246-d873-4aa0-84fb-0e1bfb73e08e tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d98daa160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIPJL/izIKCEb4pKxjWtNUcYLSNl7hWH1ojGUi3QJSt5qOGqqKEIlcqNLG4lxKyxMjvxr+ZI8qwhWP7prdBrEBRifhuAXlCM2wXD2dcfNOE26p/je1BKHAWBTbUhCN0Rw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17b96246-d873-4aa0-84fb-0e1bfb73e08e tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 257 Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:59.533050 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:34:59.534206 n-d-852771-11 devstack@n-api.service[122123]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIPJL/izIKCEb4pKxjWtNUcYLSNl7hWH1ojGUi3QJSt5qOGqqKEIlcqNLG4lxKyxMjvxr+ZI8qwhWP7prdBrEBRifhuAXlCM2wXD2dcfNOE26p/je1BKHAWBTbUhCN0Rw=="}} Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIPJL/izIKCEb4pKxjWtNUcYLSNl7hWH1ojGUi3QJSt5qOGqqKEIlcqNLG4lxKyxMjvxr+ZI8qwhWP7prdBrEBRifhuAXlCM2wXD2dcfNOE26p/je1BKHAWBTbUhCN0Rw=='}}} Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.534897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:59.535794 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:34:59.538237 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:34:59.539224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 17:34:59.539224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.539224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17b96246-d873-4aa0-84fb-0e1bfb73e08e tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:59.539224 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17b96246-d873-4aa0-84fb-0e1bfb73e08e tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.177876 Aug 30 17:34:59.539224 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1098/2323] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:59 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:34:59.546605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d984bd670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1195524737", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:59.569990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:59.576628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for user afe7afa718df4cb6948799592fd994ab and project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:59.600990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 2167 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1195524737", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:59.628790 n-d-852771-11 devstack@n-api.service[122123]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1195524737', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:59.630768 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0230edb2-1ff0-4788-98ef-127f1e9c32b4 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.088234 Aug 30 17:34:59.632990 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1099/2324] 10.222.0.50 () {60 vars in 1160 bytes} [Tue Aug 30 17:34:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:34:59.643451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e4c2676-159c-4cfd-8301-19642a90399c tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d984aec10>, body: {"keypair": {"name": "tempest-keypair-1137470075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5vy+SpbaW6HqcAs6vpCthHngCntDVnC9WfLGBTwXjwTJOLpvGHETwXdGDF4GbhdSup52PY2b5zbkrXQ6+tOAyb4FLusNaRgPAEFDUcmFtXE3qS65KRewdh+RcXirpmMw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:59.664767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2e4c2676-159c-4cfd-8301-19642a90399c tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:59.681169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-2e4c2676-159c-4cfd-8301-19642a90399c tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for user afe7afa718df4cb6948799592fd994ab and project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:59.734508 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e4c2676-159c-4cfd-8301-19642a90399c tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094151 Aug 30 17:34:59.745183 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1100/2325] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:59.750709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d98f12790>, body: {"keypair": {"name": "tempest-keypair-1137470075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3btNSb5Krtt0yNSSjfg1gy2mf51q8Pyb1ZfbAmms218dTDig8w3uI1G81ddkSQb2TJSVa8JD0opGrncX7vZ14hX0IUHauHgJMFzpBkORPAp0CIfx8k8zH+x85EtMeI7A=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:59.775292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:34:59.783077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for user afe7afa718df4cb6948799592fd994ab and project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:34:59.817421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] HTTP exception thrown: Key pair 'tempest-keypair-1137470075' already exists. Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 273 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: {"keypair": {"name": "tempest-keypair-1137470075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3btNSb5Krtt0yNSSjfg1gy2mf51q8Pyb1ZfbAmms218dTDig8w3uI1G81ddkSQb2TJSVa8JD0opGrncX7vZ14hX0IUHauHgJMFzpBkORPAp0CIfx8k8zH+x85EtMeI7A=="}} Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: exception: Key pair 'tempest-keypair-1137470075' already exists. Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1137470075', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3btNSb5Krtt0yNSSjfg1gy2mf51q8Pyb1ZfbAmms218dTDig8w3uI1G81ddkSQb2TJSVa8JD0opGrncX7vZ14hX0IUHauHgJMFzpBkORPAp0CIfx8k8zH+x85EtMeI7A=='}}} Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'afe7afa718df4cb6948799592fd994ab-tempest-keypair-1137470075' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 17:34:59.891192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result.read() Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 17:34:59.894362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'afe7afa718df4cb6948799592fd994ab-tempest-keypair-1137470075' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 17, 34, 59, 809423), 'updated_at': None, 'name': 'tempest-keypair-1137470075', 'user_id': 'afe7afa718df4cb6948799592fd994ab', 'fingerprint': 'ea:9a:19:d1:2c:f2:5e:55:40:56:2b:74:9a:0d:ed:36', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3btNSb5Krtt0yNSSjfg1gy2mf51q8Pyb1ZfbAmms218dTDig8w3uI1G81ddkSQb2TJSVa8JD0opGrncX7vZ14hX0IUHauHgJMFzpBkORPAp0CIfx8k8zH+x85EtMeI7A==', 'type': 'ssh'}] Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi keypair.create() Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._create() Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1137470075' already exists. Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 30 17:34:59.902853 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1137470075' already exists. Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1137470075' already exists. Aug 30 17:34:59.916805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:34:59.921360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 409 to user: Key pair 'tempest-keypair-1137470075' already exists. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:34:59.923692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91722fc1-666b-455f-985e-7f670a526152 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.176744 Aug 30 17:34:59.926565 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1101/2326] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:34:59 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:34:59.938776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:59.945274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:59.956096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:59.957361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:59.959712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:59.961283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:59.962440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:59.963680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.089428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.108247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3633b2a-2b58-4da2-8b2d-528da16ca037 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1506 microversion: 2.1 time: 1.009664 Aug 30 17:35:00.109416 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1226/2327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:59 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1506 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:00.112193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.113942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7dcd448-5277-44fc-b3ca-13f4359f9267 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Calling method '.version_select at 0x7f2d991064c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.148664 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a7dcd448-5277-44fc-b3ca-13f4359f9267 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137470075" status: 202 len: 0 microversion: 2.1 time: 0.038109 Aug 30 17:35:00.149248 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1227/2328] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137470075 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:00.157392 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25272dd4-7223-4a0f-9e7f-5cb2dcdb4989 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1271 microversion: 2.1 time: 0.221895 Aug 30 17:35:00.159539 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1102/2329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:59 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:00.169011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.169968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.179176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.183174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.196280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.196780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.197239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.197972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.198433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.198861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.205617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.206099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.206545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.207278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.207753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.208199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.278989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb9ddf84-6c10-4cad-b9f6-beb2122e21f0 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips" status: 200 len: 109 microversion: 2.1 time: 0.120322 Aug 30 17:35:00.279609 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1228/2330] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips => generated 109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:00.311202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42707421-e93d-4d10-8c8b-8b41e0b74f44 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d98b33d30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAhT7TRSDLJReVxvHKZYHdHgg6P2ob92fka5Qz6HkgcVwtbJJb9ll0V4+MV420IOOY3sFH4RMjGveZAdw6x5x0XdKw9pNf7FYHyZaX700D5ovbhD76rsg98xo9LUxNkQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42707421-e93d-4d10-8c8b-8b41e0b74f44 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 247 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAhT7TRSDLJReVxvHKZYHdHgg6P2ob92fka5Qz6HkgcVwtbJJb9ll0V4+MV420IOOY3sFH4RMjGveZAdw6x5x0XdKw9pNf7FYHyZaX700D5ovbhD76rsg98xo9LUxNkQ=="}} Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAhT7TRSDLJReVxvHKZYHdHgg6P2ob92fka5Qz6HkgcVwtbJJb9ll0V4+MV420IOOY3sFH4RMjGveZAdw6x5x0XdKw9pNf7FYHyZaX700D5ovbhD76rsg98xo9LUxNkQ=='}}} Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi '' Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:35:00.315233 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:35:00.318813 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.321884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42707421-e93d-4d10-8c8b-8b41e0b74f44 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:00.322961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42707421-e93d-4d10-8c8b-8b41e0b74f44 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.033649 Aug 30 17:35:00.328545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1229/2331] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:35:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:00.334115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.334897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.341996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.342731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.343357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.344280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.344945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.345649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.386406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e7fcbfc-4e33-4553-9a97-dd000d94bd48 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips" status: 200 len: 109 microversion: 2.1 time: 0.055533 Aug 30 17:35:00.387526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1230/2332] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips => generated 109 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:00.392424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d994d1430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2005728753", "public_key": " "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:00.447502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:00.454935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for user afe7afa718df4cb6948799592fd994ab and project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:00.494171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:00.512832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 95 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2005728753", "public_key": " "}} Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2005728753', 'public_key': ' '}}} Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.517724 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.523206 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.530303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:00.533317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c4acbb8-aa2f-4acf-bcd2-fd2f5ad01562 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.143772 Aug 30 17:35:00.534887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1231/2333] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Aug 30 17:35:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:35:00.549105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.549725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.559174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.560122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.560920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.562975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.563810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.565470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.607648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3bf47743-992b-4724-ba2a-f1e0936794f1 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips/tempest-ServerAddressesTestJSON-1400940234-network" status: 200 len: 94 microversion: 2.1 time: 0.071273 Aug 30 17:35:00.608877 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1232/2334] 10.222.0.50 () {58 vars in 1401 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f/ips/tempest-ServerAddressesTestJSON-1400940234-network => generated 94 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:00.616402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a67c7ea-6315-412d-bf52-af807664d6e3 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d98e7c700>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmDvnzmXND3XgtOs9t7V6RmShifXZVrXtvmH7EMI9S+oDWtnhyWbH2ocxXM+8W27wNvE3hbemvQwKQegf2pfhb/pQDSwTOB+HggLka1WirljPk+W4vQJypwImg6Ss4iFQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a67c7ea-6315-412d-bf52-af807664d6e3 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 507 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmDvnzmXND3XgtOs9t7V6RmShifXZVrXtvmH7EMI9S+oDWtnhyWbH2ocxXM+8W27wNvE3hbemvQwKQegf2pfhb/pQDSwTOB+HggLka1WirljPk+W4vQJypwImg6Ss4iFQ=="}} Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmDvnzmXND3XgtOs9t7V6RmShifXZVrXtvmH7EMI9S+oDWtnhyWbH2ocxXM+8W27wNvE3hbemvQwKQegf2pfhb/pQDSwTOB+HggLka1WirljPk+W4vQJypwImg6Ss4iFQ=='}}} Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 17:35:00.620861 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a67c7ea-6315-412d-bf52-af807664d6e3 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:00.624305 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a67c7ea-6315-412d-bf52-af807664d6e3 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012942 Aug 30 17:35:00.628583 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1233/2335] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:35:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:00.635999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.636548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.647563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.647934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.648099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.651080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.652143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.652772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.692082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:35:00.839581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e46199d4-1ac8-4c8a-bfe6-9352e4668961 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 204 len: 0 microversion: 2.1 time: 0.209168 Aug 30 17:35:00.840964 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1234/2336] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:35:00 2022] DELETE /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:00.850234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Action: 'create', calling method: .version_select at 0x7f2d98e7cb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-676252951", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:00.869407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.879266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.884582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:00.885863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.887272 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-727d5f7a-9001-44b8-8712-31aac6ea69c7 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.724479 Aug 30 17:35:00.891384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Getting quotas for user afe7afa718df4cb6948799592fd994ab and project 58e75c8f749448619f87f46f4f76063c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:00.912082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.915902 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1103/2337] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 117 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-676252951", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-676252951', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 17:35:00.916737 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 17:35:00.920496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.925097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:00.926424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ca08904-59ae-4bc2-8ed7-1bc626c39ac6 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.083962 Aug 30 17:35:00.927816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.928321 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1235/2338] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:35:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:35:00.928966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.938443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1aa34a43-d9f3-4edc-aaa8-1aef6cef70a2 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Calling method '.version_select at 0x7f2d98dc3700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.938993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.939974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.940679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.941627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.942316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.943299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.978153 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1aa34a43-d9f3-4edc-aaa8-1aef6cef70a2 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1aa34a43-d9f3-4edc-aaa8-1aef6cef70a2 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Request method failure captured: Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913077420 HTTP/1.1 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpDt9t9XtBJ4lQYb7qg_CwKsUb8EiY-ubFFoLqOthNf4vclRn56UpBIub9ln3I4BhO_HhByPK1OFZgvBZCxnRF-8M3zq6TUUrnaNl0petG082UY-tqVfd72h48DKBZzP0BfkQetCQLsGe0NMtyuqYTzMagITUTI43C585EM9U8oW9Q Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58e75c8f749448619f87f46f4f76063c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58e75c8f749448619f87f46f4f76063c"}]}] Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 58e75c8f749448619f87f46f4f76063c Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-349724906 Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-349724906-project Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: exception: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'tempest-keypair-non-existent-1913077420'} Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.981317 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab Aug 30 17:35:00.985196 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:00.986733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1aa34a43-d9f3-4edc-aaa8-1aef6cef70a2 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1913077420 not found for user afe7afa718df4cb6948799592fd994ab {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:00.987723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1aa34a43-d9f3-4edc-aaa8-1aef6cef70a2 tempest-KeyPairsNegativeTestJSON-349724906 tempest-KeyPairsNegativeTestJSON-349724906-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913077420" status: 404 len: 145 microversion: 2.1 time: 0.053554 Aug 30 17:35:00.988082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1236/2339] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913077420 => generated 145 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:35:01.187347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:01.189051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:01.207509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.209137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.212829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:01.215014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.216328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.218061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:01.472147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:01.485617 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eeba9870-73eb-42ae-b1cd-bc580663b148 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1271 microversion: 2.1 time: 0.304796 Aug 30 17:35:01.504664 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1237/2340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:01 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1271 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:01.859689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:01.872220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c547ff5-6951-4c81-9730-744771cb5e5e tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1512 microversion: 2.1 time: 0.955145 Aug 30 17:35:01.874461 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1104/2341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1512 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:01.913397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:01.916180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:01.947730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.948346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.949609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:01.954081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.956808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.960606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.511494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:02.512138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:02.524156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.525838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.525838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.527619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.528090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.529995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.589296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:02.609604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:02.611972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:02.613480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd1cb06e-2f0f-4714-9a16-7bab0497d6c4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.706830 Aug 30 17:35:02.614662 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1238/2342] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:01 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:02.632706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "name": "network-vif-unplugged", "status": "completed", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:02.662250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.664694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.665932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.694607 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] Creating event network-vif-unplugged:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h1-852771-11 Aug 30 17:35:02.702352 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d81d95c1-437d-487f-8a85-c65abc193779 req-8ba96efa-51cf-4ca5-a7b1-ac7a3286abc9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084993 Aug 30 17:35:02.703371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1239/2343] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:02.909560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:02.955079 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d77df47c-e65b-4d75-807b-7cf6d6f2db8b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1271 microversion: 2.1 time: 0.442311 Aug 30 17:35:02.955826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1105/2344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:02 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:02.969896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:02.971457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:02.980301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.981519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.982320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.983184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.985123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.986123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:03.415311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9538633-1f6d-4f6b-a8e5-254425ce47aa tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Action: 'create', calling method: .version_select at 0x7f2d98a03670>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:04.464673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8d31e1d8194f70b7b8e4949d58bad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9714a0044b14192a2e72db67b87d1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:04.477509 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a6d324c6-469f-402d-8d72-38e42af53847 tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 200 len: 1512 microversion: 2.1 time: 1.518265 Aug 30 17:35:04.482837 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1106/2345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:02 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 1512 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:04.494000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:04.496028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:04.510646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:04.514467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:04.515144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:04.516078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:04.517639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:04.519691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:05.547520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:05.697599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:05.713278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:05.716833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:05.721101 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f57a30c-b180-4839-947b-667e0047d853 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 1.235215 Aug 30 17:35:05.722241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1107/2346] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:04 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:06.162362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1251476807", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "a221715c-922c-442c-8ef8-0c4b4ea0b907"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:06.346438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] validate_networks() for [('a221715c-922c-442c-8ef8-0c4b4ea0b907', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:06.555817 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9538633-1f6d-4f6b-a8e5-254425ce47aa tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.808608 Aug 30 17:35:06.556785 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1240/2347] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:35:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:35:06.571690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:06.572675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:06.595012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:06.596933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:06.597579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:06.598483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:06.599765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:06.600485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:06.878459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:06.895250 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7954adae-a640-4b62-8474-c70aa6bf96e1 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 0.336746 Aug 30 17:35:06.896597 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1241/2348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:06 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:06.930984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:06.949556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:06.950814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:06.951592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:06.971255 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] Creating event network-changed:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h1-852771-11 Aug 30 17:35:06.980347 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8ff98a4b-6a35-4cd0-b5ef-9cd68eb99c97 req-ad39598e-5098-4547-9b19-d2c52bd6ba1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080837 Aug 30 17:35:06.982026 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1242/2349] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:06.989130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:06.991100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] [instance: cd1b2d82-9f0c-4776-befd-b35a47f54b4f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:06.998704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:06.999585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:07.000804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:07.001740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:07.005070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:07.005862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:07.027863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] HTTP exception thrown: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Request method failure captured: Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f HTTP/1.1 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkoovV-MYj589Olb19nunPQlHk0F334wooPaKfX4GQlB0cMEEOBtQIZXW8VnQHTKrjhS06veMSwhsfUyuT5FmhiPg59SRyJHukWb3kqULKhugWr8edbyZOBBj6XFh3BTiskY5uVf3nTG1Tg_aNOKgRV3yzJ6kHamfSyDss9siJVuynA Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: b9714a0044b14192a2e72db67b87d1b8 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerAddressesTestJSON-1741216061 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9714a0044b14192a2e72db67b87d1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9714a0044b14192a2e72db67b87d1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9714a0044b14192a2e72db67b87d1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9714a0044b14192a2e72db67b87d1b8"}]}] Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerAddressesTestJSON-1741216061 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: b9714a0044b14192a2e72db67b87d1b8 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1741216061 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerAddressesTestJSON-1741216061-project Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 3d8d31e1d8194f70b7b8e4949d58bad2 Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerAddressesTestJSON-1741216061-project Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'cd1b2d82-9f0c-4776-befd-b35a47f54b4f'} Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:07.029946 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. Aug 30 17:35:07.033656 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:07.039335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] Returning 404 to user: Instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:07.040674 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-171a4269-c1a5-4530-8ca4-ab42e8821d8c tempest-ServerAddressesTestJSON-1741216061 tempest-ServerAddressesTestJSON-1741216061-project] 10.222.0.50 "GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f" status: 404 len: 111 microversion: 2.1 time: 0.057173 Aug 30 17:35:07.041820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1243/2350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:06 2022] GET /compute/v2.1/servers/cd1b2d82-9f0c-4776-befd-b35a47f54b4f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:35:07.050351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c07abc0-0847-409d-9f12-16ea9d124451 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Action: 'create', calling method: .version_select at 0x7f2d9cda8af0>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:07.073257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:09.801242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=26 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:10.041555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c07abc0-0847-409d-9f12-16ea9d124451 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.998177 Aug 30 17:35:10.044110 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1244/2351] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:35:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:10.064607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:10.066020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:10.075706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.076596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.077268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.077620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:10.078719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:10.079356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:10.079752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.080097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:10.080503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.081161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.081755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:10.085188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:10.093631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.094593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.095874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.096835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.113737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.115876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.159313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:10.182764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for user 0150130ff67243309f43d31bf80f45ef and project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:10.197762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:10.200532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:10.273059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfb91b89-fe21-4ca9-b7cb-7048c44b43d8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.548575 Aug 30 17:35:10.274559 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1108/2352] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:10.294331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:10.302397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:10.331719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.332224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.332664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.333900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.342195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.345200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.385651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:10.395211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:10.400013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:10.401256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9559527-d67d-4eec-b495-0d139b43ab25 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.355006 Aug 30 17:35:10.401828 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1245/2353] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:10 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:10.409708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1b2d82-9f0c-4776-befd-b35a47f54b4f", "name": "network-vif-deleted", "tag": "c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:10.434381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.434870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.435308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.447508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] Creating event network-vif-deleted:c3e0d5bf-8ef6-4e77-ac08-f4b7ee1fefbb for instance cd1b2d82-9f0c-4776-befd-b35a47f54b4f on n-h1-852771-11 Aug 30 17:35:10.453695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0a152c0f-6ebd-438a-b2f4-d1b6cfab5654 req-c65b7f8a-ffb7-4340-9298-fa3bbc3ddb8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050664 Aug 30 17:35:10.454582 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1246/2354] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:10.461404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d23f1b09-7a06-4bff-9653-dd60aa0db857 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Action: 'create', calling method: .version_select at 0x7f2d993725e0>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:10.900191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:11.627979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:11.645220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c472d54-69b2-436c-ad53-480ea26d5a0c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 1.362094 Aug 30 17:35:11.645922 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1109/2355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:10 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:11.667349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-767298338", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "a221715c-922c-442c-8ef8-0c4b4ea0b907"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:11.757338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] validate_networks() for [('a221715c-922c-442c-8ef8-0c4b4ea0b907', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:14.986678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:14.987273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:14.987454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:14.988216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:14.988633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:14.996048 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d23f1b09-7a06-4bff-9653-dd60aa0db857 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.539914 Aug 30 17:35:15.003933 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1247/2356] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:35:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:15.004253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.004253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.004253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.004505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:15.004591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.004591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.004752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:15.004842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.012212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.012696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.013311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.014859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.015970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.016667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.026662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:15.032983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for user 0150130ff67243309f43d31bf80f45ef and project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:15.068474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:15.072765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:15.157414 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9cb029f8-2524-4713-ad57-2c0e7cec3a88 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.510205 Aug 30 17:35:15.158494 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1110/2357] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:15.165474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:15.166175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:15.200487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.202072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.209407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.210355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.210819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.211239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.297439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:15.309288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:15.314115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:15.319082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb6901eb-c1ec-4e0f-8c34-b7cc149d9c8b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.319094 Aug 30 17:35:15.320969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1248/2358] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:14 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:15.330737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}, {"name": "network-changed", "server_uuid": "e49998e5-567e-46db-907f-f0b481d2247a", "tag": "97cd37f5-3dba-4d84-b226-9ae163d96ad4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:15.348989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.352160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.355597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.374921 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Creating event network-changed:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:35:15.375442 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] Creating event network-changed:97cd37f5-3dba-4d84-b226-9ae163d96ad4 for instance e49998e5-567e-46db-907f-f0b481d2247a on n-h2-852771-11 Aug 30 17:35:15.396896 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0f5dc9e4-4b3b-4f99-b216-8655ca3c8751 req-a60377d6-3980-45ff-8e5c-3cf4d6ab7948 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074329 Aug 30 17:35:15.399010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1249/2359] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:15.406048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85615573-ece6-4f2d-b0bc-05d69d52c6e4 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Action: 'create', calling method: .version_select at 0x7f2d991e2670>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:16.215469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:16.237831 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78614168-f7f4-4d89-bfbf-c7626b4da5c8 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 1.077854 Aug 30 17:35:16.244281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1111/2360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:15 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:16.254561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-707055379", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "451", "networks": [{"uuid": "a221715c-922c-442c-8ef8-0c4b4ea0b907"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:16.372268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] validate_networks() for [('a221715c-922c-442c-8ef8-0c4b4ea0b907', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:20.252424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:20.253006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:20.258752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:20.259348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:20.259903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:20.285897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.287791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.288464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:20.289937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.290632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.291414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:20.316390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:20.324980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Getting quotas for user 0150130ff67243309f43d31bf80f45ef and project ccddc9927f7349a5a02e4fde9842dcde. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:20.346714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:20.349052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:20.449738 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0e90da8-51cb-47c3-82a5-0df52b67d233 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.204149 Aug 30 17:35:20.450407 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1112/2361] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:20.455129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:20.455957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:20.473471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.474488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.474921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:20.475757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.476202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.477482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.319085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85615573-ece6-4f2d-b0bc-05d69d52c6e4 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.918245 Aug 30 17:35:21.321523 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1250/2362] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:35:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:21.326799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:21.329532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:21.343726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.352487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.353035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.353872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.354405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.354907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.710763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:21.731817 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7a1d6fd-2f5f-4502-bf4d-c5a0a63b32c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 0.408903 Aug 30 17:35:21.736741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1251/2363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:21 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:21.745822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49998e5-567e-46db-907f-f0b481d2247a", "name": "network-vif-plugged", "status": "completed", "tag": "97cd37f5-3dba-4d84-b226-9ae163d96ad4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:21.760931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.762000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.762690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.791110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] Creating event network-vif-plugged:97cd37f5-3dba-4d84-b226-9ae163d96ad4 for instance e49998e5-567e-46db-907f-f0b481d2247a on n-h2-852771-11 Aug 30 17:35:21.800957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f124cadd-39a7-46be-bd60-882fe7c4ed43 req-4b25bc3c-4051-4a7a-982f-114d6a387846 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062336 Aug 30 17:35:21.802981 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1252/2364] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:21.811407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:21.812539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:21.842353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.843207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.844253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.845209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.846196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.846839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.884592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:21.890578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:21.902294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:21.907831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:21.909044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9198d069-b45b-44bd-8eee-9a309158f1aa tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 1.457566 Aug 30 17:35:21.934317 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1113/2365] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:20 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:21.944807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a2be3c6-b5ac-43e7-b44a-c06c1d48b8f5 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d98255dc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:22.030567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:22.067802 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54f0cf83-f08b-4c4f-baba-c71dac0f27bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1272 microversion: 2.1 time: 0.263273 Aug 30 17:35:22.068745 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1253/2366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:21 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:22.077212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394b99da-ae93-48de-9ed7-645b787e57d7", "tag": "e2fb3d03-80d0-4e16-823e-2b9b7267c346"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:22.107957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:22.122620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:22.123022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:22.172072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] Creating event network-changed:e2fb3d03-80d0-4e16-823e-2b9b7267c346 for instance 394b99da-ae93-48de-9ed7-645b787e57d7 on n-h1-852771-11 Aug 30 17:35:22.198823 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3c0f1ab5-1176-4a61-890d-d270c1f48595 req-373daa11-c19c-4302-ad9f-b93df85324ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122248 Aug 30 17:35:22.205558 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1254/2367] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:22.764350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:22.775956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:22.783425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:22.784689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:22.785354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:22.786349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:22.787098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:22.787873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:23.268466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:23.298563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe0799ef-9f48-47d5-a06a-a2b0a2568b27 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 0.544074 Aug 30 17:35:23.304840 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1255/2368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:22 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:23.326406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:23.327294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:23.340206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:23.341082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:23.341739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:23.363842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:23.365296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:23.370622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:23.668165 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a2be3c6-b5ac-43e7-b44a-c06c1d48b8f5 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/16b3d9e5-d8d2-4a96-9522-eadb6f63ab5f" status: 200 len: 142 microversion: 2.1 time: 1.728942 Aug 30 17:35:23.670594 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1114/2369] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:35:21 2022] GET /compute/v2.1/os-floating-ips/16b3d9e5-d8d2-4a96-9522-eadb6f63ab5f => generated 142 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:23.683005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:23.684224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:23.735408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:23.739280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:23.741282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:23.745961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:23.746462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:23.746966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:23.893933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:23.908179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:23.910558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:23.912268 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db474ef4-da6b-4009-a9eb-18d28761e1e3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.591564 Aug 30 17:35:23.913661 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1256/2370] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:23 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:23.920990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65e73896-8135-4440-a097-2d696b107c77 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d98b1a0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:23.973940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:23.992184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70b12523-00f8-4bc6-a6c4-1e433bb57d7d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1278 microversion: 2.1 time: 0.318424 Aug 30 17:35:23.993981 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1115/2371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:23 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:24.003210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-plugged", "status": "completed", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:24.029796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:24.031309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:24.031950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:24.058292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] Creating event network-vif-plugged:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:35:24.073820 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-280bd2af-bffc-4cdb-a6a5-8145be1ad57e req-2146cd3f-33d3-4a10-802e-5d6d64067e51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078386 Aug 30 17:35:24.076634 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1116/2372] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:24.326461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:24.327915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:24.344692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:24.345347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:24.345926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:24.346788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:24.347407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:24.348008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:25.898975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:25.917372 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e0a0983-0206-472d-8231-c148c137c2f0 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1313 microversion: 2.1 time: 1.595929 Aug 30 17:35:25.917980 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1117/2373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:24 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1313 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:25.935155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:25.936141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:25.943659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:25.944258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:25.944763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:25.945560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:25.946083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:25.946580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:26.678598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:26.697765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:26.707803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:26.710562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ef6d6f3-7592-498e-9dae-2dbf483d8a87 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1813 microversion: 2.25 time: 0.790419 Aug 30 17:35:26.713299 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1118/2374] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:25 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1813 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:26.741774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:26.743044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:26.756028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:26.764918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:26.766268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:26.767263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:26.767987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:26.768663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:26.806922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:27.783723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:27.794046 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f63ceae-e525-4ad0-b887-55d9f0f17047 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 1.058604 Aug 30 17:35:27.815288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1119/2375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:26 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:27.828510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bc3b69-9072-4e4f-966b-d252862496b4", "tag": "55de5b34-44fd-4c57-8174-eaa6bbb2d7cf"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:27.839861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:27.840685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:27.841258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:27.873865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] Creating event network-changed:55de5b34-44fd-4c57-8174-eaa6bbb2d7cf for instance 15bc3b69-9072-4e4f-966b-d252862496b4 on n-h1-852771-11 Aug 30 17:35:27.879629 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9a726c9e-b118-4b47-a8a7-26721420811d req-382f30bd-c38e-4f30-ab3b-98cad3d093ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062338 Aug 30 17:35:27.880840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1120/2376] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:27.887029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:27.888148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:27.897203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:27.897950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:27.898591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:27.899724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:27.900511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:27.901188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.497829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:28.515452 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-219f369a-64ae-41fb-9a8e-5a7670c17c3a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1463 microversion: 2.1 time: 0.633021 Aug 30 17:35:28.521452 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1121/2377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:27 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1463 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:28.532057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:28.533003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:28.548777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.549899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.550772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.552478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.553365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.554024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.725403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65e73896-8135-4440-a097-2d696b107c77 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/16b3d9e5-d8d2-4a96-9522-eadb6f63ab5f" status: 202 len: 0 microversion: 2.1 time: 4.809961 Aug 30 17:35:28.728834 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1257/2378] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:35:23 2022] DELETE /compute/v2.1/os-floating-ips/16b3d9e5-d8d2-4a96-9522-eadb6f63ab5f => generated 0 bytes in 4814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:28.733754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:28.734806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:28.750975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.751540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.752130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.753030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.753708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.754377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.895870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:28.924624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:28.927547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:28.929139 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b3cfb4d-fddd-4c03-82c0-152fd8747362 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1803 microversion: 2.25 time: 0.406350 Aug 30 17:35:28.932284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1122/2379] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:28 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1803 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:28.940940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b953d48-a1f5-4bf8-bd4c-a9bd034ecacb tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d98272e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:29.195519 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b953d48-a1f5-4bf8-bd4c-a9bd034ecacb tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.261923 Aug 30 17:35:29.196365 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1123/2380] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 30 17:35:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:29.207090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:29.207740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:29.254029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:29.268339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:29.268953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:29.269719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:29.270185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:29.271127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:30.105308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:30.121466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37b92e8b-6550-4523-8e06-9c34a5abef23 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1463 microversion: 2.1 time: 1.391367 Aug 30 17:35:30.123560 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1258/2381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:28 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1463 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:30.128817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-977c5575-b41a-4d91-9b77-2d43379acdee tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '.version_select at 0x7f2d990580d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:30.134190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-977c5575-b41a-4d91-9b77-2d43379acdee tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:30.135809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-977c5575-b41a-4d91-9b77-2d43379acdee tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:30.136844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-977c5575-b41a-4d91-9b77-2d43379acdee tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:30.148985 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-977c5575-b41a-4d91-9b77-2d43379acdee tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1289 microversion: 2.25 time: 0.024129 Aug 30 17:35:30.150073 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1259/2382] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 30 17:35:30 2022] GET /compute/v2.1/os-migrations => generated 1289 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:30.303650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:30.325829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:30.340205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0aed88a-787e-41a4-9b87-9c0438639735 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 1.139879 Aug 30 17:35:30.342053 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1124/2383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:29 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:30.353371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394b99da-ae93-48de-9ed7-645b787e57d7", "name": "network-vif-plugged", "status": "completed", "tag": "e2fb3d03-80d0-4e16-823e-2b9b7267c346"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:30.374706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=18 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:30.404989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:30.409871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:30.411245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:30.442878 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] Creating event network-vif-plugged:e2fb3d03-80d0-4e16-823e-2b9b7267c346 for instance 394b99da-ae93-48de-9ed7-645b787e57d7 on n-h1-852771-11 Aug 30 17:35:30.450617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8ebec8b7-f33c-482e-9859-367ac4dc47d7 req-ad57bea2-460f-4616-a2b5-196df2415515 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106296 Aug 30 17:35:30.455305 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1125/2384] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:30.460596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: .version_select at 0x7f2d98e731f0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1113295158", "policies": ["affinity"]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:30.485938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f128aa7a-bb0f-42d1-8523-3d779eb1ffc7 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d98272160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:30.530346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:30.538476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:30.564228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:30.618008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:30.628357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:30.644679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f5e1a38-4356-4d4c-916c-5998c9b65f83 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.493393 Aug 30 17:35:30.646533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1260/2385] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 30 17:35:30 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:30.652545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:30.653514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:30.662279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:30.663051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:30.663822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:30.664709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:30.665314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:30.665901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.010659 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f128aa7a-bb0f-42d1-8523-3d779eb1ffc7 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.553762 Aug 30 17:35:31.012270 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1126/2386] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:35:30 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:31.019617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1070947377", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "242cced2-dca9-4c9e-bc27-3e8abdd1848e"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:31.089842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:31.243096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:35:31.311582 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7b28802-e33d-4f50-8f90-f7c901f9f231 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 2424 microversion: 2.25 time: 0.663728 Aug 30 17:35:31.315420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1261/2387] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:30 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 2424 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:31.339152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: .version_select at 0x7f2d98b7fc10>, body: {"server_group": {"name": "tempest-server-group-195641272", "policies": ["affinity"]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:31.374511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:31.387281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:31.497322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:31.506464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:31.538463 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a57cf85-44e8-4df1-b51a-655c3ada61bf tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.221354 Aug 30 17:35:31.541847 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1262/2388] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:35:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:31.551132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-480b00e9-b86e-4681-a7b8-a88180787e11 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d992460d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:31.668609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:31.669398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:31.669881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:31.670287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:31.671131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:31.684456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.684951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.687442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.688257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.691059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.693302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.745109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:31.754671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Getting quotas for user c2ec4dfcb09b45d7b8fe7319077cc12a and project 6e41fbe5fc754f1886dcd6a270efe36f. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:31.794925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:31.798531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:31.881051 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-16b7983d-b9f9-4745-8bb1-64fbe98d278b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866418 Aug 30 17:35:31.888217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1127/2389] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:31.893847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ca421e-91dc-4948-a0f0-ac3cbab70eb3", "tag": "1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:31.908756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.909323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.909982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.925492 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] Creating event network-changed:1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce for instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 on n-h2-852771-11 Aug 30 17:35:31.931791 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a736dfdd-57c5-4b73-a976-6ad43cb0297b req-40621307-51a5-4e21-b951-413bdabd29e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Aug 30 17:35:31.933108 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1128/2390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:31.938208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:31.940071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:31.948116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.949053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.949598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.957144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.958830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.959419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:32.318937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:35:32.357281 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5bac1952-3f10-4cd5-ae01-2fda388e6d2c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 2424 microversion: 2.25 time: 0.422773 Aug 30 17:35:32.374103 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1129/2391] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:35:31 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 2424 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:35:32.397013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:32.397717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:32.413001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:32.413680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:32.416013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:32.416805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:32.417268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:32.417743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:32.611917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:32.625072 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9576133-16ad-4dc1-a701-1e81f0a41b48 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.249537 Aug 30 17:35:32.644125 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1130/2392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:32 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:32.754838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1244773873", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:32.839977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] validate_networks() for [('9dfb5058-00ea-4f65-a61c-4fd0231d3a4e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:33.484576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:33.485282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:33.485916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:33.486709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:33.487600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:33.501215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.501899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.502487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.503446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.504068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.504884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.531652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Getting quotas for project 83276416771c45d3b9d92e8a62d44d9b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:33.539517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:33.542729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Getting quotas for user 9ee51bcebceb454daa31fdd28ff98b03 and project 83276416771c45d3b9d92e8a62d44d9b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:33.563930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:33.566765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:33.629652 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1416ad85-6165-4e6a-9dbe-7cbfcc44d54c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.981019 Aug 30 17:35:33.631504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1131/2393] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:33.641643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: .version_select at 0x7f2d98278790>, body: {"server_group": {"name": "tempest-server-group-195641272", "policies": ["affinity"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:33.697425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:33.707516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:33.774244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:33.782468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:33.821830 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26e0dc27-2329-4efa-a161-0d361f382698 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.189200 Aug 30 17:35:33.823558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1132/2394] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:35:33 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:33.903393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-480b00e9-b86e-4681-a7b8-a88180787e11 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/bf1b350e-5996-49ad-b0ec-1183a4ca014d" status: 202 len: 0 microversion: 2.1 time: 2.357942 Aug 30 17:35:33.908371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1263/2395] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:35:31 2022] DELETE /compute/v2.1/os-floating-ips/bf1b350e-5996-49ad-b0ec-1183a4ca014d => generated 0 bytes in 2363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:33.913803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:33.914834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:33.926029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.931111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.933273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.934160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.935854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.936954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.941827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Action: 'create', calling method: .version_select at 0x7f2d98278430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:33.965697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Getting quotas for project 951b7880577e48a89bac0dc30053814e. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:33.972243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Getting quotas for user 8edf17106fa549a4af7d60c0e676e0d8 and project 951b7880577e48a89bac0dc30053814e. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:34.064432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:34.069322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Getting quotas for project 951b7880577e48a89bac0dc30053814e. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:34.074665 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf9ff978-dfd6-4006-9861-c8e9c92f9d86 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1266 microversion: 2.1 time: 0.165002 Aug 30 17:35:34.076187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1264/2396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:33 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:34.081937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Getting quotas for user 8edf17106fa549a4af7d60c0e676e0d8 and project 951b7880577e48a89bac0dc30053814e. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:34.090586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:34.091448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:34.102341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.107578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.109659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.111543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.112440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.112904 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bfe8b485-0f1b-4faa-b887-d4642008e297 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.286418 Aug 30 17:35:34.119070 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1133/2397] 10.222.0.50 () {62 vars in 1214 bytes} [Tue Aug 30 17:35:33 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:34.124337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.136647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e4ea00b-7d1c-4a83-a23c-741ba04b489d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:34.139638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e4ea00b-7d1c-4a83-a23c-741ba04b489d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:34.326719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'services' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:35:34.423272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9e4ea00b-7d1c-4a83-a23c-741ba04b489d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:34.440387 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e4ea00b-7d1c-4a83-a23c-741ba04b489d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1223 microversion: 2.1 time: 0.324569 Aug 30 17:35:34.440998 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1134/2398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:34 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1223 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:34.465816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:34.466606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:34.473820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.474882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.475419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.476697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.477174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.478269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.527803 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7b65793-b7bf-4b12-b0a1-1dee62a23af9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments/c98b7e4c-ae79-4cb5-a22d-c0408ed79120" status: 202 len: 0 microversion: 2.25 time: 0.445836 Aug 30 17:35:34.535366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1265/2399] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 30 17:35:34 2022] DELETE /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments/c98b7e4c-ae79-4cb5-a22d-c0408ed79120 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:34.646920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35332849-9b6a-46cd-9c0b-68b6bd067f06 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d991ca700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1925127946", "description": "tempest-description-1327160547"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:34.685797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:34.700172 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35e6d23d-278f-4eda-baa5-3168386f4297 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.241496 Aug 30 17:35:34.701067 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1135/2400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:34 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:34.709512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-116fb4e4-6f89-416f-8eba-ca352c83a14d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:34.774013 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-116fb4e4-6f89-416f-8eba-ca352c83a14d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/2f04c4e0-64a5-4ca5-b723-853188857393" status: 204 len: 0 microversion: 2.1 time: 0.068704 Aug 30 17:35:34.776444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1136/2401] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:35:34 2022] DELETE /compute/v2.1/os-server-groups/2f04c4e0-64a5-4ca5-b723-853188857393 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:34.787458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d0505aa-8b83-4830-abcf-6f422af3a2ac tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d9827c4c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.285136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35332849-9b6a-46cd-9c0b-68b6bd067f06 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.744779 Aug 30 17:35:35.286076 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1266/2402] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:35:34 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:35.291952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d246ae87-e5fe-44df-801a-70ede6708253 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.328261 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d246ae87-e5fe-44df-801a-70ede6708253 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.040519 Aug 30 17:35:35.329184 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1267/2403] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 17:35:35 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:35.334942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.337688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:35.345703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.346220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.346658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:35.347611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.348232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.349389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:35.392309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-999a5234-63ef-4353-8078-0db01c82a3a9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061781 Aug 30 17:35:35.393593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1268/2404] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:35:35 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:35.398499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af9b6751-a344-4194-b9f8-694c2bf736d2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.411873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af9b6751-a344-4194-b9f8-694c2bf736d2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.016231 Aug 30 17:35:35.413099 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1269/2405] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:35:35 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:35.418478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.419315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:35.427672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.428347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.428952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:35.429902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.430754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.431529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:36.079621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:36.094516 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b4d52164-21b2-484a-ac8a-8c9eeb670a5a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1272 microversion: 2.1 time: 0.680051 Aug 30 17:35:36.095411 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1270/2406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:35 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1272 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:36.111393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01e9e9c4-d8f9-49f4-b958-7576fc555986 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d98aed8b0>, body: {"security_group_rule": {"parent_group_id": "deaf5f53-27f2-4a35-8529-7990c1c56f44", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:36.641301 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01e9e9c4-d8f9-49f4-b958-7576fc555986 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.544095 Aug 30 17:35:36.641865 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1271/2407] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:36.647826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d7096ff-e367-4c66-a32b-161565963b50 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:36.678622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d7096ff-e367-4c66-a32b-161565963b50 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7" status: 200 len: 235 microversion: 2.64 time: 0.035858 Aug 30 17:35:36.680004 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1272/2408] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 30 17:35:36 2022] GET /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7 => generated 235 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:36.686817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dd4cf81-595c-4bce-b4db-7f9672345f61 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:36.721823 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1dd4cf81-595c-4bce-b4db-7f9672345f61 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/9333897d-362a-41c4-82dd-46ae5bc2549b" status: 204 len: 0 microversion: 2.1 time: 0.039606 Aug 30 17:35:36.722969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1273/2409] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:35:36 2022] DELETE /compute/v2.1/os-server-groups/9333897d-362a-41c4-82dd-46ae5bc2549b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:36.729328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:36.732807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:36.742287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:36.743172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:36.744105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:36.745213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:36.745874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:36.746499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:36.843160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:36.851902 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee6dda16-6ddc-45f7-bdb4-6aaea9c683f5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1281 microversion: 2.1 time: 0.126730 Aug 30 17:35:36.856598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1274/2410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:36 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:36.862034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:36.862998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:36.870313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:36.871118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:36.872417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:36.873684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:36.874632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:36.876295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:37.050491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:37.064268 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1290718-c27a-419f-aabc-8d2c965b6279 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.206229 Aug 30 17:35:37.065587 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1275/2411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:36 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:37.071325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.074292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:37.082460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:37.084094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:37.085103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:37.086712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:37.087559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:37.088235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:37.134285 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5670595e-e02d-47bb-879c-cf65de1c2600 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067214 Aug 30 17:35:37.135748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1276/2412] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:35:37 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:37.143164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-252ac461-452c-4713-afe1-f5850fdcce80 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d99210040>, body: {"security_group_rule": {"parent_group_id": "deaf5f53-27f2-4a35-8529-7990c1c56f44", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:37.204934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-252ac461-452c-4713-afe1-f5850fdcce80 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-252ac461-452c-4713-afe1-f5850fdcce80 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 138 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: {"security_group_rule": {"parent_group_id": "deaf5f53-27f2-4a35-8529-7990c1c56f44", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: exception: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'deaf5f53-27f2-4a35-8529-7990c1c56f44', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:37.208746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:37.212568 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:37.212568 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:37.212568 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 Aug 30 17:35:37.212568 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.215236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-252ac461-452c-4713-afe1-f5850fdcce80 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: This rule already exists in group deaf5f53-27f2-4a35-8529-7990c1c56f44 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:37.216443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-252ac461-452c-4713-afe1-f5850fdcce80 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.079340 Aug 30 17:35:37.217810 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1277/2413] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:37 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:37.227078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a3b3c5a-7e80-4af8-bef8-4e81bea08ba6 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.282045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a3b3c5a-7e80-4af8-bef8-4e81bea08ba6 tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7" status: 204 len: 0 microversion: 2.64 time: 0.062033 Aug 30 17:35:37.284386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1278/2414] 10.222.0.50 () {60 vars in 1307 bytes} [Tue Aug 30 17:35:37 2022] DELETE /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:35:37.301285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7db5d4bd-b6a0-42e6-93f4-fd9f5e73d406 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.325983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7db5d4bd-b6a0-42e6-93f4-fd9f5e73d406 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035691 Aug 30 17:35:37.327949 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1279/2415] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:35:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:37.337652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.340873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:37.355665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:37.356166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:37.356600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:37.357322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:37.358030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:37.359888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:37.493938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:37.512629 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-670fc3be-4f7f-4600-aebd-7044d398eca6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1272 microversion: 2.1 time: 0.181403 Aug 30 17:35:37.514941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1280/2416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:37 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:37.522076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5544a9cc-b781-451a-aed2-98e248a38c9b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d99302670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.758559 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5544a9cc-b781-451a-aed2-98e248a38c9b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/e0135121-f0d3-4320-8950-3110a19fd26e" status: 202 len: 0 microversion: 2.1 time: 0.242301 Aug 30 17:35:37.759748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1281/2417] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 30 17:35:37 2022] DELETE /compute/v2.1/os-security-group-rules/e0135121-f0d3-4320-8950-3110a19fd26e => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:37.766906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56999f5e-c17f-4954-ac4d-b9411d7f35aa tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:37.782195 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-56999f5e-c17f-4954-ac4d-b9411d7f35aa tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] HTTP exception thrown: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56999f5e-c17f-4954-ac4d-b9411d7f35aa tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Request method failure captured: Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7 HTTP/1.1 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpjl9uXBHkf5S78jLP0M89o_uvwrWy_de07vz3gp6VQgeZV1bp_YVoHkTg0fH43QtPbnZnRyf12pmmxaGRsw1tvMdzfWqagHF5oU1yiYUOZt8MwodpV1R0WzWVt0D2uXPwNGH6MHnIKHhX8ewokdfxAvlB91FjGBPR_hc6TpbPlsTQ Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.64 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 951b7880577e48a89bac0dc30053814e Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerGroup264TestJSON-1232734930 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/951b7880577e48a89bac0dc30053814e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/951b7880577e48a89bac0dc30053814e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/951b7880577e48a89bac0dc30053814e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_951b7880577e48a89bac0dc30053814e"}]}] Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerGroup264TestJSON-1232734930 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 951b7880577e48a89bac0dc30053814e Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1232734930 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerGroup264TestJSON-1232734930-project Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8edf17106fa549a4af7d60c0e676e0d8 Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerGroup264TestJSON-1232734930-project Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c666cde2-f21f-40d1-9c4d-05acb58d57f7'} Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.800784 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. Aug 30 17:35:37.805580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:37.808627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56999f5e-c17f-4954-ac4d-b9411d7f35aa tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] Returning 404 to user: Instance group c666cde2-f21f-40d1-9c4d-05acb58d57f7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:37.809778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56999f5e-c17f-4954-ac4d-b9411d7f35aa tempest-ServerGroup264TestJSON-1232734930 tempest-ServerGroup264TestJSON-1232734930-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7" status: 404 len: 117 microversion: 2.64 time: 0.048999 Aug 30 17:35:37.811143 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1282/2418] 10.222.0.50 () {60 vars in 1307 bytes} [Tue Aug 30 17:35:37 2022] DELETE /compute/v2.1/os-server-groups/c666cde2-f21f-40d1-9c4d-05acb58d57f7 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:37.845841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: .version_select at 0x7f2d98f86af0>, body: {"server_group": {"name": "tempest-server-group-1264386681", "policies": ["affinity"]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:37.930087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:37.937025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:37.964420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:38.016737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:38.031558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:38.078769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24d78299-57d1-4af0-bc6f-b92c0f48504d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.266137 Aug 30 17:35:38.084974 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1283/2419] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:35:37 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:38.090092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bc3b69-9072-4e4f-966b-d252862496b4", "name": "network-vif-plugged", "status": "completed", "tag": "55de5b34-44fd-4c57-8174-eaa6bbb2d7cf"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:38.116181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:38.116674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:38.117116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:38.144397 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] Creating event network-vif-plugged:55de5b34-44fd-4c57-8174-eaa6bbb2d7cf for instance 15bc3b69-9072-4e4f-966b-d252862496b4 on n-h1-852771-11 Aug 30 17:35:38.159842 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-58dbc2f0-f4e2-4619-b0ba-8b505ca431eb req-a6ce469d-de2f-4a81-84e7-bce8f4e7cad4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067840 Aug 30 17:35:38.160807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1284/2420] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:38.168959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24335dd4-eca9-4a01-a1c6-ed0aad2cbcbf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d9cda8af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-509243033", "description": "tempest-description-83800967"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:38.354502 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d0505aa-8b83-4830-abcf-6f422af3a2ac tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/db678b36-8abd-4dfd-92e7-ed62e35d81e7" status: 202 len: 0 microversion: 2.1 time: 3.574649 Aug 30 17:35:38.355092 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1137/2421] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:35:34 2022] DELETE /compute/v2.1/os-floating-ips/db678b36-8abd-4dfd-92e7-ed62e35d81e7 => generated 0 bytes in 3578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:38.363264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:38.364144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:38.387659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:38.391899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:38.395195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:38.397955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:38.398931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:38.401098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:38.666721 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24335dd4-eca9-4a01-a1c6-ed0aad2cbcbf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.504022 Aug 30 17:35:38.674416 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1285/2422] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:35:38 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:38.674416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:38.674416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:38.694052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:38.697974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:38.698302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:38.699274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:38.699985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:38.700247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:39.154257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:39.163433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e8ce833-8d7f-412a-a20c-8f9e4f6f6364 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.494424 Aug 30 17:35:39.166061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1286/2423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:38 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:39.170749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9d432cc8-31bf-4a4d-9050-c7b2f600d82f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:39.196048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:39.209883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40a3697d-492a-4802-8bd0-de25795a7a66 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 0.853265 Aug 30 17:35:39.210512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1138/2424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:38 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:39.227080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:39.231272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9d432cc8-31bf-4a4d-9050-c7b2f600d82f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/ce4d4e00-0b65-4a7c-954e-afc42a41d3d2" status: 204 len: 0 microversion: 2.1 time: 0.064081 Aug 30 17:35:39.232796 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1287/2425] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:35:39 2022] DELETE /compute/v2.1/os-server-groups/ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:39.233545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:39.248209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:39.250859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:39.253442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:39.254487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:39.255680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8acabb6-27a9-4144-8c07-c73ffb7544a8 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] Calling method '.version_select at 0x7f2d98f311f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:39.258126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:39.258858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:39.412624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24567fc2-5829-4c00-8230-6fa9ebb00603 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.197883 Aug 30 17:35:39.418397 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1139/2426] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:35:39 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:39.431410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:39.436368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:39.454318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:39.459554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:39.460844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:39.461442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:39.462163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:39.462560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:40.115787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:40.128415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6165b2e-6f9b-41b3-8fb6-20b512576eb5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.707877 Aug 30 17:35:40.130750 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1140/2427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:39 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:40.142121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a07f58a3-99cd-411a-9812-ddad64edf86d tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d9827c670>, body: {"security_group_rule": {"parent_group_id": "c0b3ffba-7484-433a-985f-ccc92d880307", "ip_protocol": "tcp", "from_port": 1034199347, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:40.238532 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a07f58a3-99cd-411a-9812-ddad64edf86d tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Invalid port range 1034199347:22. Former value cannot be greater than the later Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a07f58a3-99cd-411a-9812-ddad64edf86d tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 146 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "c0b3ffba-7484-433a-985f-ccc92d880307", "ip_protocol": "tcp", "from_port": 1034199347, "to_port": 22}} Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid port range 1034199347:22. Former value cannot be greater than the later Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c0b3ffba-7484-433a-985f-ccc92d880307', 'ip_protocol': 'tcp', 'from_port': 1034199347, 'to_port': 22}}} Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1034199347:22. Former value cannot be greater than the later Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1034199347:22. Former value cannot be greater than the later Aug 30 17:35:40.240304 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1034199347:22. Former value cannot be greater than the later Aug 30 17:35:40.244112 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:40.246772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a07f58a3-99cd-411a-9812-ddad64edf86d tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: Invalid port range 1034199347:22. Former value cannot be greater than the later {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:40.247865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a07f58a3-99cd-411a-9812-ddad64edf86d tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.114928 Aug 30 17:35:40.249279 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1141/2428] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:40 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:40.257781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06469ab3-2dd5-4fa8-a297-4a8011887dc6 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:40.304577 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06469ab3-2dd5-4fa8-a297-4a8011887dc6 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.053060 Aug 30 17:35:40.309585 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1142/2429] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:35:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:40.327281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:40.328426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:40.341572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:40.349888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:40.350663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:40.351660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:40.352309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:40.353520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:40.705586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:40.720112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed74c583-004c-49bd-b0c8-cd258897bad0 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.408724 Aug 30 17:35:40.721086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1143/2430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:40 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:40.726052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:40.726669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:40.760936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:40.761443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:40.761883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:40.762602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:40.771644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:40.772334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.266335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:41.279218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a2bedaf-26a7-40d8-88b0-4efe71a93dc4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 0.556836 Aug 30 17:35:41.282284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1144/2431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:40 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:41.296946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9be959d8-6087-479a-91cc-6b4a6581cea8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d98461700>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-624708964", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:41.299100 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9be959d8-6087-479a-91cc-6b4a6581cea8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Security group id should be uuid Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9be959d8-6087-479a-91cc-6b4a6581cea8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 130 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-624708964", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group id should be uuid Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-624708964', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:41.301434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:41.307166 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 30 17:35:41.307166 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:41.309231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9be959d8-6087-479a-91cc-6b4a6581cea8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: Security group id should be uuid {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:41.311201 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9be959d8-6087-479a-91cc-6b4a6581cea8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027802 Aug 30 17:35:41.313954 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1145/2432] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:35:41.323072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: .version_select at 0x7f2d98272e50>, body: {"server_group": {"name": "tempest-server-group-594263664", "policies": ["anti-affinity"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:41.375410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:41.383351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:41.427595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:41.505193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:41.521416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_groups'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:41.561728 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc778fb9-1d81-4d54-bbd0-48784615b496 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.246517 Aug 30 17:35:41.562964 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1146/2433] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:35:41 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:41.571644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ca421e-91dc-4948-a0f0-ac3cbab70eb3", "name": "network-vif-plugged", "status": "completed", "tag": "1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:41.595070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.597273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.597940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.626486 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] Creating event network-vif-plugged:1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce for instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 on n-h2-852771-11 Aug 30 17:35:41.632920 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-09824102-455d-43c7-8e75-504e439f2998 req-a6ea4d72-a523-4271-803b-6a8b264554ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064815 Aug 30 17:35:41.638230 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1147/2434] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:41.665722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:41.693553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:41.717318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.720083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.721146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.722450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.723344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.726498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.837244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44767281-8948-43d0-a5c5-a0f6717a5043 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.196493 Aug 30 17:35:41.838759 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1148/2435] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:35:41 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:35:41.876418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:41.900765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.901237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.901873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.923313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] Creating event network-changed:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:35:41.929060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4a7c6706-4bd8-4af3-a937-028f3a22c22b req-b140448b-f01d-45a6-a83a-5245b5c605d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086596 Aug 30 17:35:41.930781 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1149/2436] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:41.937769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:41.938472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:41.947080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.947594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.948032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:41.948742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:41.949195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:41.949621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:42.100165 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8acabb6-27a9-4144-8c07-c73ffb7544a8 tempest-FloatingIPDetailsTestJSON-425670970 tempest-FloatingIPDetailsTestJSON-425670970-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/f2ea9e54-2036-4242-a7bc-21a6dd5e80d0" status: 202 len: 0 microversion: 2.1 time: 2.866094 Aug 30 17:35:42.100975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1288/2437] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:35:39 2022] DELETE /compute/v2.1/os-floating-ips/f2ea9e54-2036-4242-a7bc-21a6dd5e80d0 => generated 0 bytes in 2867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:42.106630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56c7119e-60f6-4355-bb9b-b73184177625 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d99499550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-508524279", "description": "tempest-description-1300178410"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:42.181279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:42.191986 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-518c3d45-2d78-4a9d-842d-a508595943bf tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.259836 Aug 30 17:35:42.196113 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1150/2438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:41 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:42.207013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ff4684b-58b8-45d4-aae6-e8c2e2b82651 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:42.275943 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ff4684b-58b8-45d4-aae6-e8c2e2b82651 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a198fc28-1e58-4cb5-99a0-bfb360f750cd" status: 204 len: 0 microversion: 2.1 time: 0.078833 Aug 30 17:35:42.277276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1151/2439] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:35:42 2022] DELETE /compute/v2.1/os-server-groups/a198fc28-1e58-4cb5-99a0-bfb360f750cd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:35:42.283437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:42.284467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:42.295373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:42.295747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:42.296237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:42.297115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:42.297569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:42.298038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:42.336475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:42.546008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:42.557777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0e1f2cf5-40ef-4288-a7e9-6426f66d13da tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1320 microversion: 2.1 time: 0.279038 Aug 30 17:35:42.563719 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1152/2440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:42 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:42.570558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ecacd15-1d33-4d55-9135-b12ab7b4336a tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:42.591283 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ecacd15-1d33-4d55-9135-b12ab7b4336a tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026331 Aug 30 17:35:42.591825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1153/2441] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:35:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:42.598273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:42.598273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:42.604996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:42.605483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:42.605913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:42.606617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:42.607057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:42.607960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:43.319262 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56c7119e-60f6-4355-bb9b-b73184177625 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.216810 Aug 30 17:35:43.325304 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1289/2442] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:35:42 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:43.355437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2098289865", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "35806061-6d04-4c32-bd88-56a2b5f0cea1"}]}, "os:scheduler_hints": {"group": "76109f16-791b-476a-999f-8e40a967c006"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:43.447781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] validate_networks() for [('35806061-6d04-4c32-bd88-56a2b5f0cea1', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:35:43.507869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:43.516878 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f5fc16e-8603-4d70-b49b-e3e00e2ed07f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 0.923645 Aug 30 17:35:43.533444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1154/2443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:42 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:43.540376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:43.544523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:43.547674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:43.554739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:43.555233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:43.555772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:43.556490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:43.556938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:43.557375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:43.615875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-613c0ed8-d4ad-4e1d-943c-69581fb8c25f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.080889 Aug 30 17:35:43.622108 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1155/2444] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:35:43 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:43.622108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:43.631381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:43.646106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:43.647021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:43.648507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:43.649615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:43.650299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:43.650945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:43.867860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:43.876141 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc6547e7-98db-4422-84a7-719cd54cd477 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.257891 Aug 30 17:35:43.876715 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1156/2445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:43 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:43.886033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b37f059f-d307-47bd-8ce7-7830a9540ef8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d9827c3a0>, body: {"security_group_rule": {"parent_group_id": "d5865517-fc6d-46f5-8fe5-8f319d0a5681", "ip_protocol": "tempest-999-748008508", "from_port": 22, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:44.054436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b37f059f-d307-47bd-8ce7-7830a9540ef8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Invalid IP protocol tempest-999-748008508. Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b37f059f-d307-47bd-8ce7-7830a9540ef8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 156 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "d5865517-fc6d-46f5-8fe5-8f319d0a5681", "ip_protocol": "tempest-999-748008508", "from_port": 22, "to_port": 22}} Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid IP protocol tempest-999-748008508. Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd5865517-fc6d-46f5-8fe5-8f319d0a5681', 'ip_protocol': 'tempest-999-748008508', 'from_port': 22, 'to_port': 22}}} Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-748008508. Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-748008508. Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:44.056265 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-748008508. Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b37f059f-d307-47bd-8ce7-7830a9540ef8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: Invalid IP protocol tempest-999-748008508. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b37f059f-d307-47bd-8ce7-7830a9540ef8 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.175973 Aug 30 17:35:44.060447 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1157/2446] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:43 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:35:44.067628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:44.068380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:44.075827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.076386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.076884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.077916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.078436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.078923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.260513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:44.272026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd8a38e0-087b-4864-8055-b7f3719a8e95 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1510 microversion: 2.1 time: 0.211390 Aug 30 17:35:44.272768 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1158/2447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:44 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:44.296215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d9b699-9baa-4c5b-ba0e-0f004e7fd554", "tag": "c1e872d3-9e18-4254-b7d1-799c0086c649"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:44.309390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.309870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.310299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.327619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] Creating event network-changed:c1e872d3-9e18-4254-b7d1-799c0086c649 for instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 on n-h2-852771-11 Aug 30 17:35:44.333007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4b0c3824-00e3-4c65-98e1-b4b8b3a7afac req-f30feb9b-5e08-476e-92b6-844a784914b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046414 Aug 30 17:35:44.334241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1159/2448] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:44.343321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7e5644c-6948-4d5f-8273-cb30d9930462 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d982785e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-518310873", "description": "tempest-description-676461917"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:44.526164 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7e5644c-6948-4d5f-8273-cb30d9930462 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.187230 Aug 30 17:35:44.532093 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1160/2449] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:35:44 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:44.548807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:44.552924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:44.564791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.565566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.566662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.568448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.569446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.570085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.814218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:44.823289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd5d1077-6e45-43c3-80af-cb59ab065e16 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1511 microversion: 2.1 time: 0.289902 Aug 30 17:35:44.824223 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1161/2450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:44 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:44.846698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:44.847814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:44.855109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.855634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.856532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:44.857401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:44.858210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:44.858887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.038708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:45.038901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:35:45.039358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:35:45.039654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:35:45.040066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:35:45.040475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:35:45.061180 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62e0dce4-9e45-4205-b451-6f33702844c5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 0.235554 Aug 30 17:35:45.062171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1162/2451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:44 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:45.074288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6afdd56-407e-4999-b4dd-6fd0e06bc3cf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d984bdd30>, body: {"security_group_rule": {"parent_group_id": "e8ad3e4a-4852-4ad1-8148-fd6bf1159b96", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:45.087637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.088128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.088561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.089288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.090007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.090800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.147178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e6afdd56-407e-4999-b4dd-6fd0e06bc3cf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 17:35:45.148930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6afdd56-407e-4999-b4dd-6fd0e06bc3cf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 138 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "e8ad3e4a-4852-4ad1-8148-fd6bf1159b96", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e8ad3e4a-4852-4ad1-8148-fd6bf1159b96', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 17:35:45.149940 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:45.153949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6afdd56-407e-4999-b4dd-6fd0e06bc3cf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:45.157375 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6afdd56-407e-4999-b4dd-6fd0e06bc3cf tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.091527 Aug 30 17:35:45.159133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1163/2452] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:45.168457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:45.176546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:45.182263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:45.200163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.203827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.203827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.203827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.204377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:35:45.207701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.210729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:35:45.215185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.327908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:45.337664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:45.457643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:35:45.478916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Getting quotas for user bf1bfa0924b444f2878a0155d48e8dc8 and project 6340b69db46449c69d7eb2012f15e7ee. Resources: {'server_group_members'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:35:45.569072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c5d492c-5302-49e7-909c-57f805f9a42f tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242279 Aug 30 17:35:45.584327 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1290/2453] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:35:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:35:45.584327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:45.590994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:45.611565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.612164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.612850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.613801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:45.614524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:45.615162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:45.726326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:45.736401 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27532255-bc54-43d3-a85d-cc3b385c5fcd tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1511 microversion: 2.1 time: 0.575946 Aug 30 17:35:45.744197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1164/2454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:45 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:45.783605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7bc791b3-12e0-47aa-9176-756c982c4d44 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d98255a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-735360938", "description": "tempest-description-703661841"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:46.281943 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7bc791b3-12e0-47aa-9176-756c982c4d44 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.536122 Aug 30 17:35:46.282536 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1165/2455] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:35:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:46.294334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0cc5fac-86a3-4239-90ad-88ed3cbdf6a5 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:46.295083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0cc5fac-86a3-4239-90ad-88ed3cbdf6a5 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:46.553555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d0cc5fac-86a3-4239-90ad-88ed3cbdf6a5 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:46.572592 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0cc5fac-86a3-4239-90ad-88ed3cbdf6a5 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1213 microversion: 2.1 time: 0.288950 Aug 30 17:35:46.573323 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1166/2456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:46 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:46.592163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:46.607712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:46.608603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:46.649863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:46.662782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:46.663259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:46.664140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:46.669620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:46.673201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:46.783409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:46.789644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:46.824239 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c69564b8-decd-48e1-bb9e-18e25aefdf97 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 1.242066 Aug 30 17:35:46.830851 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1291/2457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:45 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:46.845357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:46.846211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:46.869730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:46.874546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:46.876071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:46.878682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:46.879423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:46.882856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:46.933000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:47.105058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:47.119140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:47.119948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:47.120617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:47.398840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a97225d-5290-4fc3-8191-6cefcc09be59 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.824436 Aug 30 17:35:47.399795 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1167/2458] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:35:46 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:47.415909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0782e1d2-1030-4c1e-8bbe-fa678db8dacb tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d98255700>, body: {"security_group_rule": {"parent_group_id": "a402e68b-5c41-4b09-93c8-ba0f6f79d4fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 2080635342}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:47.487837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0782e1d2-1030-4c1e-8bbe-fa678db8dacb tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0782e1d2-1030-4c1e-8bbe-fa678db8dacb tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 146 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "a402e68b-5c41-4b09-93c8-ba0f6f79d4fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 2080635342}} Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a402e68b-5c41-4b09-93c8-ba0f6f79d4fe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2080635342}}} Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 Aug 30 17:35:47.489779 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:47.493817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0782e1d2-1030-4c1e-8bbe-fa678db8dacb tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 400 to user: Invalid port range 22:2080635342. Valid TCP ports should be between 1-65535 {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:47.495077 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0782e1d2-1030-4c1e-8bbe-fa678db8dacb tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.093626 Aug 30 17:35:47.501053 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1168/2459] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:47 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:35:47.507311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:47.523229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:47.523229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1251476807', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:47.529943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:47.530419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:47.530854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:47.531597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:47.532049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:47.532471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:47.648842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:47.737584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:47.746569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:47.747372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:47.748051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:47.928416 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d37a803e-b9cf-4a51-bc25-771a7fc71d4c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1251476807" status: 200 len: 1514 microversion: 2.1 time: 0.424518 Aug 30 17:35:47.929642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1169/2460] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:35:47 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1251476807 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:47.947258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Action: 'create', calling method: .version_select at 0x7f2d98455a60>, body: {"security_group_rule": {"parent_group_id": "9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:48.004822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:35:48.005999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Neutron security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:35:48.006721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.006721 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 138 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: {"security_group_rule": {"parent_group_id": "9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:35:48.008901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] Aug 30 17:35:48.013064 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.017333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 404 to user: Security group 9c1b07ea-53ec-4623-a4d8-82cdf3fae6ea does not exist Aug 30 17:35:48.017333 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-98fccb93-e7ec-43e4-81f1-874841b4b7cd'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:48.018465 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e728f81-a6fc-4bc9-928a-a891a9a816b1 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.087713 Aug 30 17:35:48.019549 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1170/2461] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 30 17:35:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:35:48.028638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.031524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:48.050468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.054861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.056983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.058483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.060959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.062303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.084805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.097944 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d238b6a-9ce8-46cd-936b-4096220f762f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 1.265248 Aug 30 17:35:48.098540 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1292/2462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:46 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:48.126172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "name": "network-vif-plugged", "status": "completed", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:48.154546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.155125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.155732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.170931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] Creating event network-vif-plugged:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:35:48.180125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8c78100e-a07b-48af-9f24-0b74b9161f87 req-fc5e7aa9-6f21-44c6-bb06-4151f861f6e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075835 Aug 30 17:35:48.181474 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1293/2463] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:48.187378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.188126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:48.195871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.196315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.196816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.197260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.198136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.198778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.200105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.212057 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d602326-2d4e-43bc-8f59-a94b493a7ce2 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1271 microversion: 2.1 time: 0.191203 Aug 30 17:35:48.213671 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1171/2464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:48 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:48.236766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.257106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.258797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:48.283383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.285086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.286418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.288754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.289323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.291051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.455459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:48.567516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.581354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ffbb5f6-462e-4725-bdba-10328803f9c2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.394532 Aug 30 17:35:48.582231 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1294/2465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:48 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:48.598836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d98aa9dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.619451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.631079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.632305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.632764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.722547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:35:48.723918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Neutron security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 not found {{(pid=122124) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 30 17:35:48.733621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] HTTP exception thrown: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.733621 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Request method failure captured: Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-group-rules/6300e85b-24c5-45e4-8c13-d14e400fba04 HTTP/1.1 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkplMc0IJfbUaQOFmOnQek2LCnXRA_z4JLk6jzdGTfzOBThKVr-RXaaB7z8Bwhwou7iIXIHGCW_rZ8Ho-l0inTkomwkm7oD4y0rr5A626veO2j3pd7CMsh-QB36oYFBMUaGZzORD8pZ74eTJ_UPLRbe_EBUIgJMVoGbGzLVXbvRDE64 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/827ddd4f913d430bad1b43b965b76f25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_827ddd4f913d430bad1b43b965b76f25"}]}] Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 827ddd4f913d430bad1b43b965b76f25 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 870eda7ccf814b6ba8a41fb2eaa3dbe3 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6300e85b-24c5-45e4-8c13-d14e400fba04'} Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:35:48.736800 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] Aug 30 17:35:48.742272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:35:48.748616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Returning 404 to user: Security group rule 6300e85b-24c5-45e4-8c13-d14e400fba04 does not exist Aug 30 17:35:48.748616 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-c5d8e86d-5b07-4d09-b101-f05055dcef69'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:35:48.750307 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c631463-2566-4ab2-b9a2-ac573f29d9c5 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/6300e85b-24c5-45e4-8c13-d14e400fba04" status: 404 len: 199 microversion: 2.1 time: 0.166729 Aug 30 17:35:48.751074 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1295/2466] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 30 17:35:48 2022] DELETE /compute/v2.1/os-security-group-rules/6300e85b-24c5-45e4-8c13-d14e400fba04 => generated 199 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:35:48.771753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb25cb97-fb43-429b-b8ae-92bd8caf2f0b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d98983550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.842876 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85c74e53-a11a-4675-8683-7068355b1cd6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.628841 Aug 30 17:35:48.843508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1172/2467] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 30 17:35:48 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:48.872349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:48.880512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.880958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.servers [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Removing options 'limit' from query {{(pid=122123) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 17:35:48.881799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:48.912616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.913351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.913976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.914842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.918444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.923508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:48.977346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:48.985175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:48.986148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:48.986989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:49.389282 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb25cb97-fb43-429b-b8ae-92bd8caf2f0b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a402e68b-5c41-4b09-93c8-ba0f6f79d4fe" status: 202 len: 0 microversion: 2.1 time: 0.630334 Aug 30 17:35:49.390481 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1296/2468] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:35:48 2022] DELETE /compute/v2.1/os-security-groups/a402e68b-5c41-4b09-93c8-ba0f6f79d4fe => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:49.395674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:49.397248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:49.409292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:49.413774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:49.415044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:49.416192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:49.416936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:49.417519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:49.496160 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0456726-bec2-4829-95a3-2c811154f04a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.627218 Aug 30 17:35:49.496806 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1173/2469] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 17:35:48 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:49.502142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:49.502957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:49.516622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:49.520141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:49.522736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:49.526372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:49.527056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:49.527527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:49.671808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:49.694881 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01f18e2c-474f-4850-90ee-366096e37fc8 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1323 microversion: 2.1 time: 0.302293 Aug 30 17:35:49.695514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1297/2470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:49 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:49.702573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89261965-7a5d-423d-806d-d01c786e6f21 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d989cb310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:50.326931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89261965-7a5d-423d-806d-d01c786e6f21 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e8ad3e4a-4852-4ad1-8148-fd6bf1159b96" status: 202 len: 0 microversion: 2.1 time: 0.628588 Aug 30 17:35:50.327932 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1298/2471] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:35:49 2022] DELETE /compute/v2.1/os-security-groups/e8ad3e4a-4852-4ad1-8148-fd6bf1159b96 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:50.336072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:50.350171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:50.357508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:50.374421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:50.378155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:50.382935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:50.384033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:50.384729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:50.385265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:50.516939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:50.529031 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43b7b07c-1c00-4900-867f-c7c0dec64663 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 1.029251 Aug 30 17:35:50.530554 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1174/2472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:49 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:50.541325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:50.542115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:50.560594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:50.561094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:50.561548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:50.562241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:50.562693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:50.563110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:50.597778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:50.725466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fcea82b-f8a8-4387-adc0-7930db02b4ba tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.395706 Aug 30 17:35:50.726069 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1299/2473] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:35:50 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:50.731782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d9b699-9baa-4c5b-ba0e-0f004e7fd554", "name": "network-vif-plugged", "status": "completed", "tag": "c1e872d3-9e18-4254-b7d1-799c0086c649"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:50.746341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:50.747111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:50.748143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:50.761883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] Creating event network-vif-plugged:c1e872d3-9e18-4254-b7d1-799c0086c649 for instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 on n-h2-852771-11 Aug 30 17:35:50.766908 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a012d497-cbad-4955-9edf-fdea3b6a889a req-7a9e7830-856c-4c74-b743-012eb4be073b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039511 Aug 30 17:35:50.768143 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1300/2474] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:50.774599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc61ee61-8efe-4663-8579-f700aa0e5813 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d989834c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:51.125785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:51.136365 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-205c29fd-a6aa-446d-a245-1d29950f62fa tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.603958 Aug 30 17:35:51.140061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1175/2475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:50 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:51.151916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:51.157877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:51.172772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.173264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.173693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.174405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.177216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.178353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.184432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:51.418565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc61ee61-8efe-4663-8579-f700aa0e5813 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d5865517-fc6d-46f5-8fe5-8f319d0a5681" status: 202 len: 0 microversion: 2.1 time: 0.649156 Aug 30 17:35:51.419988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1301/2476] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:35:50 2022] DELETE /compute/v2.1/os-security-groups/d5865517-fc6d-46f5-8fe5-8f319d0a5681 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:51.428092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:51.445676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:51.447938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.servers [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Removing options 'limit' from query {{(pid=122124) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 17:35:51.450710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:51.463094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.463094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.467149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.472266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.473083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.476558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.501441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:51.509733 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32b97d75-4c39-4958-a5f6-7879c249d4e2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1517 microversion: 2.1 time: 0.368288 Aug 30 17:35:51.511239 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1176/2477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:51 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:51.516952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6755a8a-e781-4a23-87ba-9e2ccfc4ff81 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d984ae040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:51.553293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:51.608788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe116958-3e6e-4aaf-a232-cba88a4e06a8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.186722 Aug 30 17:35:51.610125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1302/2478] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 30 17:35:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:51.616682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:51.620254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:51.631368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.632319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.632970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.634040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.634840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.635468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.689011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lazy-loading 'flavor' on Instance uuid 405f21a5-8833-4802-b076-ec6dfdc948d4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:35:51.831727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e30d7d98-7be0-40a6-8b51-e0675633e603 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action" status: 200 len: 32 microversion: 2.1 time: 0.219333 Aug 30 17:35:51.834679 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1303/2479] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:35:51 2022] POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:51.847429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:51.850594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:51.862461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.886992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.888495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:51.890039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:51.892159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:51.892950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.252129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6755a8a-e781-4a23-87ba-9e2ccfc4ff81 tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c0b3ffba-7484-433a-985f-ccc92d880307" status: 202 len: 0 microversion: 2.1 time: 0.739631 Aug 30 17:35:52.268516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1177/2480] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:35:51 2022] DELETE /compute/v2.1/os-security-groups/c0b3ffba-7484-433a-985f-ccc92d880307 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:52.297596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:52.311859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:52.329105 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce80c1b3-403b-4cce-b01c-5ff08b62cdea tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.489168 Aug 30 17:35:52.330508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:52.332882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:52.337144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1304/2481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:51 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:52.352945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.353682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.354375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.356608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:52.357609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:52.358799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.359522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.362531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.370911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.371437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.371938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.372700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.381418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.381926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.443578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:52.532910 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1087e7b6-5912-4f47-916a-aa4442a4fde8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.257308 Aug 30 17:35:52.536326 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1178/2482] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:35:52 2022] GET /compute/v2.1/servers => generated 1010 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:52.542189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:52.543050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:52.573476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.573971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.574486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.575202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:52.575679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:52.576970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:52.901632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:52.942080 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d72417a7-5ddb-43d3-b8e6-8b8c6ecc8ae4 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.593152 Aug 30 17:35:52.955540 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1305/2483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:52 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:52.969554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8ffef29-f244-4b0a-ade1-aed92c4eb47b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] Calling method '.version_select at 0x7f2d989134c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:53.368785 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8ffef29-f244-4b0a-ade1-aed92c4eb47b tempest-SecurityGroupRulesNegativeTestJSON-1485079149 tempest-SecurityGroupRulesNegativeTestJSON-1485079149-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/deaf5f53-27f2-4a35-8529-7990c1c56f44" status: 202 len: 0 microversion: 2.1 time: 0.418754 Aug 30 17:35:53.370659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1306/2484] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:35:52 2022] DELETE /compute/v2.1/os-security-groups/deaf5f53-27f2-4a35-8529-7990c1c56f44 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:53.377507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:53.381565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:53.398914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:53.399957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:53.406703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9f58ef8e-a744-49ab-8a0c-38a2a8e5c78f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1314 microversion: 2.1 time: 0.869014 Aug 30 17:35:53.407291 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1179/2485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:52 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:53.420374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.421058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.421637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.422658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.423218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.424289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.436928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadfba85-9201-49d2-bae1-95de8c5e6008", "tag": "ad697af6-de75-484d-8613-b3f1e4e82e6c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:53.496588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.497334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.497890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.551404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] Creating event network-changed:ad697af6-de75-484d-8613-b3f1e4e82e6c for instance eadfba85-9201-49d2-bae1-95de8c5e6008 on n-h1-852771-11 Aug 30 17:35:53.582436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d5e1f0e2-600e-4a25-ac49-e64e6f8ea9a6 req-2857d838-508f-4721-a533-7f87f979a397 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166864 Aug 30 17:35:53.586149 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1180/2486] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:53.601625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:53.603899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:53.624115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.628621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.629744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.631596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.633012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.634900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.648128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:53.773123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb9a63b0-828b-4ead-becd-a4f76a578da2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.400829 Aug 30 17:35:53.774663 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1307/2487] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:35:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:53.799791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:53.814664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:53.816078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.servers [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Removing options 'limit' from query {{(pid=122124) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 17:35:53.820695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:53.832748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.833886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.834586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.836223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.837086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.838109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.886619 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d2570d6-f5d9-4f36-b9df-31b82bf1214f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.100994 Aug 30 17:35:53.888191 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1308/2488] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 17:35:53 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:53.910778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:53.922161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:53.923329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1251476807', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:53.935133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.936028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.936714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:53.939115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:53.942286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:53.943709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.112085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:54.257938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-abc5b94a-747f-4576-b704-abfe2f44a5e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1251476807" status: 200 len: 346 microversion: 2.1 time: 0.361049 Aug 30 17:35:54.268348 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1309/2489] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:35:53 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1251476807 => generated 346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:54.270630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:54.271967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:54.279033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:54.280582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.282776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.284100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.284843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.290173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.290641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.339774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:54.358598 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-736fb6dc-8ae7-443d-b675-5e516b4de59c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.767781 Aug 30 17:35:54.361847 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1181/2490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:53 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:54.371534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:54.387215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.396248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.400919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.499975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:35:54.562668 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-479b0849-4698-41b5-afad-d6ee124a876a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "POST /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4/action" status: 202 len: 0 microversion: 2.1 time: 0.198927 Aug 30 17:35:54.567660 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1182/2491] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:35:54 2022] POST /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:54.585338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:54.586042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:54.601010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.602021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.602624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.603381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.603895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.604320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.703774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:54.715159 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5911a290-afdf-499f-a5b6-cf6db9d58d9d tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.455366 Aug 30 17:35:54.728464 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1310/2492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:54 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:54.741478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:54.742269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:54.750083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.750572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.751283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.754496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:54.754496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:54.754496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:54.922471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:54.939380 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-749e6eee-1497-45e8-8422-8be20741e001 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1462 microversion: 2.1 time: 0.361065 Aug 30 17:35:54.940624 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1183/2493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:54 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1462 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:55.066353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:55.071618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:55.091192 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89e39b3b-d24a-45a3-a3e9-56c64c4b0d3b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.359524 Aug 30 17:35:55.094048 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1311/2494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:54 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:55.366089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:55.377980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'deleted': False, 'project_id': '297aa64154d244cabd9ddd3920891b07'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:55.389349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:55.390153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:55.406439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.406919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.407356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.408114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.408561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.408983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.413079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.415284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.415777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.416521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.416985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.417417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.467939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2fc6520-565c-4d59-897c-dce6d411c828 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.504058 Aug 30 17:35:55.469202 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1184/2495] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:35:54 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:55.491171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:55.501002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'deleted': False} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:55.506519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=38 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:55.516799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.517291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.517709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.521597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:55.522283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:55.522965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:55.835807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:56.090080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:DELETE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:56.099789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:56.100871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:56.101464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:56.106724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:56.120460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13a62911-cd8a-4a36-b9f7-15820ba9bb74 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.742899 Aug 30 17:35:56.121078 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1312/2496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:55 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:56.138786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:56.142895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:56.163743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:56.165906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:56.166631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:56.167603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:56.173586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:56.177904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:56.876266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:56.894040 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0291fe40-0f26-4a44-a771-20a74a12b670 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.766327 Aug 30 17:35:56.896324 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1313/2497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:56 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:56.903747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:56.904652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:56.917148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:56.918467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:56.919647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:56.920949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:56.921779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:56.923744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.332372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:57.348237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-428c1bf7-8dfa-455a-b120-62f57918ccdb tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.450070 Aug 30 17:35:57.349816 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1314/2498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:56 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:57.354404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:57.354995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:57.372876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.373317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.373756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.374544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.374947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.375386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.494735 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-506a8cc7-77fc-42a4-92ed-8864f459c10c tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 18061 microversion: 2.1 time: 2.007872 Aug 30 17:35:57.507938 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1185/2499] 10.222.0.50 () {58 vars in 1171 bytes} [Tue Aug 30 17:35:55 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 18061 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:35:57.548750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:57.564816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'deleted': False, 'project_id': '297aa64154d244cabd9ddd3920891b07'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:57.570056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.571313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.572520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.573425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.574021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.574579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.638309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27ed7ba5-d45a-4bd7-a026-e1f5aa9d6e6a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?tenant_id=6e41fbe5fc754f1886dcd6a270efe36f" status: 200 len: 15 microversion: 2.1 time: 0.093107 Aug 30 17:35:57.638894 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1186/2500] 10.222.0.50 () {58 vars in 1231 bytes} [Tue Aug 30 17:35:57 2022] GET /compute/v2.1/servers/detail?tenant_id=6e41fbe5fc754f1886dcd6a270efe36f => generated 15 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 17:35:57.663394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:57.674769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'tenant_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'deleted': False} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:57.688161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.688646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.689091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.696473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.697398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.701269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.778964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:57.855663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:57.856684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:57.857280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:57.948651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:57.962706 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62ae6ff0-3038-4a22-8bbb-04fe37c727d4 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.611803 Aug 30 17:35:57.963914 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1315/2501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:57 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:57.981989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:57.982864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:57.999755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.000439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.001045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.001960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.002596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.003188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.297501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d5ddcd0-6be1-4ba8-ae15-6c2d85f2bf67 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e41fbe5fc754f1886dcd6a270efe36f" status: 200 len: 4830 microversion: 2.1 time: 0.638740 Aug 30 17:35:58.298359 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1187/2502] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:35:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e41fbe5fc754f1886dcd6a270efe36f => generated 4830 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:58.325093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:58.331680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'tenant_id': '297aa64154d244cabd9ddd3920891b07', 'deleted': False} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:58.345281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.346756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.349151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.350006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.350977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.353026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.418949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-826ee37b-4e82-429e-b163-279462a11644 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=297aa64154d244cabd9ddd3920891b07" status: 200 len: 15 microversion: 2.1 time: 0.097252 Aug 30 17:35:58.421593 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1188/2503] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:35:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=297aa64154d244cabd9ddd3920891b07 => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:58.433241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:58.434208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:58.447196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.447847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.461188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.463114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.466609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:58.472397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.478839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5060f3e-b6aa-4b4d-b233-538af2006652 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.513706 Aug 30 17:35:58.479767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.486228 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1316/2504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:57 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:58.514776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3884920-56f4-48b1-8dc7-0949bb71fb04 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:58.535581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3884920-56f4-48b1-8dc7-0949bb71fb04 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023702 Aug 30 17:35:58.538969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1317/2505] 10.222.0.50 () {58 vars in 1189 bytes} [Tue Aug 30 17:35:58 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:35:58.564216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:58.569159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:58.586835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.587630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.588228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.589386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.590021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.591285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.772042 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b32628c6-5f81-4110-8bb4-a39863345b2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 0 microversion: 2.1 time: 0.213741 Aug 30 17:35:58.779149 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1318/2506] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:35:58 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:35:58.790382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:58.801411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:58.804472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:58.817040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.818074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.819551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.820578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.821049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.821528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.852587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:35:58.892593 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5c2894f-2972-4a6c-b028-efb12d49c151 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.111923 Aug 30 17:35:58.896164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1319/2507] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 30 17:35:58 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:58.906631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:58.910047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:58.919582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.920741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.921518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:58.923037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:58.923970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:58.924601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.055526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-167cb4ae-d521-4241-9c34-b233e2c24e07 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 0 microversion: 2.1 time: 0.152902 Aug 30 17:35:59.056606 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1320/2508] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:35:58 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:59.060552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:59.063167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:59.064257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:59.070580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3723ae7-c940-46ed-af01-42ebab3fcaa3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.647841 Aug 30 17:35:59.072511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.073113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.073735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.074606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.075315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.076007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.077016 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1189/2509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:58 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:59.081634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:59.087985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:59.104380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.105590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.111027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.117169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.118746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.120037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.450224 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86bec024-1f57-4ba5-9db1-2ff65fd886ac tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1616 microversion: 2.1 time: 0.372005 Aug 30 17:35:59.450844 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1190/2510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:59 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1616 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:59.476750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:59.477369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:59.486937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.487428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.487922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.488639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.489093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.490248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.641660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:59.654470 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b064d605-dd3f-43a7-abc0-86edbd2f2d35 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.592091 Aug 30 17:35:59.655190 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1321/2511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:59 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:59.687856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:59.689587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:59.704614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.705112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.705559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.706272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.706729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.707154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.891270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aae9404d-0480-40ed-b21d-602a96a23ca8 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1616 microversion: 2.1 time: 0.417454 Aug 30 17:35:59.892603 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1191/2512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:59 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1616 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:59.913566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:59.921065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'host': 'n-h2-852771-11', 'deleted': False} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:35:59.927786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.928560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.929389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:59.930334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:59.930995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:59.931647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.120535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:00.259702 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ed98857-091d-408e-b4cc-466454bb9e2d tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=n-h2-852771-11&all_tenants=1" status: 200 len: 1992 microversion: 2.1 time: 0.349687 Aug 30 17:36:00.270008 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1192/2513] 10.222.0.50 () {58 vars in 1192 bytes} [Tue Aug 30 17:35:59 2022] GET /compute/v2.1/servers?host=n-h2-852771-11&all_tenants=1 => generated 1992 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:00.283370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:00.285211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:00.301636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.302832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.303383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.304222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.306444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.307580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.363185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:00.634501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:00.649955 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f542f298-2b87-4963-ae3d-7911f6ed9c48 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.979412 Aug 30 17:36:00.658125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1322/2514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:59 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:00.671619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:00.685314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:00.703398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.706785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.707229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.709451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.710488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.710931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.805086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:00.817337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c9e8b97-03b5-46bb-b6a7-795bd469e67e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.542720 Aug 30 17:36:00.836106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1193/2515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:00 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:00.841043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:00.844782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:00.861642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.866163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.866612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.867368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.867849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.868272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.950026 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67343344-6945-4371-bb83-3b43c39e7edc tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.287951 Aug 30 17:36:00.957586 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1323/2516] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Aug 30 17:36:00 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:36:00.965171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:00.967403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:00.988602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.989934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.990588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:00.991554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:00.993472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:00.995539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.130561 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1904ae6-593b-478b-9773-c6f9bfdfada7 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 0 microversion: 2.1 time: 0.169821 Aug 30 17:36:01.136676 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1324/2517] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:00 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:01.143231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:01.147405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:01.154710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.155659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.157279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.158111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.159387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.159936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.218160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:01.307196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:01.338862 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83bb275c-9399-4247-bdff-57dc7c413a58 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.501487 Aug 30 17:36:01.345373 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1194/2518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:00 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:01.352536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:01.353172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:01.353815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:01.354395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:01.355208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:01.501558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:01.519063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.521647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.522297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.522994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.525577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.526035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.596831 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ef90e55-0a03-4516-ac39-936231c98cd2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 1067 microversion: 2.1 time: 0.458764 Aug 30 17:36:01.597850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1325/2519] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:01 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 1067 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 17:36:01.615146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:01.616263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:01.623138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.624131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.624704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.625562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.626160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.626716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.678457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:01.679519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:01.688443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.691118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.693633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:01.694565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:01.695712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:01.697306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:02.396957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:02.408121 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-540cb5ed-4dfd-4c75-94ec-a92d84675a2b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.737186 Aug 30 17:36:02.413370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1326/2520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:01 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:02.418258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:02.419053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:02.464524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:02.465388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:02.465989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:02.466852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:02.467558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:02.468133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:02.878900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:02.915667 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6623b751-18cd-4a17-84d6-d5739c72cada tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.499286 Aug 30 17:36:02.924692 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1327/2521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:02 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:02.935927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:02.938876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:02.960291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:02.961107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:02.963598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:02.965456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:02.967825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:02.969662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.195434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:03.212445 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1a0c53a-66cf-4913-8b79-ad3a91735cd3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 1.601013 Aug 30 17:36:03.214100 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1195/2522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:01 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:03.239908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadfba85-9201-49d2-bae1-95de8c5e6008", "name": "network-vif-plugged", "status": "completed", "tag": "ad697af6-de75-484d-8613-b3f1e4e82e6c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:03.296347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:03.329457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:03.332187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.408293 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] Creating event network-vif-plugged:ad697af6-de75-484d-8613-b3f1e4e82e6c for instance eadfba85-9201-49d2-bae1-95de8c5e6008 on n-h1-852771-11 Aug 30 17:36:03.424563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-82ab23a6-3486-4b60-8bd3-f51f90caa58f req-da97b1c2-4e1a-49ee-ba36-895b6e03ebd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208479 Aug 30 17:36:03.437045 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1196/2523] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:03.453034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:03.454076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:03.462309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:03.470064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:03.471134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.472282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:03.473392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:03.474400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.546179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:03.569825 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d000b108-f611-4524-bef5-2af476834a52 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.634421 Aug 30 17:36:03.570773 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1328/2524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:02 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:03.949871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:03.950503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:03.960274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:03.960772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:03.961215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.961940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:03.962402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:03.962836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:03.995171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:04.011385 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ef716e5e-1eb9-4520-84aa-d65b6503d0fa tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.572290 Aug 30 17:36:04.013404 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1197/2525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:03 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:04.248767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:04.250804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:04.285086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:04.293140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:04.293947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:04.295144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:04.295933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:04.303447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:04.565855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:04.584079 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba0c707c-1508-47a7-82e8-a8c03ce5e00b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.637408 Aug 30 17:36:04.584695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1329/2526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:03 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:04.647914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:04.662670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99481810-bf59-40b1-9cf0-fa75622b1ce7 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.420883 Aug 30 17:36:04.663663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1198/2527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:04 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:04.681136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:04.681752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:04.687927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:04.688412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:04.688848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:04.689552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:04.690004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:04.700011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:04.877466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1118533065", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "740d6dc9-7e20-470b-bd96-f9b1fde30066"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:05.034436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] validate_networks() for [('740d6dc9-7e20-470b-bd96-f9b1fde30066', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:36:05.127141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:05.137949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a5d8881-7db9-4ad3-9b35-072af0542b00 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1313 microversion: 2.1 time: 0.473226 Aug 30 17:36:05.140259 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1199/2528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:04 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:05.170176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:05.174376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:05.189036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:05.190652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:05.191466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:05.193972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:05.195194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:05.196688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:05.656480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:05.688784 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ac0cd49-fbe9-44d8-ad3d-5858029d35c0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.525552 Aug 30 17:36:05.691927 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1200/2529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:05 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:05.717366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:05.720077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:05.748289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:05.750657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:05.751590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:05.754276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:05.758772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:05.761934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.168358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:06.180336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-467f4a55-b38b-45c5-b409-dd638c469b0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.486066 Aug 30 17:36:06.181588 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1201/2530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:05 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:06.201510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:06.202338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:06.214054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.219317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.220329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.221410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.221872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.222298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.553760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:06.561605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:06.562130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:06.562496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:06.563461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:06.563889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:06.586270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a64a0491-7f0e-4f93-9682-d1d41a6efa57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.399000 Aug 30 17:36:06.587869 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1202/2531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:06 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:06.590326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.591037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.596403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.597618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.598269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.598984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.605278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:06.606209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:06.625592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.626273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.627139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.628235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.629806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.630788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.673284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Getting quotas for project cceaf428e4724b4891c13ffd0ae7694e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:06.690429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Getting quotas for user 760c313411ef4103acd837230270e84b and project cceaf428e4724b4891c13ffd0ae7694e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:06.725328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:06.731539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:06.840571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e13c240-e6a9-4b66-974a-9c0033d901b0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254758 Aug 30 17:36:06.845433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1330/2532] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:36:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:36:06.855867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:06.856499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:06.870460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.874097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.875169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:06.878558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:06.879127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:06.880129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.224788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:07.234339 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf3ca26e-75c0-4559-b4d0-4904364898da tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1498 microversion: 2.1 time: 0.644390 Aug 30 17:36:07.248844 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1203/2533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:06 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1498 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:07.261385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-895d742a-75ac-4569-a2ad-0794afdea8f4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.262322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-895d742a-75ac-4569-a2ad-0794afdea8f4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:07.362594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-895d742a-75ac-4569-a2ad-0794afdea8f4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:07.377073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=53 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:07.382328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-895d742a-75ac-4569-a2ad-0794afdea8f4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1216 microversion: 2.1 time: 0.127349 Aug 30 17:36:07.384164 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1204/2534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:07 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:07.391047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.392892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:07.393256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:07.403216 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-baba08f4-2160-4fd6-ab25-438b6a83c0ff tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.556691 Aug 30 17:36:07.407936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.408653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.409249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.410701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.413889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.414857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.416497 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1331/2535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:06 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:07.427842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.469836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_groups [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Querying cell d64e249a-e872-487f-b759-da855b1e5621(cell1) for 1 instances {{(pid=122124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 17:36:07.472796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.473441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.474729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.525443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7c4073f-7228-46b4-bdb1-b12f52213272 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006" status: 200 len: 222 microversion: 2.1 time: 0.107733 Aug 30 17:36:07.527838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1332/2536] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:36:07 2022] GET /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006 => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:07.539493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.544335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:07.558782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.559863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.560638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.561693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.572256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.573058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.627792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:07.792990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:07.819463 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0499c3d2-2dfd-4f23-b9bd-21bbd3f686b3 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.431334 Aug 30 17:36:07.820817 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1205/2537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:07 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:07.821500 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86d63b62-f5a7-41a0-93b4-ac98564fa709 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 204 len: 0 microversion: 2.1 time: 0.286476 Aug 30 17:36:07.824885 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1333/2538] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:07 2022] DELETE /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:36:07.834808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.839583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:07.853099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:07.855098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:07.856734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.857226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.859426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.860479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.861128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.864373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.870452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.871317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.873066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:07.874824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:07.877066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:07.881841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.189636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:08.215702 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08cbe23d-867f-4075-a992-8678dab799ba tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1504 microversion: 2.1 time: 0.372084 Aug 30 17:36:08.216932 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1206/2539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:07 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:08.404997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:08.406244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:08.422554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.423285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.423911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.424774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.426405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.432910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.435560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:08.444715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-754f26c3-c252-49c5-8b71-8c9bc00b61b3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.618398 Aug 30 17:36:08.457137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1334/2540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:07 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:08.463011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:08.463687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:08.484478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.485513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.486152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.487038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.487705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.488597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.564019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:08.578808 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c965302-d303-4cb8-8991-06a2ef76bfd0 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1220 microversion: 2.1 time: 0.177952 Aug 30 17:36:08.582963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1207/2541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:08 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:36:08.855123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:08.856476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:08.869704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.870447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.876791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:08.879289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:08.880670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:08.881315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.064315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:09.091899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5771ed6-938d-4a0c-af1e-82f3a9061b0a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.633497 Aug 30 17:36:09.106728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1335/2542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:08 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:09.163335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:09.185395 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ff200b9-363c-4a21-aaf3-f3ab0ac68426 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.346190 Aug 30 17:36:09.186010 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1208/2543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:08 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:09.252259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:09.253353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:09.276624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.277141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.277583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.278372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.291689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.292255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.470672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:09.471337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:09.484174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.485023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.486029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.488357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.489307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.492749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.931470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:09.942025 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ae526f1-1f77-482a-9526-cb3a249d7e56 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.475301 Aug 30 17:36:09.943010 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1209/2544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:09 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:09.951880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:09.955590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:09.975691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:09.977746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.978531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.979211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:09.980130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:09.980865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:09.981503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:10.163056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:10.189094 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dda645b9-55b8-47e1-8275-105c73100850 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1504 microversion: 2.1 time: 0.945867 Aug 30 17:36:10.189755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1336/2545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:09 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1504 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:10.203254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:10.203951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:10.204888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:10.229186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:10.229760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:10.229886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12cb915f-6434-4a52-82b0-8a05e5d84582 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1268 microversion: 2.1 time: 0.284420 Aug 30 17:36:10.230208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:10.230421 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1210/2546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:09 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1268 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:10.235578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:10.236071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:10.236510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:10.253742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:10.254376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:10.278451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:10.279107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:10.279824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:10.285720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:10.290907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:10.293576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:10.776155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:10.788720 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-64eed65d-876c-49d7-b0b4-601469f3ebf2 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.597800 Aug 30 17:36:10.789689 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1337/2547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:10 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:11.195074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2046101027", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e431bf68-ed0c-4198-9d04-b41e8fc8143d"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:11.363252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] validate_networks() for [('e431bf68-ed0c-4198-9d04-b41e8fc8143d', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:36:11.737768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:11.745941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:11.759396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b74b0ef3-0e54-45ea-984e-66435266711a tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 1.521951 Aug 30 17:36:11.792324 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1211/2548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:10 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:11.797670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:11.802556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:11.822833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:11.825610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:11.826429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:11.830558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:11.831633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:11.832333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.181387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:12.189980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e55b76bc-6ad8-4100-b875-4180480bc66e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.396111 Aug 30 17:36:12.195961 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1212/2549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:11 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:12.215187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:12.216378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:12.224241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.228664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.229347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.230270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.237014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.238072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.372714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.373384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.373974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.374530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lazy-loading 'fault' on Instance uuid eadfba85-9201-49d2-bae1-95de8c5e6008 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:12.494507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1bfa0924b444f2878a0155d48e8dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6340b69db46449c69d7eb2012f15e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:12.503326 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d5420a7-3da8-471b-aabf-9aabcd4df78d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 200 len: 1303 microversion: 2.1 time: 0.304613 Aug 30 17:36:12.507104 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1213/2550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:12 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:12.530089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:12.533257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:12.559667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.560318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.560861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.561679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.563963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.573125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.901484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:12.902063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:12.902596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:12.903001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:12.903629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:12.924004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.927627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.928091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.928944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:12.929408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:12.929833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:12.948075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=19 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:12.962615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Getting quotas for project 9e8c0a90bd0548198ab6e6753452dfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:12.977625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Getting quotas for user 19a44501d50245f386bc8ed3d041a750 and project 9e8c0a90bd0548198ab6e6753452dfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:12.995134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:12.997684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:13.076050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:13.097203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ed8ba59-4920-4d6d-9d39-86af393c3f23 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.585814 Aug 30 17:36:13.099045 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1214/2551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:12 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:13.201278 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80249895-9bd7-4e6c-839d-682320e58df6 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.409778 Aug 30 17:36:13.204616 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1338/2552] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:36:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:36:13.218814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:13.220002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:13.245682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:13.255611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:13.255916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:13.258964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:13.260508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:13.261331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:13.323295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadfba85-9201-49d2-bae1-95de8c5e6008", "name": "network-vif-deleted", "tag": "ad697af6-de75-484d-8613-b3f1e4e82e6c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:13.352119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:13.352605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:13.353030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:13.392815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] Creating event network-vif-deleted:ad697af6-de75-484d-8613-b3f1e4e82e6c for instance eadfba85-9201-49d2-bae1-95de8c5e6008 on n-h1-852771-11 Aug 30 17:36:13.402170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5657f965-71d2-4588-8d42-ba9618cdab22 req-2e81ba21-d320-4328-95bd-b47ead85df24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301683 Aug 30 17:36:13.408419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1215/2553] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:13.427595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:13.428567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:13.438399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:13.439064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:13.439848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:13.441450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:13.443032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:13.443679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:13.788574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:13.802369 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7b8fd30-16a1-4c5e-961a-affc25c1cee5 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.593449 Aug 30 17:36:13.805882 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1339/2554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:13 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:13.831432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0dd0332e-2cb1-4889-a06b-2aa5537601cb tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:13.833705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0dd0332e-2cb1-4889-a06b-2aa5537601cb tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:13.867982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:13.988656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:13.991360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0dd0332e-2cb1-4889-a06b-2aa5537601cb tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:14.004162 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0dd0332e-2cb1-4889-a06b-2aa5537601cb tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1216 microversion: 2.1 time: 0.196941 Aug 30 17:36:14.008196 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1340/2555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:13 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:14.015564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.016962 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95496e44-ce67-428d-a512-06b6807419bc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.604965 Aug 30 17:36:14.017878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.018533 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1216/2556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:13 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:14.035560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.036700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.041163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.041931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.042557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.044459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.045074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.045648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.047741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.053542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.057137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.058173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.058856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.059559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.074053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:14.100170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 HTTP/1.1 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'eadfba85-9201-49d2-bae1-95de8c5e6008'} Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.104871 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.109495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.113038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:14.116947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9dfee5dc-1d0a-4ec8-ba3b-abc8dab3d301 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 404 len: 111 microversion: 2.1 time: 0.094242 Aug 30 17:36:14.119516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1217/2557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:14.138520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.140282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.155256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.157957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.158666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.160777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.162729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.163423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.372227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:14.391236 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3e01526-ff57-410b-9100-71237fbc7601 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1471 microversion: 2.1 time: 0.381568 Aug 30 17:36:14.392558 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1341/2558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:14.399444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.445210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_groups [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Querying cell d64e249a-e872-487f-b759-da855b1e5621(cell1) for 1 instances {{(pid=122124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 17:36:14.448182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.448695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.449139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.476964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fa489eb-fd0e-4e37-a3f1-86422eed0e33 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.082171 Aug 30 17:36:14.479333 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1342/2559] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:14.505409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.538429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:14.549866 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6eb29722-358d-4d53-b7d8-115edabc2e1d tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.428795 Aug 30 17:36:14.553512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1218/2560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:14.558474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_groups [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Querying cell d64e249a-e872-487f-b759-da855b1e5621(cell1) for 1 instances {{(pid=122124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 17:36:14.561577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.580799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.582856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.622568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9f7f0ca-8336-43c5-8d4e-706c56e99501 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006" status: 200 len: 184 microversion: 2.1 time: 0.133585 Aug 30 17:36:14.636092 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1343/2561] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006 => generated 184 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:14.642331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.642824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.661064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.661953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.662624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.663618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.666272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.666896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.702089 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 HTTP/1.1 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'eadfba85-9201-49d2-bae1-95de8c5e6008'} Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:14.706772 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.711389 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.721874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:14.723008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7b0aa9d3-6ef8-4060-ba9e-f36024cdc09d tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 404 len: 111 microversion: 2.1 time: 0.085547 Aug 30 17:36:14.723803 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1219/2562] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:14 2022] DELETE /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:14.732809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.733859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] [instance: eadfba85-9201-49d2-bae1-95de8c5e6008] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.751722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.754365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.755557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.764731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.770197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.771538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.818148 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 HTTP/1.1 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'eadfba85-9201-49d2-bae1-95de8c5e6008'} Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.824272 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. Aug 30 17:36:14.828362 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.832350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance eadfba85-9201-49d2-bae1-95de8c5e6008 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:14.835024 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39c8b337-4446-4f17-af2d-3a45a9cd9a48 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008" status: 404 len: 111 microversion: 2.1 time: 0.106373 Aug 30 17:36:14.835349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.836094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:14.842457 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1344/2563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/servers/eadfba85-9201-49d2-bae1-95de8c5e6008 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:14.852822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.854951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.856936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.860541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:14.862087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9efe0b20-823a-4c23-9471-76e80a0a089e tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.866139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:14.868786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:14.896555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9efe0b20-823a-4c23-9471-76e80a0a089e tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9efe0b20-823a-4c23-9471-76e80a0a089e tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-server-groups/a198fc28-1e58-4cb5-99a0-bfb360f750cd HTTP/1.1 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a198fc28-1e58-4cb5-99a0-bfb360f750cd'} Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.900433 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. Aug 30 17:36:14.906622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.908723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9efe0b20-823a-4c23-9471-76e80a0a089e tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance group a198fc28-1e58-4cb5-99a0-bfb360f750cd could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:14.911674 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9efe0b20-823a-4c23-9471-76e80a0a089e tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a198fc28-1e58-4cb5-99a0-bfb360f750cd" status: 404 len: 117 microversion: 2.1 time: 0.066766 Aug 30 17:36:14.914163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1345/2564] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:36:14 2022] DELETE /compute/v2.1/os-server-groups/a198fc28-1e58-4cb5-99a0-bfb360f750cd => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:14.944116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6efa426a-1f21-4730-b214-5fcd250140ec tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:14.986687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-6efa426a-1f21-4730-b214-5fcd250140ec tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6efa426a-1f21-4730-b214-5fcd250140ec tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-server-groups/ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 HTTP/1.1 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'ce4d4e00-0b65-4a7c-954e-afc42a41d3d2'} Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:14.998904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. Aug 30 17:36:15.004436 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.010589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6efa426a-1f21-4730-b214-5fcd250140ec tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance group ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:15.012902 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6efa426a-1f21-4730-b214-5fcd250140ec tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/ce4d4e00-0b65-4a7c-954e-afc42a41d3d2" status: 404 len: 117 microversion: 2.1 time: 0.093192 Aug 30 17:36:15.016154 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1346/2565] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:36:14 2022] DELETE /compute/v2.1/os-server-groups/ce4d4e00-0b65-4a7c-954e-afc42a41d3d2 => generated 117 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:15.034601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b030a7fa-6758-4383-920a-fa34247663e7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.069072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b030a7fa-6758-4383-920a-fa34247663e7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b030a7fa-6758-4383-920a-fa34247663e7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-server-groups/9333897d-362a-41c4-82dd-46ae5bc2549b HTTP/1.1 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9333897d-362a-41c4-82dd-46ae5bc2549b'} Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.075789 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. Aug 30 17:36:15.080291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.084163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b030a7fa-6758-4383-920a-fa34247663e7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance group 9333897d-362a-41c4-82dd-46ae5bc2549b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:15.088589 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b030a7fa-6758-4383-920a-fa34247663e7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/9333897d-362a-41c4-82dd-46ae5bc2549b" status: 404 len: 117 microversion: 2.1 time: 0.061511 Aug 30 17:36:15.091017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1347/2566] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:36:15 2022] DELETE /compute/v2.1/os-server-groups/9333897d-362a-41c4-82dd-46ae5bc2549b => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:15.104199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.106128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:15.123020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.124218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.124939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.126093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.126690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.127246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.394234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:15.409414 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dbc8132f-a86b-494c-8d83-df737d2ec835 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1268 microversion: 2.1 time: 0.315716 Aug 30 17:36:15.413082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1348/2567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:15 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1268 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:15.419004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.422886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:15.424571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:15.433719 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b69d8e6-049c-4e3d-852c-51f3cfc34002 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.610945 Aug 30 17:36:15.437976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1220/2568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:14 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:15.443527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.448763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e95cc84c-2502-4a5a-a4d9-65fa2d51bbb7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.454494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.454947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.459416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.462766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.464389 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e95cc84c-2502-4a5a-a4d9-65fa2d51bbb7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] HTTP exception thrown: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e95cc84c-2502-4a5a-a4d9-65fa2d51bbb7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Request method failure captured: Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-server-groups/2f04c4e0-64a5-4ca5-b723-853188857393 HTTP/1.1 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkpgHAR3ZZCnSIti7SRoCntiUmqaHrC1Zg8RBSNUfwGFeFItqD4Jy37akFDReHphiVUtqB7da73rNhw5mKks4pZ-2sCDCrNWzQvRzg94uSE0uRpHd3kA9TzTySztSyl5lk_qTzaAJD3TmlWAP-F-OLaCWqP2LJOPSdgVVfuj7S3xNOs Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6340b69db46449c69d7eb2012f15e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6340b69db46449c69d7eb2012f15e7ee"}]}] Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6340b69db46449c69d7eb2012f15e7ee Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756817900 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: bf1bfa0924b444f2878a0155d48e8dc8 Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerGroupTestJSON-1756817900-project Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2f04c4e0-64a5-4ca5-b723-853188857393'} Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.468009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. Aug 30 17:36:15.471592 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:15.471945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.476427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e95cc84c-2502-4a5a-a4d9-65fa2d51bbb7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Returning 404 to user: Instance group 2f04c4e0-64a5-4ca5-b723-853188857393 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:15.477480 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e95cc84c-2502-4a5a-a4d9-65fa2d51bbb7 tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/2f04c4e0-64a5-4ca5-b723-853188857393" status: 404 len: 117 microversion: 2.1 time: 0.038320 Aug 30 17:36:15.478207 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1221/2569] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:36:15 2022] DELETE /compute/v2.1/os-server-groups/2f04c4e0-64a5-4ca5-b723-853188857393 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:15.493123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.508310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:15.531766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.532536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.534819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.540262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.541137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.541768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:15.838452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:15.853179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8767dd4a-18cc-4c85-928e-768f261ea4be tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1521 microversion: 2.1 time: 0.434150 Aug 30 17:36:15.855868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1349/2570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:15 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:15.872206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-746d3e76-284f-4343-809c-f98418d33a1c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:15.926124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-746d3e76-284f-4343-809c-f98418d33a1c tempest-ServerGroupTestJSON-1756817900 tempest-ServerGroupTestJSON-1756817900-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006" status: 204 len: 0 microversion: 2.1 time: 0.069095 Aug 30 17:36:15.927011 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1350/2571] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:36:15 2022] DELETE /compute/v2.1/os-server-groups/76109f16-791b-476a-999f-8e40a967c006 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:15.934878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c", "tag": "3ab2a23c-af13-4818-9d44-90c3e0e7773b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:15.963830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:15.964438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:15.964898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.012047 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] Creating event network-changed:3ab2a23c-af13-4818-9d44-90c3e0e7773b for instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c on n-h1-852771-11 Aug 30 17:36:16.022795 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1e82064a-0358-4dfc-a70e-35cbc0006f91 req-a7d3bf5a-96b2-4794-a0e7-41011136918a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094124 Aug 30 17:36:16.023427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1351/2572] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:16.041808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:16.042524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:16.057571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.058078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.058523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.059253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.059740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.060174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.652686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:16.666797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-925a56f8-48c3-4d44-af3d-dcb9f00fa4eb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.624426 Aug 30 17:36:16.668046 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1352/2573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:16 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:16.682581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:16.683427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:16.698056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.698804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.699430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.700357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.700972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.701561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.836921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:16.852095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-512503d2-d1c7-4716-8ea5-891c5e9b0718 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1274 microversion: 2.1 time: 0.182060 Aug 30 17:36:16.863967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1353/2574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:16 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:16.872887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:16.873749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:16.881976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.882707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.883335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.884241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.884855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.885442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.893071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:16.901928 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98efc3a5-95d3-4b2d-9a01-7a4ba0fcc83f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1477 microversion: 2.1 time: 1.421921 Aug 30 17:36:16.909645 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1222/2575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:15 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1477 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:16.915061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:16.917890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:16.933416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.936905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.937359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:16.938090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:16.942038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:16.943057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:17.272321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:17.294925 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c621ffa8-10af-4357-8b70-8033e15224d0 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.428637 Aug 30 17:36:17.295723 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1354/2576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:16 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:17.310610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-4371975", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "217d0c94-8215-478d-a8e4-3bc0b700061c"}], "block_device_mapping_v2": [{"uuid": "21391eb5-044a-40f4-a592-42e7469173a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:17.392461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] validate_networks() for [('217d0c94-8215-478d-a8e4-3bc0b700061c', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:36:17.407985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:17.430692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:17.449241 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-375d6fe9-a907-47b5-b91e-aec33ad4c425 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1498 microversion: 2.1 time: 0.538343 Aug 30 17:36:17.449838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1223/2577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:16 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1498 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:17.470032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:17.475386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:17.476473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:17.482668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:17.483347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:17.484373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:17.485284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:17.486126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:17.487378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:17.612246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:17.703809 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5bbc8486-6930-460a-8fb4-5bd6d667ce7f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.237441 Aug 30 17:36:17.711519 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1224/2578] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 30 17:36:17 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:36:17.718889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:17.720399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:17.729535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:17.731789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:17.732729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:17.734413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:17.735875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:17.736749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.141401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:18.152711 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9b83266-2d46-4388-acd8-59068fc247e1 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.446903 Aug 30 17:36:18.153313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1225/2579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:17 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:18.158938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:18.177460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.177917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.178354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.210891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:18.211740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:18.212562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:18.213350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:18.214104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:18.238885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.239368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:36:18.239620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.240127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.241134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.241786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.242437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.264330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:18.272306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Getting quotas for user 859d8e930c434d519e4208e58246b471 and project 36850e3f45ae4558a78f5f78dd09c806. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:18.323021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab6f6269-9120-4621-ab9e-a09e053f7846 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "POST /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4/action" status: 202 len: 0 microversion: 2.1 time: 0.167861 Aug 30 17:36:18.327226 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1226/2580] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:18 2022] POST /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:18.332095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:18.335085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:18.361351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:18.364308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21391eb5-044a-40f4-a592-42e7469173a6',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:18.378136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.383128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.384757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.386998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.390321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.392954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.654992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba94d96a-b36f-4ead-8b49-e7ec2766c321 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.348298 Aug 30 17:36:18.668664 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1355/2581] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 17:36:18.717449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:18.718270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:18.729807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.740120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.741681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:18.742549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:18.743121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:18.751069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.123746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:19.151189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a85363b9-8a8d-4e4b-80c7-2333550884e4 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.825144 Aug 30 17:36:19.163743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1227/2582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:18 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:19.163743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:19.163743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:19.174508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.175828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.176429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.178242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.179191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.179812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.577268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:19.591214 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0b07eeb-cdc3-4812-9599-02f34ff69cf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1477 microversion: 2.1 time: 0.921182 Aug 30 17:36:19.594909 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1356/2583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:18 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1477 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:19.607749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:19.608777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:19.621256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.623219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.623901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.633856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.635037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.635743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.725339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:19.738246 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-80e4478f-29c4-4ee6-9d77-1e0ce695299b tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 0.584686 Aug 30 17:36:19.741576 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1228/2584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:19 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:19.754437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:19.756407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:19.764923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.765790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.766444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:19.767398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:19.768103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:19.768740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.127634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.139537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.145228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:20.147361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea9b65fd-beff-4730-9bab-89e26c1095c2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1507 microversion: 2.1 time: 0.550889 Aug 30 17:36:20.161820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1357/2585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:19 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:20.174100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.178812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.180179 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89c752a5-9c3b-4a30-a9a3-6a4198d95d53 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1174 microversion: 2.25 time: 0.435551 Aug 30 17:36:20.181254 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1229/2586] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:19 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1174 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:20.186677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:20.187450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:20.200451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:20.204470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.206106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.207221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.210127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.213901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.214465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.266999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-unplugged", "status": "completed", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:20.299795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.302079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.302701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.322362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] Creating event network-vif-unplugged:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:36:20.328532 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c0610121-5cf1-483c-ba42-8678f0101777 req-80d5863b-cd2b-49fb-b8ca-6d118c1868c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165241 Aug 30 17:36:20.330296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1358/2587] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:20.339224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:20.340145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:20.348507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.349249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.349900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.350780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.351383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.352013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.618005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.635608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:20.640283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72a89da7-87a2-4d92-adbb-d0422b102b96 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.297274 Aug 30 17:36:20.662928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1359/2588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:20 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:20.663148 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71cf324e-a975-4bae-84d8-de5ae87a96b7 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.475412 Aug 30 17:36:20.669029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1230/2589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:20 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:20.670535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:20.671505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:20.683746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.686046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.686537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.687281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.687780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.688208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.762209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:20.762918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:20.778177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.780120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.781334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:20.782207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:20.782836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:20.783367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:21.141059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:21.155254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa5c0a6b-80fa-4821-9ad4-e77eb09a53e6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1477 microversion: 2.1 time: 0.502447 Aug 30 17:36:21.169958 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1360/2590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:20 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:21.175592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2350ef-18f4-4c0e-95d2-5432b4ab2de3", "tag": "8a8923fd-ef35-4578-9a6d-3a78746cf8d3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:21.225391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:21.229819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:21.238222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:21.275526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] Creating event network-changed:8a8923fd-ef35-4578-9a6d-3a78746cf8d3 for instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 on n-h1-852771-11 Aug 30 17:36:21.287311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2fc42b4d-b4e8-4dcf-b285-6384b88ef60e req-8fa4424a-92e5-4001-91ca-bb1761008231 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115330 Aug 30 17:36:21.296434 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1361/2591] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:21.303751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:21.307695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:21.324627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:21.325357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:21.325939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:21.326820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:21.327420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:21.328033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.047828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.059644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37aef823-d383-4ba9-b7fb-6deefb20b58d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1507 microversion: 2.1 time: 0.761563 Aug 30 17:36:22.062984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1362/2592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:21 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1507 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:22.070544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:22.073524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:22.091280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.092315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.092755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.093469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.093920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.094337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.253921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.272054 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d50182c-e8df-4ae6-bf95-23137a01f31f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1523 microversion: 2.1 time: 1.513798 Aug 30 17:36:22.303740 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1231/2593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:20 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1523 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:22.310315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:22.312278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:22.319612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.320390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.320984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.321878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.325292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.325972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.523922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.535050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.537534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.539495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bdf651da-ef3a-4d6d-ad15-3fef23bbff09 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1290 microversion: 2.25 time: 0.474379 Aug 30 17:36:22.540252 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1363/2594] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:22 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1290 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:22.552523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:22.554636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:22.570710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.571216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.571754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.573115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.573701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.574131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.770120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:22.790970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5106b31-d13c-4e7e-b12b-7b958775fe99 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.484943 Aug 30 17:36:22.791867 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1232/2595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:22 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:22.799610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:22.803650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:22.815631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.816410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.817875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:22.818797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:22.819394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:22.820034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.013379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.022773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80741c82-bd15-4fe7-9c33-559fe0def6d3 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.480688 Aug 30 17:36:23.027428 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1364/2596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:22 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:23.036768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-plugged", "status": "completed", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:23.066654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.067831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.073486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.114828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] Creating event network-vif-plugged:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:36:23.126799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e623c23e-8e23-4444-a599-381714d9e6a0 req-22f088ee-e1ed-43ba-ae95-b812332a6bfd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097671 Aug 30 17:36:23.128204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1365/2597] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:23.135656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:23.136669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:23.150827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.152757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.153372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.156545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.157182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.157784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.377015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.400585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4afe4061-e65e-4eb9-8271-8486300b378b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1477 microversion: 2.1 time: 0.606420 Aug 30 17:36:23.402686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1233/2598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:22 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:23.413080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:23.415161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:23.436766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.438594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.439904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.440925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.441616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.444134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.480837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.490082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-baa83729-ac65-4ead-a3a0-a3b39a8068f7 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1507 microversion: 2.1 time: 0.359392 Aug 30 17:36:23.494184 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1366/2599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:23 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:23.578213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cafd98f-7d60-455b-9d0b-406e7d81bf8f", "tag": "0020fda5-9556-48f0-bc6b-3f28866810a1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:23.590512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.591515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.592203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.606488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:23.610076 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] Creating event network-changed:0020fda5-9556-48f0-bc6b-3f28866810a1 for instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f on n-h2-852771-11 Aug 30 17:36:23.617761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9a15615a-7393-4be4-8f0b-9b6dfb91c46a req-257e39fd-6337-47a6-8d6b-44b2b5dddeb8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121935 Aug 30 17:36:23.619170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1367/2600] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:23.629721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:23.630869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:23.639133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.639746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.640395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.641453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.642730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.643406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.891036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.905242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.910264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.912458 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24a71ea9-a992-44bc-a976-8dc8c611c301 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1290 microversion: 2.25 time: 0.287787 Aug 30 17:36:23.913216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1368/2601] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:23 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1290 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:23.920702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:23.922711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:23.923920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:23.935803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.936995 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6ebda6b-cd82-4a4d-b706-62c14174ff4a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1503 microversion: 2.1 time: 0.531327 Aug 30 17:36:23.938006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.939041 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1234/2602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:23 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1503 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:23.939867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.940780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:23.941428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:23.942056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:23.960478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1337bcca-30d9-4afd-9d68-59205195e65e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'create', calling method: .version_select at 0x7f2d9cdc2790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1826210669", "description": "tempest-description-814780356"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:24.208870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:24.224906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1dcd7393-169b-449e-929f-a06d358f1c0b tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.310352 Aug 30 17:36:24.225706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1369/2603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:23 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:24.321114 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1337bcca-30d9-4afd-9d68-59205195e65e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.365233 Aug 30 17:36:24.321837 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1235/2604] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 30 17:36:23 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:36:24.335965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:24.336178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e67be2a5-70eb-4e27-91e6-34f1c059c638 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Action: 'create', calling method: .version_select at 0x7f2d93f75670>, body: {"keypair": {"name": "tempest-keypair-1252654289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUrcg5vy+e/JRjrfq2VWIu0lAPd4Eu5khX+YTkC0uv/HG5OJTQtLVv58wo78kajv689xCZuMC2xIyn/+KhpKdehEfxUCLaJskAQLxwqwOlY5Ew/YQiM5YdZL82Pg+QARA=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:24.337213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:24.362042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.362542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.362982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:24.363722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.364733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.368042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e67be2a5-70eb-4e27-91e6-34f1c059c638 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for project 84ac52a6449e40999f9d74f115069bbb. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:24.370165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:24.380355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e67be2a5-70eb-4e27-91e6-34f1c059c638 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for user 8a8a9adbb5a849dbbdd4c81ef2e42f7e and project 84ac52a6449e40999f9d74f115069bbb. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:24.433567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e67be2a5-70eb-4e27-91e6-34f1c059c638 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205550 Aug 30 17:36:24.436748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1370/2605] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:36:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:24.446664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1826210669"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:24.447426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:24.461005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.462157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.463043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:24.464577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.465280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.466090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:24.796135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:24.812565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70ee4c9b-ebf3-43ad-95fd-d4648512089b tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.489328 Aug 30 17:36:24.816267 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1236/2606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:24 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:24.838036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:24.853388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:24.870792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.871725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.872605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:24.873721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:24.874461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:24.875123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:25.326170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Adding security group 8686aad8-c2d1-4237-a3d7-3276d579f8fe to port 59c3f779-04f6-4b47-919f-70f52b03ce61 Aug 30 17:36:25.402412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:25.423107 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b307dafb-d813-4f02-983b-e4aa9fb6b95f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1477 microversion: 2.1 time: 0.600261 Aug 30 17:36:25.424990 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1237/2607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:24 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:25.432925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:25.434594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:25.445335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:25.447289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:25.448502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:25.449895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:25.450848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:25.451695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:25.902380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:25.910289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a9a7a33-7371-446c-98c8-6684027c9c99 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1511 microversion: 2.1 time: 0.484039 Aug 30 17:36:25.929273 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1238/2608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:25 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:25.941451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:25.942209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:25.949354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:25.949846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:25.950285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:25.950997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:25.951512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:25.951955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:26.452128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be2762f7-860b-4a78-b184-47ee64676379 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action" status: 202 len: 0 microversion: 2.1 time: 2.011857 Aug 30 17:36:26.452757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1371/2609] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:24 2022] POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action => generated 0 bytes in 2015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:26.458741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c", "name": "network-vif-plugged", "status": "completed", "tag": "3ab2a23c-af13-4818-9d44-90c3e0e7773b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:26.481048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:26.481539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:26.481968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:26.512183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] Creating event network-vif-plugged:3ab2a23c-af13-4818-9d44-90c3e0e7773b for instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c on n-h1-852771-11 Aug 30 17:36:26.528033 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b4ec736f-736b-43b3-b2c9-6d5eff2b5719 req-654e6ced-9b31-450f-88c8-110c7662b38b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073723 Aug 30 17:36:26.529277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1372/2610] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:26.534942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:26.540704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:26.549771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:26.558227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:26.560742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:26.564120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:26.565045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:26.565674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:26.569634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.045428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.054405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-536a5d47-5f81-48f9-ae96-251753cc143e tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.523688 Aug 30 17:36:27.062648 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1373/2611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:26 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:27.077652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:27.085564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:27.102059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.102654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.103103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.105707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.106963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.109888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.313992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.330761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.332361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.338871 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-110295e2-d18f-4915-a5d1-556b1b840cff tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1290 microversion: 2.25 time: 1.407860 Aug 30 17:36:27.351506 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1239/2612] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:25 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1290 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:27.351506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:27.395700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.396344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.servers [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Removing options 'limit' from query {{(pid=122123) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 17:36:27.397290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:27.398492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.398978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.403792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.404845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.405337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.409192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.413153 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40eb9505-e5e9-4b90-a3b9-5cb1a74da9ac tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.068362 Aug 30 17:36:27.414655 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1240/2613] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 17:36:27 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:36:27.424205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:27.427322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:27.442674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.443249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.448760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.451961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.452918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.454502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.454748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46620b24-6df5-46b5-a024-76bc2d3069bb tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1316 microversion: 2.1 time: 0.388784 Aug 30 17:36:27.456038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.470084 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1374/2614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:27 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:27.488623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1826210669"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:27.490974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:27.508231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.508968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.509735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.510771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.511469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.513762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.537152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:27.712323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:27.734709 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fac19e4-5c7a-42a7-88d1-ceda9bb3975b tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1463 microversion: 2.1 time: 0.305393 Aug 30 17:36:27.736797 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1241/2615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:27 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1463 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:27.760468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:27.788422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.789437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.790123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.821785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] Creating event network-changed:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:36:27.834050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a4156403-378e-49c8-a824-eb7ff47d4c7f req-d3989e96-553e-424a-8356-654486065073 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094167 Aug 30 17:36:27.834963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1242/2616] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:27.840836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:27.843323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:27.865820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.866592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.867237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.868174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:27.868813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:27.869677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:27.873328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Removing security group 8686aad8-c2d1-4237-a3d7-3276d579f8fe from port 59c3f779-04f6-4b47-919f-70f52b03ce61 Aug 30 17:36:28.192934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:28.204864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be1fdc28-de88-496c-a957-10fe80527542 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1511 microversion: 2.1 time: 0.368348 Aug 30 17:36:28.206391 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1243/2617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:27 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:28.215408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:28.225600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:28.243268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.243820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.246878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.247433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.249334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.251338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:28.253339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.401762 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2dc05e2c-0ac0-4c2e-8f4b-ca045df6a22c tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action" status: 202 len: 0 microversion: 2.1 time: 0.929664 Aug 30 17:36:28.403870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1375/2618] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:27 2022] POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:28.413266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:28.414284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:28.430789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.432271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.433002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.438674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.444257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.444966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.689522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:28.701598 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a180aac-5b51-4a77-b6fb-51ab69ed0f54 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1463 microversion: 2.1 time: 0.493700 Aug 30 17:36:28.719198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1244/2619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:28 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1463 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:28.719198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:28.729536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:28.752150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.752638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.753168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.754022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.754481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.755710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.808015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:28.819778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d3f0ec7-67d6-482a-8d0d-64ea45f39e53 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.414486 Aug 30 17:36:28.825749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1376/2620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:28 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:28.835063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:28.844479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:28.869197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.869683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.871305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:28.872593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:28.873481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:28.882649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:29.153560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:29.169495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:29.173100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:29.178381 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8870a83d-2f07-4765-846c-8472f6d14771 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1290 microversion: 2.25 time: 0.351292 Aug 30 17:36:29.182203 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1377/2621] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:28 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1290 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:29.192305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e6af148-855b-4905-99dc-1226fe76413f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'create', calling method: .version_select at 0x7f2d9cd3b820>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:29.247542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:29.258746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-68c0268d-c769-4095-9f94-95273c942f9c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1511 microversion: 2.1 time: 0.551984 Aug 30 17:36:29.261505 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1245/2622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:28 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:29.274330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:29.275155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:29.288623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:29.291161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:29.294650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:29.295646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:29.296368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:29.297091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:29.775518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:29.786384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1c589d7e-c5d0-4ac8-be4a-2bffee732aac tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1505 microversion: 2.1 time: 0.523252 Aug 30 17:36:29.789633 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1246/2623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:29 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:29.813817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:29.818346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:29.826890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:29.827616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:29.828426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:29.829288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:29.829894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:29.831093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:29.937927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:29.938420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:29.939831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:29.940291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:29.940797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:29.991101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:30.006978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.016138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.016967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.017477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.018256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.018782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.019306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.046505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dfc7f96a-6026-4ae3-9cef-b6aec3534163 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 1067 microversion: 2.1 time: 0.240958 Aug 30 17:36:30.047804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1247/2624] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:29 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 1067 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 17:36:30.057471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:30.058304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.065622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.066239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.066746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.067608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.068127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.069025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.215462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:30.223933 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67335401-6bf5-476d-a8e9-9950221f9289 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1510 microversion: 2.1 time: 0.174322 Aug 30 17:36:30.224612 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1248/2625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:30 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:30.234576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2350ef-18f4-4c0e-95d2-5432b4ab2de3", "name": "network-vif-plugged", "status": "completed", "tag": "8a8923fd-ef35-4578-9a6d-3a78746cf8d3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:30.246832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.247434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.247956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.263358 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] Creating event network-vif-plugged:8a8923fd-ef35-4578-9a6d-3a78746cf8d3 for instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 on n-h1-852771-11 Aug 30 17:36:30.264151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3db61831-2456-493e-8586-bf3366ce3db6 req-c6d33ac0-e6df-42d2-a792-0d1746511c3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038328 Aug 30 17:36:30.264922 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1249/2626] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:30.273057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:30.280063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.287095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.287721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.288156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.289023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.289628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.290196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.363456 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a291aab-626a-4cfd-9f77-067ae79cb164 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.094780 Aug 30 17:36:30.364154 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1250/2627] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 30 17:36:30 2022] DELETE /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c/os-server-password => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:30.370659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:30.371269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.379093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.379799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.380623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.382183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.382901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.383467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.545522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:30.553395 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c149a85-212e-4bf4-a1e0-8cb9d47b3f55 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1316 microversion: 2.1 time: 0.187721 Aug 30 17:36:30.554031 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1251/2628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:30 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:30.696161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-393942186", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:30.765968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:30.766492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:30.767077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:30.767506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:30.767925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:30.777864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.779006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.779425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.780320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.780761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.781175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.799346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Getting quotas for project 639bc23579034376bd2c131c30d6f6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:30.804740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Getting quotas for user 858d6fad19f440b7a2e4c71540d44efc and project 639bc23579034376bd2c131c30d6f6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:30.817661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:30.819974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:30.867090 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98969e27-3149-4d99-a901-3adc0c23dc1a tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.311915 Aug 30 17:36:30.868030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1252/2629] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:36:30.872562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:30.884206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.884681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.885120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.898096 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] Creating event network-changed:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:36:30.903980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6ccf1684-c859-4021-b5da-b8f50834bc22 req-5ed6cca5-eae1-4fe6-b5cf-57e17e286393 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034888 Aug 30 17:36:30.905253 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1253/2630] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:30.910567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:30.911239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.915495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e6af148-855b-4905-99dc-1226fe76413f tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.730700 Aug 30 17:36:30.916198 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1378/2631] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:36:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:30.921080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:30.921759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:30.925707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.927783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.928266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.929622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.930132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.930583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.932157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.933001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.933648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:30.934556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:30.935227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:30.936012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.078633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.083671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.088309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.089756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.091259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40b22d7f-a8c3-4a33-b97d-d8a5c59eadb6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.184890 Aug 30 17:36:31.092039 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1254/2632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:30 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:31.102794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ab214b5c-b2e2-4491-b011-7fe8a7a90b22 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.173667 Aug 30 17:36:31.103545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1379/2633] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:30 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:31.106081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-92064926", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b0eef958-aece-43f2-8247-c8705fd55c46"}], "security_groups": [{"name": "tempest-securitygroup--348986984"}], "key_name": "tempest-keypair-1252654289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:31.109449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:31.115291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.116625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:31.226145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] validate_networks() for [('b0eef958-aece-43f2-8247-c8705fd55c46', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:36:31.235472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.236257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.236688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.237413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.237866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.238284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.339551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:31.405269 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f51fef0d-83bf-46df-bc65-0ca71e22fd71 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.300309 Aug 30 17:36:31.405877 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1380/2634] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 30 17:36:31 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:31.410667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:31.411956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:31.418489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.418973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.419409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.420139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.420581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.421010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.450220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da37f9ae-e96b-427b-9631-d3a1e88cc82e tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.043038 Aug 30 17:36:31.451070 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1381/2635] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 30 17:36:31 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c/os-server-password => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:36:31.460434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:31.461313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:31.467785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.468467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.469142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.469882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.470363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.470793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.588628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.596980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.598485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:31.599683 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d75abc73-fbae-4b84-9976-2d0b849cd6a9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1281 microversion: 2.57 time: 0.147481 Aug 30 17:36:31.600282 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1382/2636] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:31 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:31.614028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.193"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:31.617379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:31.624082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.624810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.625349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.626119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:31.626640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:31.627133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:31.656738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:36:31.657299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquired lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:36:32.069493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for project 84ac52a6449e40999f9d74f115069bbb. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:32.074892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for user 8a8a9adbb5a849dbbdd4c81ef2e42f7e and project 84ac52a6449e40999f9d74f115069bbb. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:32.088914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:32.089326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:32.089790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:32.090189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:32.090589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:32.099327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.099838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.100268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.100984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.101427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.101846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.119295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for project 84ac52a6449e40999f9d74f115069bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:32.124692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Getting quotas for user 8a8a9adbb5a849dbbdd4c81ef2e42f7e and project 84ac52a6449e40999f9d74f115069bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:32.137517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:32.139924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:32.189269 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcff6709-e6cf-4eab-9907-516a8c542652 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.088676 Aug 30 17:36:32.195525 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1255/2637] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:36:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:36:32.199523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:32.200295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:32.207297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.208354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.209369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.209518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.209898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.210490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.492071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:32.504700 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3577864-6340-49db-a0de-ade5b7eb471e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1511 microversion: 2.1 time: 0.313460 Aug 30 17:36:32.520239 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1256/2638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:32 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:32.534461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:32.534973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:32.543605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.544096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.544533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.545225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.545832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.546422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.589025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:32.690123 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c79e80a0-037d-4741-84f2-6b4abde0ee7c tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 204 len: 0 microversion: 2.1 time: 0.167421 Aug 30 17:36:32.691720 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1257/2639] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:32 2022] DELETE /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:32.701046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:32.702304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:32.704797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:32.712434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.712864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.713374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.714131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.714853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.715115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.876785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:32.884639 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30b07ea8-2592-4b8e-8b18-f0f8dc799671 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1504 microversion: 2.1 time: 0.191339 Aug 30 17:36:32.885292 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1258/2640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:32 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:32.891573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:32.892237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:32.906779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.907359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.907896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:32.908794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:32.909107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:32.909527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.074007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.083041 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d9b261c-03fd-4ca9-bc84-3e9f7fd11997 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.196596 Aug 30 17:36:33.083961 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1259/2641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:32 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:33.088383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:33.088976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:33.098221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.099916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.100354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.102447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.103586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.103820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.199278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Building network info cache for instance {{(pid=122124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:36:33.294727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.303918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.305513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.306638 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f07b943-8580-4e75-96f8-bd966d1cd458 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.221727 Aug 30 17:36:33.307232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1260/2642] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:33 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:33.316656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:33.318033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:33.324700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.325301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.326110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.326931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.328534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.329062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.399678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.409435 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a16680a9-9052-49fe-96ee-cb4407a9f1f1 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1328 microversion: 2.1 time: 0.096811 Aug 30 17:36:33.410029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1261/2643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:33 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:33.415223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:33.415852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:33.427809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.428387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.429006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.430037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.430477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.431228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.607397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.620511 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee136246-c983-4cac-a092-3a32cbc93278 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1511 microversion: 2.1 time: 0.209441 Aug 30 17:36:33.638867 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1262/2644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:33 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:33.644703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:33.645853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:33.652692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.653370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.653900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.654870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.655559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.655559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.722549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:INSERT=6,nova_cell1:SELECT=92,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:33.789343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.802514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.804212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.805542 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-802593b3-e90d-40b5-b9e5-930ef873d9dd tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1335 microversion: 2.57 time: 0.165431 Aug 30 17:36:33.806663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1263/2645] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:33 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1335 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:33.811743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:33.812667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:33.819396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.820230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.820839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.821816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:33.822555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:33.823146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:33.985189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:33.995329 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fb576364-96c6-40b1-bad2-2e3d5b7a4f65 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1511 microversion: 2.1 time: 0.187383 Aug 30 17:36:33.996143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1264/2646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:33 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:34.000561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:34.000943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.003959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Updating instance_info_cache with network_info: [{"id": "59c3f779-04f6-4b47-919f-70f52b03ce61", "address": "fa:16:3e:f4:0d:e9", "network": {"id": "9dfb5058-00ea-4f65-a61c-4fd0231d3a4e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-598042399-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "83276416771c45d3b9d92e8a62d44d9b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59c3f779-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:36:34.009387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.010491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.010926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.012442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.012945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.014706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.020814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Releasing lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:36:34.022081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2086809b-3c76-45b0-8364-dd506a09b549 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action" status: 202 len: 0 microversion: 2.1 time: 2.420830 Aug 30 17:36:34.027516 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1383/2647] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:31 2022] POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action => generated 0 bytes in 2423 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:36:34.031923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:34.044360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.044899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.045571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.049839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:34.057876 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] Creating event network-changed:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:36:34.063505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-101d81f7-da2d-409c-b661-08b7fc9d66d9 req-f08670a2-280c-4caf-af98-9b00c8d949e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038040 Aug 30 17:36:34.064565 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1384/2648] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:34.070447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:34.071274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.077765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.078547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.079248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.080208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.080880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.081531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.147580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00bb11eb-4d6d-4479-bd16-58f262f822d9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 204 len: 0 microversion: 2.1 time: 0.150314 Aug 30 17:36:34.148856 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1265/2649] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:33 2022] DELETE /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:34.155285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Action: 'action', calling method: .version_select at 0x7f2d9ac9ee50>, body: {"removeFloatingIp": {"address": "172.25.4.193"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:34.326572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:34.335221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b86f840a-5a2f-4482-b1bf-9e7b417df266 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1510 microversion: 2.1 time: 0.269384 Aug 30 17:36:34.339259 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1385/2650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:34 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:34.343991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:34.345162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.345296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.355359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.355916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.356356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.357066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.357554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.357984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.362167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.362783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.363333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.364527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.366082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.366734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.403774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=24 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:34.599624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:36:34.600223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquired lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:36:34.616768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:34.626632 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f48f801-48a0-417e-a4fe-c5b07a9ccb16 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.285903 Aug 30 17:36:34.627171 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1386/2651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:34 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:34.634571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:34.635386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.646603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.647343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.648012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.648731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.649184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.651309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.684280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:34.884426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:34.892660 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3fe8701-1525-4fbd-baad-28c62bfbff61 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1510 microversion: 2.1 time: 0.263902 Aug 30 17:36:34.893343 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1387/2652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:34 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:34.899029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:34.901050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:34.918144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.918629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.919253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:34.920160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:34.920771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:34.921357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:35.233344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:35.255455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:35.273814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:35.275713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a052240-ddcb-4a7b-9255-ae0b3324717f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.381212 Aug 30 17:36:35.276305 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1388/2653] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:34 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:35.292814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:35.300706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:35.303671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:35.310648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:35.311629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:35.312293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:35.313564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:35.323287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:35.323975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:35.452061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:35.475093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Building network info cache for instance {{(pid=122123) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:36:35.561196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:35.581491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:35.585301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:35.587718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:35.815622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ea3d198-15ae-4f0c-8060-e85de9526143 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.533719 Aug 30 17:36:35.817792 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1389/2654] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:36:35 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:35.826258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:35.827459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:35.843317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:35.843910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:35.844485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:35.845189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:35.845637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:35.846056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.003829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.012930 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-948dd491-23f8-425c-9f81-9dad859fd52b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.193629 Aug 30 17:36:36.013570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1390/2655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:35 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:36.028879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.030090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:36.039005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.039536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.040559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.041295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.041863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.042910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.070344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Updating instance_info_cache with network_info: [{"id": "59c3f779-04f6-4b47-919f-70f52b03ce61", "address": "fa:16:3e:f4:0d:e9", "network": {"id": "9dfb5058-00ea-4f65-a61c-4fd0231d3a4e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-598042399-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "83276416771c45d3b9d92e8a62d44d9b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59c3f779-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:36:36.085306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Releasing lock "refresh_cache-405f21a5-8833-4802-b076-ec6dfdc948d4" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:36:36.086340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a6a1a1d-0d68-41d0-a64c-f28fabe753d1 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action" status: 202 len: 0 microversion: 2.1 time: 1.936155 Aug 30 17:36:36.087271 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1266/2656] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:36:34 2022] POST /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4/action => generated 0 bytes in 1937 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:36:36.092251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.092924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:36.100300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.100858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.101297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.101998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.102446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.102898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.119720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.128373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.130444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.131902 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b934f628-f194-4b1f-8a6a-5b3c400e75a7 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1335 microversion: 2.57 time: 0.110268 Aug 30 17:36:36.132649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1391/2657] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:36 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:36.146085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:36.155791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.156270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.156697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.169183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] Creating event network-changed:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:36:36.174215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-86453ebc-b910-4d8a-a321-427cd1521420 req-1ccce8ce-421d-431d-b154-cb85686736c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Aug 30 17:36:36.174824 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1392/2658] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:36.180066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.180741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:36.186839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.187324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.187806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.188490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.188939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.189362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.248368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.257588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2945810-31aa-40d7-8f2a-629ef1916b85 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1511 microversion: 2.1 time: 0.169132 Aug 30 17:36:36.264132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1267/2659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:36 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:36.280827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.286337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.287289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:36.443336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.452922 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ffe4c4f5-6b42-4106-888a-448f9450e35c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.276661 Aug 30 17:36:36.454326 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1393/2660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:36 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:36.476999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.477624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:36.488775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.489416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.489830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.490544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.490996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.491420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.878192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.880242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.880868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.882280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:36.882921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:36.883534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:36.883695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:36.901756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb3f4773-0569-4b74-bbe7-fea1fe50dada tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1510 microversion: 2.1 time: 0.431084 Aug 30 17:36:36.915898 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1394/2661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:36 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:36.921125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e0be83f-5b0b-4aa2-9f47-380a3559de6e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '.version_select at 0x7f2d9882fc10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:36.985667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:37.046967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-18110231-da6f-4c4d-8c8d-2f6dd915117d tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.781650 Aug 30 17:36:37.056618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1268/2662] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 30 17:36:36 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:37.056618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47141bd6-d2c0-4f3b-a618-25ff021f2ad1", "tag": "79312d8d-4530-4a33-9863-3757aff5e83e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:37.063307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.063804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.064221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.078942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] Creating event network-changed:79312d8d-4530-4a33-9863-3757aff5e83e for instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 on n-h2-852771-11 Aug 30 17:36:37.084921 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-23a0f6e6-27eb-4244-b19a-467a019d87be req-efcaea97-fa6a-4eca-a60c-728c99150ca1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Aug 30 17:36:37.085694 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1269/2663] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:37.090480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:37.091277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:37.097455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.097766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.108242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.109600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.110378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.111077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.404949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:37.413637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:37.415073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:37.416405 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc9bd638-8d13-4a99-9e5d-8e76feb909f3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.329822 Aug 30 17:36:37.417282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1270/2664] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:37 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:37.422027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:37.422629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:37.430364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.431093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.431827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.432763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.433445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.434562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.742475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:37.751366 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21e7d26f-6481-41c2-89ff-b56008be027b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.332851 Aug 30 17:36:37.752025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1271/2665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:37 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:37.756889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:37.762306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:37.763219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:37.769653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.770271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.770711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.771558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.772206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.772640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.879372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:37.974583 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5e507eb-6a03-437b-bb45-6236d906e373 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.220606 Aug 30 17:36:37.976345 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1272/2666] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 30 17:36:37 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:37.981554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:37.982466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:37.990561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.991858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.992299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:37.993006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:37.993461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:37.993880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.164130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.170379 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e0be83f-5b0b-4aa2-9f47-380a3559de6e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/27687fee-894b-4b63-80e5-fa22d2928f8f" status: 202 len: 0 microversion: 2.1 time: 1.253213 Aug 30 17:36:38.171972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1395/2667] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:36:36 2022] DELETE /compute/v2.1/os-floating-ips/27687fee-894b-4b63-80e5-fa22d2928f8f => generated 0 bytes in 1256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:38.174312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.177372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.178807 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fcfe6f34-e5b6-4fce-8744-d091128025eb tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1356 microversion: 2.57 time: 0.201234 Aug 30 17:36:38.179287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.179687 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1273/2668] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:37 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:38.180187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.184258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.185002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.190829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.191300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.192288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.192732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.193172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.193744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.196772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.197386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.197897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.198613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.199221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.199991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.270833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.271737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.272721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.273281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lazy-loading 'fault' on Instance uuid e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:38.344143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c313411ef4103acd837230270e84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaf428e4724b4891c13ffd0ae7694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.352393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69e85b67-b7e8-47f7-9bf6-d2822fcd13a4 tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 200 len: 1306 microversion: 2.1 time: 0.177990 Aug 30 17:36:38.352990 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1396/2669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:38 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 1306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:38.357625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.358266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.364919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.365409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.365849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.366538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.367171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.367628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.404326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.404820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.405259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.405926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lazy-loading 'fault' on Instance uuid 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:38.420749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.428998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc58cdb2-bfcc-4d32-8602-d65980e1f420 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.248238 Aug 30 17:36:38.429593 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1274/2670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:38 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:38.434337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.439719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.440697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:38.447704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.448249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.448751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.449544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.450123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.450613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.460966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a44501d50245f386bc8ed3d041a750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8c0a90bd0548198ab6e6753452dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:38.470755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71789d1f-3a5b-4804-8870-5f6a7035e36f tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 200 len: 1306 microversion: 2.1 time: 0.116667 Aug 30 17:36:38.483069 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1397/2671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:38 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:38.483069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b570fc2d-d428-46b0-b6a5-ea9a8c7c1d1a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '.version_select at 0x7f2d93d5e940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.544733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:38.618310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-05ab1bdf-31a9-4dda-9a46-5fb81bbde8f8 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.187107 Aug 30 17:36:38.618956 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1275/2672] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Aug 30 17:36:38 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:38.628796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2350ef-18f4-4c0e-95d2-5432b4ab2de3", "name": "network-vif-deleted", "tag": "8a8923fd-ef35-4578-9a6d-3a78746cf8d3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:38.652896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.653365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.654136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.673456 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] Creating event network-vif-deleted:8a8923fd-ef35-4578-9a6d-3a78746cf8d3 for instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 on n-h1-852771-11 Aug 30 17:36:38.680205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7d43e5ca-c965-46de-a716-89426e618b46 req-47e4dc5b-c87c-429e-9a4b-c32df6b32182 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055100 Aug 30 17:36:38.681399 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1276/2673] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:38.687410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:38.691293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.700848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.701587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.711175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.712086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.712561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.712996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.822898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:38.843426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:38.843907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:38.844339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:38.844751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:38.845801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:38.920988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.930388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.930720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.931155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.931949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.932409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.932843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.964853 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9862b73-aa37-4c4c-8cc7-eaa478238c1b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "POST /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23/action" status: 202 len: 1137 microversion: 2.57 time: 0.281697 Aug 30 17:36:38.965436 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1277/2674] 10.222.0.50 () {62 vars in 1320 bytes} [Tue Aug 30 17:36:38 2022] POST /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23/action => generated 1137 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 17:36:38.970476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:38.971550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:38.977920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.978708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.979315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:38.980483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:38.981121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:38.981704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.245186 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b570fc2d-d428-46b0-b6a5-ea9a8c7c1d1a tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/8686aad8-c2d1-4237-a3d7-3276d579f8fe" status: 202 len: 0 microversion: 2.1 time: 0.772706 Aug 30 17:36:39.246107 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1398/2675] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:36:38 2022] DELETE /compute/v2.1/os-security-groups/8686aad8-c2d1-4237-a3d7-3276d579f8fe => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:36:39.253298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.273696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.280290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': '1251476807', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:39.292110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.292684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.293194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.294364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.295088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.295712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.368879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.378025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.382160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.385470 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ac19d0f-687e-4df1-95b0-6c61a796d414 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.418652 Aug 30 17:36:39.385836 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1278/2676] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:38 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:39.395262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.397067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.411378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.414250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.414692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.415416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.418423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.418864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.419804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:39.500744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57eaa24a-c016-4ea6-9996-c9a81d42ba79 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=1251476807" status: 200 len: 346 microversion: 2.1 time: 0.253371 Aug 30 17:36:39.501458 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1399/2677] 10.222.0.50 () {58 vars in 1156 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers?name=1251476807 => generated 346 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:39.506987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.509226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.513959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.514518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.515041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.515828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.516350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.516840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.587707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.596035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.597470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.599565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8d1a307-0463-4723-bbec-d3423b077c3c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.096862 Aug 30 17:36:39.600137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1400/2678] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:39.605429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c", "name": "network-vif-deleted", "tag": "3ab2a23c-af13-4818-9d44-90c3e0e7773b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:39.616908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.617594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.618024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.632345 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] Creating event network-vif-deleted:3ab2a23c-af13-4818-9d44-90c3e0e7773b for instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c on n-h1-852771-11 Aug 30 17:36:39.637605 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f0d16d70-e4a7-4295-a713-f8c1c90e780f req-ac2f8648-c961-492e-81a1-5b1b92f0ac6f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Aug 30 17:36:39.638221 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1401/2679] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:39.640226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.643115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.643717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.650218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61933b35-4dd2-4211-86ff-c3c6da616f98 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.261195 Aug 30 17:36:39.650575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.650805 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1279/2680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:39.655341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.655825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.656051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] [instance: e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.656514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.657312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.657899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.658351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.666128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.666602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.667033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.667754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.668195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.668784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.682878 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] HTTP exception thrown: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Request method failure captured: Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c HTTP/1.1 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqEqB6qFU-mYeJPpT2aOa66Rj9Lmmps3lYA3mhuCd1L31af2dpewy5_lu8Gpn-D1ajbAeLQ9y0KlnYoL3NWv6v1ow90sL75CvF9ElwiStkvtdV_l6plmD_bhbUySmT5VF5YfWwYMlRtitAHKQZCbCN2s6-vEJorsy5hm5be40vkgJE Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: cceaf428e4724b4891c13ffd0ae7694e Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerPasswordTestJSON-270421216 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cceaf428e4724b4891c13ffd0ae7694e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cceaf428e4724b4891c13ffd0ae7694e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cceaf428e4724b4891c13ffd0ae7694e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cceaf428e4724b4891c13ffd0ae7694e"}]}] Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerPasswordTestJSON-270421216 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: cceaf428e4724b4891c13ffd0ae7694e Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerPasswordTestJSON-270421216 Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerPasswordTestJSON-270421216-project Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 760c313411ef4103acd837230270e84b Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerPasswordTestJSON-270421216-project Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c'} Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:39.684819 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.689523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] Returning 404 to user: Instance e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:39.690416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:39.690524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f6118da-5873-4da2-98f8-44a354f2ecea tempest-ServerPasswordTestJSON-270421216 tempest-ServerPasswordTestJSON-270421216-project] 10.222.0.50 "GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c" status: 404 len: 111 microversion: 2.1 time: 0.034450 Aug 30 17:36:39.690524 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1280/2681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/e4c67801-b5f1-4bb7-a1a5-b5e55fc90c9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:39.694691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.695557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.704734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.706730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.710306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.711309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.712580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.713225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.819960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-610215d5-a371-4b67-9b96-a59ee6dc8da9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "DELETE /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 204 len: 0 microversion: 2.1 time: 0.177872 Aug 30 17:36:39.826939 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1402/2682] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:39 2022] DELETE /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:39.835597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.836346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.849887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.850375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.850807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.851528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.851976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.858219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.887567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 HTTP/1.1 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9f2350ef-18f4-4c0e-95d2-5432b4ab2de3'} Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:39.889136 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f42bb7de-f430-4c11-a38c-cd00ecadf574 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 404 len: 111 microversion: 2.1 time: 0.065017 Aug 30 17:36:39.892956 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1403/2683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:39.898258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.901277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.906086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67e7ed1f-ccf7-4db9-907f-abce99030963 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.218060 Aug 30 17:36:39.907318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:39.908493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:39.915753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.916458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.917179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.918321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.919226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.919882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.920022 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1281/2684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:39.925858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:39.927661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:39.933441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.933933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.934368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:39.935069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:39.935536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:39.935962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.064925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:40.085776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:40.132907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.143292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3521ce09-47d9-40b7-81db-cf4bb4a673e9 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1509 microversion: 2.1 time: 0.222140 Aug 30 17:36:40.144264 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1282/2685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:40.150313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1048939609", "metadata": {"image_type": "test"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:40.153159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.160069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.160646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.161618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.162332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.162788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.163216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.181625 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3/action HTTP/1.1 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 112 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1048939609", "metadata": {"image_type": "test"}}} Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9f2350ef-18f4-4c0e-95d2-5432b4ab2de3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1048939609', 'metadata': {'image_type': 'test'}}}} Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:36:40.183281 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8748efe0-bdfe-4aec-b157-5d81bcbe5ac3 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "POST /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3/action" status: 404 len: 111 microversion: 2.1 time: 0.039545 Aug 30 17:36:40.192116 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1283/2686] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 30 17:36:40 2022] POST /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.196597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1037675142", "metadata": {"image_type": "test"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:40.199104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Failed to fetch instance by id tempest-invalid-1737291265 {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:36:40.199660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance tempest-invalid-1737291265 could not be found. Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/tempest-invalid-1737291265/action HTTP/1.1 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 112 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1037675142", "metadata": {"image_type": "test"}}} Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance tempest-invalid-1737291265 could not be found. Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'tempest-invalid-1737291265', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1037675142', 'metadata': {'image_type': 'test'}}}} Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1737291265 could not be found. Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.201798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1737291265 could not be found. Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1737291265 could not be found. Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance tempest-invalid-1737291265 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.208134 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de917b5e-301c-4035-87fb-7fc3f191a5be tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-1737291265/action" status: 404 len: 101 microversion: 2.1 time: 0.011108 Aug 30 17:36:40.209409 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1284/2687] 10.222.0.50 () {60 vars in 1249 bytes} [Tue Aug 30 17:36:40 2022] POST /compute/v2.1/servers/tempest-invalid-1737291265/action => generated 101 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.216159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1931476576"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:40.218481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:36:40.219000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 57 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "tempest-test-snap-1931476576"}} Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1931476576'}}} Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.222042 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.228560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ba4c7d5-8e5a-48f5-aacf-21bfa77436c9 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013112 Aug 30 17:36:40.229432 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1285/2688] 10.222.0.50 () {60 vars in 1275 bytes} [Tue Aug 30 17:36:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.234969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2098606189"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:40.237604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:36:40.238117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 57 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: {"createImage": {"name": "tempest-test-snap-2098606189"}} Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2098606189'}}} Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.239762 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.244238 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94bd9e3c-48a7-4766-9797-1e8e062c1726 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010801 Aug 30 17:36:40.247838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1286/2689] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 30 17:36:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.253474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.253984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.269957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.271236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.272053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.273008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.273672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.278199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.298541 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 HTTP/1.1 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9f2350ef-18f4-4c0e-95d2-5432b4ab2de3'} Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.300470 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.304825 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.306311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.307346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1f6fde7-3723-43e5-834c-a81eb08b1897 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 404 len: 111 microversion: 2.1 time: 0.058492 Aug 30 17:36:40.308459 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1287/2690] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:40 2022] DELETE /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.316227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.317291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] [instance: 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.324282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.325017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.325637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.326510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.327120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.328574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.346415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] HTTP exception thrown: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Request method failure captured: Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 HTTP/1.1 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqK8JIs2oaj8ybfKi1utnunjuugYMyo_Jg_PgXYzYh6NN1O1kJKc5QYC0GWugGK6-XNOZxaOscSdZj1UeaLnhtdcE_uL8YZ9ur40oiPCGDulvm-S_PF9QyGM-vnHpHB-6STEN8Dnij-jO07-FXMnu_HKIlbIzDmKZwjuoOvT8YMVBk Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e8c0a90bd0548198ab6e6753452dfd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e8c0a90bd0548198ab6e6753452dfd8"}]}] Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9e8c0a90bd0548198ab6e6753452dfd8 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-69198448 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 19a44501d50245f386bc8ed3d041a750 Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesNegativeTestJSON-69198448-project Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9f2350ef-18f4-4c0e-95d2-5432b4ab2de3'} Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:40.349009 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. Aug 30 17:36:40.353595 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:36:40.355600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] Returning 404 to user: Instance 9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:40.357168 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53828e01-936f-4377-b05e-54c1dfb82d43 tempest-ImagesNegativeTestJSON-69198448 tempest-ImagesNegativeTestJSON-69198448-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3" status: 404 len: 111 microversion: 2.1 time: 0.044911 Aug 30 17:36:40.358226 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1288/2691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:40 2022] GET /compute/v2.1/servers/9f2350ef-18f4-4c0e-95d2-5432b4ab2de3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:40.410224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.411865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.423538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.425770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.427407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.433560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.436329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.437028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.450697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57113ceb-137a-4e83-bfaa-68276ac5adb4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.557790 Aug 30 17:36:40.452242 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1404/2692] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 30 17:36:39 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:40.468475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.476019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.476790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-125147680', 'deleted': False, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:36:40.486208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.486813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.487330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.488178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.488709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.489242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.587689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:36:40.661139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5af29e2-dd62-4a72-9e7d-753ea0c3625e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125147680" status: 200 len: 346 microversion: 2.1 time: 0.196126 Aug 30 17:36:40.669140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1405/2693] 10.222.0.50 () {58 vars in 1228 bytes} [Tue Aug 30 17:36:40 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125147680 => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:40.677407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.678386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.691195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.691746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.692725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.694156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.694867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.695348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.731189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.740041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.758083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.760006 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fae8cdb3-8a80-4057-b11d-8f14582d2728 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.354869 Aug 30 17:36:40.771788 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1289/2694] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:40 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:36:40.777856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.778710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.787617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.788213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.788763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.790282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.790846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.791349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.799269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.815766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.821009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:40.822260 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5acb2572-ed6c-4f2f-9ff6-b9f9d6044899 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.151814 Aug 30 17:36:40.824942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1406/2695] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:40 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:40.837648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:40.838383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:40.850052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.850666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.855979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.857010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:40.858111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:40.858750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:40.894689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:41.057266 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d070abdf-777e-43a4-a928-81a1b170aa35 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 204 len: 0 microversion: 2.1 time: 0.230582 Aug 30 17:36:41.061041 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1407/2696] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:40 2022] DELETE /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:41.065362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:41.066331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:41.078876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.080016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.080016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.082009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.083962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.084569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.194466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.205347 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2be7bfb3-a927-4f57-ab9b-e55374583368 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.431495 Aug 30 17:36:41.205989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1290/2697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:40 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:41.232912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:41.234861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:41.252640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.255397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.257088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.258007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.260437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.265497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.316758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.328624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e90cde61-00a8-42a4-bc55-651801f0aaf4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.268891 Aug 30 17:36:41.329170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1408/2698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:41 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:41.351077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:41.353847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:41.369596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.370103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.370528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.375054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.376603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.377173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.618180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.630642 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a6cf4c80-8857-4ddb-9dd5-08efb3c0c5e2 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1516 microversion: 2.1 time: 0.406229 Aug 30 17:36:41.631997 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1291/2699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:41 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:41.637257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cafd98f-7d60-455b-9d0b-406e7d81bf8f", "name": "network-vif-plugged", "status": "completed", "tag": "0020fda5-9556-48f0-bc6b-3f28866810a1"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:41.649596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.650455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.651030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.683058 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] Creating event network-vif-plugged:0020fda5-9556-48f0-bc6b-3f28866810a1 for instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f on n-h2-852771-11 Aug 30 17:36:41.698298 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a12d182d-eb76-4807-ae10-901bc0db3b8e req-7db3d97d-b128-4bf6-a714-ebf1cbaf762e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064852 Aug 30 17:36:41.699240 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1292/2700] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:41.718575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.731909 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf911943-6bd2-4d14-a27d-f497992e402e tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1509 microversion: 2.1 time: 0.386021 Aug 30 17:36:41.744703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1409/2701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:41 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:41.790578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:41.791285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:41.805106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.806641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.807081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.807855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.809464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.810021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.852362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:41.853257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:41.860143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.860733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.861424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.862269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:41.862732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:41.863145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:41.945464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.954847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.957216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:41.957808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ff287bb-cca2-40d6-8ec7-d07202662c66 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.109289 Aug 30 17:36:41.958474 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1410/2702] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:41 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:36:42.132974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:42.143710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:42.163241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:42.169881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:42.171126 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b283e4a1-5c3f-4963-843a-4de6c6753765 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.388076 Aug 30 17:36:42.171777 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1293/2703] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:41 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:42.230601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:42.231230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:42.243845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.244369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.251692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.252599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.253190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.253518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.351288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:42.352120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:42.383792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.384758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.388017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.391504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.392319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.393018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.535317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:42.547856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56c292ef-81b7-4264-8358-0640b02dfa3a tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.321239 Aug 30 17:36:42.549029 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1411/2704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:42 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:42.654255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:42.656272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:42.666447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.667395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.668040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.668915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:42.670124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:42.672385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:42.971418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:42.981688 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8832ff8d-c11b-4b60-9630-23dd1c7a2c68 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.635099 Aug 30 17:36:42.998726 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1294/2705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:42 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:43.008451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:43.009480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:43.018800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.019573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.020793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.021977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.022593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.023175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.293953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:43.306876 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9b64130-09f8-4050-bd62-ca0613bcb8d9 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1516 microversion: 2.1 time: 0.658720 Aug 30 17:36:43.309249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1412/2706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:42 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1516 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:43.314667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:43.315289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:43.324214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.324710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.325156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.325868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.327098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.327625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.411983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:43.430610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:43.432808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:43.434378 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f978edfa-9e7e-4431-8a6b-90c9557b0fc4 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.123939 Aug 30 17:36:43.435691 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1413/2707] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:43 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:43.446182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:43.447142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:43.457368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.459564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.465674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.469766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.470604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.472846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.666396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:43.677920 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69929efd-266e-42e4-bd7d-acb21f654d59 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1509 microversion: 2.1 time: 0.677458 Aug 30 17:36:43.693649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1295/2708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:42 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:43.713206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:43.715197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:43.732628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.733307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.734363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.735102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:43.735583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:43.736270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:43.994416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:44.011759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:44.013480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:44.015288 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d74a99ed-c294-40e1-9b52-92673efb5c61 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1278 microversion: 2.25 time: 0.578429 Aug 30 17:36:44.016982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1414/2709] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:43 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1278 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:44.043689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47141bd6-d2c0-4f3b-a618-25ff021f2ad1", "name": "network-vif-plugged", "status": "completed", "tag": "79312d8d-4530-4a33-9863-3757aff5e83e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:44.075752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.077215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.077925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.103314 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] Creating event network-vif-plugged:79312d8d-4530-4a33-9863-3757aff5e83e for instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 on n-h2-852771-11 Aug 30 17:36:44.116467 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-974d3cc0-52d4-40c9-918d-9ce1d005a4ad req-027f70f4-140d-4abf-b64a-99583746ec47 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096979 Aug 30 17:36:44.117577 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1415/2710] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:44.132135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:44.133021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:44.148848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.149792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.150345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.151179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.152836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.153356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.472072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:44.484969 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ed5504b-87e5-4c7e-815a-4f2a036af55c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.364659 Aug 30 17:36:44.500702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1416/2711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:44 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:44.521664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:44.529896 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bacc2c82-2b7e-442b-a16e-9a0943608446 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.832152 Aug 30 17:36:44.544732 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1296/2712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:43 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:44.546341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:44.553664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:44.558557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:44.559407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:44.566802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.568065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.568665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.569735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.570361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.570979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.578137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.589635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.590164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:44.591559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:44.591559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:44.591849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.019076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.034297 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f36b58a7-ecdf-4229-b53b-e27ac359c033 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1516 microversion: 2.1 time: 0.516676 Aug 30 17:36:45.047599 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1417/2713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:44 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1516 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:45.064832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:45.070056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:45.079495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:45.094024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.096857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.097564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.098601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.099220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.099835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.164334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.167777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.168215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.168662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.169121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lazy-loading 'fault' on Instance uuid 405f21a5-8833-4802-b076-ec6dfdc948d4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:45.178747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.180317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.183001 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-80829cf5-581a-47f6-a87a-68ba15191331 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.636664 Aug 30 17:36:45.185239 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1297/2714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:44 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:45.195345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405f21a5-8833-4802-b076-ec6dfdc948d4", "name": "network-vif-deleted", "tag": "59c3f779-04f6-4b47-919f-70f52b03ce61"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:45.205440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.206192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.206817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.218655 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] Creating event network-vif-deleted:59c3f779-04f6-4b47-919f-70f52b03ce61 for instance 405f21a5-8833-4802-b076-ec6dfdc948d4 on n-h1-852771-11 Aug 30 17:36:45.231284 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7e1b8cf4-7be2-4b42-baf0-76e6de0102d9 req-9d17c319-399d-4317-a8df-3a1e988d5696 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042067 Aug 30 17:36:45.232872 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1298/2715] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:45.249823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee51bcebceb454daa31fdd28ff98b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83276416771c45d3b9d92e8a62d44d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.253928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:45.259512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:45.291184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.291714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae8c6174-2b7d-456c-9257-bd18f1bbadb7 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 200 len: 1313 microversion: 2.1 time: 0.228549 Aug 30 17:36:45.293624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1418/2716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:45 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:45.294863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.295953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.297411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.299165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.300188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.341810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:45.516019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:45.517100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:45.556913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.556913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.562836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.565540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.566402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.567788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.568585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:45.700060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:45.854247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.868040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.871012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:45.872696 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43f37328-d493-4b30-9105-26df3dee06e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1473 microversion: 2.25 time: 0.638084 Aug 30 17:36:45.873510 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1299/2717] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:45 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1473 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:45.878227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:45.878949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:45.888621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.889447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.890209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:45.891280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:45.892085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:45.893271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.062635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.077821 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a42e2651-7acf-4de5-acc3-80108cd9a893 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.570373 Aug 30 17:36:46.078426 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1419/2718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:45 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:46.223877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.237564 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22b725d4-774c-4f9a-961d-2e8db548b99c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1401 microversion: 2.1 time: 0.361609 Aug 30 17:36:46.239643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1300/2719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:45 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1401 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:46.251709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:46.252659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:46.273039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.279430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.280243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.281178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.281841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.282474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.341111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:46.341943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:46.344652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.347046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.348916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.349569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.350153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.350507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.350980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lazy-loading 'fault' on Instance uuid 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:46.351513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.352120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.352760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.479332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.495760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9335106d-cea5-4df1-9a9d-e24503cc4a72 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 200 len: 1310 microversion: 2.1 time: 0.253056 Aug 30 17:36:46.507564 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1301/2720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:46 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 1310 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:46.513179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:46.515163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:46.528326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.529401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.530034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.530896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.531678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.532367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.631889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 1cafd98f-7d60-455b-9d0b-406e7d81bf8f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:46.657571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.661188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7084d8e-cf61-4e64-b402-c257c121759b tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1965 microversion: 2.25 time: 0.578761 Aug 30 17:36:46.666427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1420/2721] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:46 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1965 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:46.669403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.674634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:46.677684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:46.678968 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-23dbcb50-a4e9-4113-b1d2-9176c28a5f26 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.168595 Aug 30 17:36:46.680666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] [instance: 405f21a5-8833-4802-b076-ec6dfdc948d4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:46.686792 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1302/2722] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:46 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:46.695203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.701773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:46.702699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.703606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:46.707703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.708582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.708960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.709395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.721858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.722352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.722807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.724083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:46.724543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:46.724970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:46.753793 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] HTTP exception thrown: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Request method failure captured: Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 HTTP/1.1 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpjtc04QpIKyfcbrxpduQU6UHtyWeVdB_J4MEVob6hoclZ0z2PqblmGFQtr19ZBJer648DiQnlEKiVp2-WsojrSiUcNoZI6wuV1mfmdmCnfted20wPpjFFJW9S7qKKBUghbKKqLeRB0qvbFs0zKyhnFIOl6jjjE5Cw_mnZg13yAkRM Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 83276416771c45d3b9d92e8a62d44d9b Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-624043821 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83276416771c45d3b9d92e8a62d44d9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83276416771c45d3b9d92e8a62d44d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83276416771c45d3b9d92e8a62d44d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83276416771c45d3b9d92e8a62d44d9b"}]}] Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-624043821 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 83276416771c45d3b9d92e8a62d44d9b Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-624043821 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueTestJSONUnderV235-624043821-project Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 9ee51bcebceb454daa31fdd28ff98b03 Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-624043821-project Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '405f21a5-8833-4802-b076-ec6dfdc948d4'} Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:46.755668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] Returning 404 to user: Instance 405f21a5-8833-4802-b076-ec6dfdc948d4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:46.759414 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05b4bde9-639b-4b71-b680-99cc4e83a157 tempest-ServerRescueTestJSONUnderV235-624043821 tempest-ServerRescueTestJSONUnderV235-624043821-project] 10.222.0.50 "GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4" status: 404 len: 111 microversion: 2.1 time: 0.089468 Aug 30 17:36:46.762730 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1421/2723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:46 2022] GET /compute/v2.1/servers/405f21a5-8833-4802-b076-ec6dfdc948d4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:46.986874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 1cafd98f-7d60-455b-9d0b-406e7d81bf8f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:47.002162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0049eb9f-adae-4551-9b34-17f4893ba963 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1965 microversion: 2.25 time: 0.309105 Aug 30 17:36:47.012299 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1303/2724] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:46 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1965 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:47.023807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:47.027920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.028615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.029231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.030119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.030747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.031327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.060792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88fa2ff4-9f25-4451-9ab1-266b0caff812 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041808 Aug 30 17:36:47.063350 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1422/2725] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 30 17:36:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:36:47.078683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-11", "block_migration": "auto"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:47.083274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:47.095578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.096069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.096568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.102746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:47.103786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:47.107671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.110359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.111869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.120367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.123241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.124436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.125528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.127059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.130798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.208690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'flavor' on Instance uuid 1cafd98f-7d60-455b-9d0b-406e7d81bf8f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:47.226996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Going to try to live migrate instance to n-h1-852771-11 {{(pid=122123) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 17:36:47.508322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:47.517240 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11013c29-12b6-4d5b-95d3-2b71187108ed tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.419017 Aug 30 17:36:47.521755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1423/2726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:47 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:36:47.550428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:47.552606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:47.569897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.570394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.570828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.576834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.579317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.581609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.872011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:47.885723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b393bd4d-20ae-4e73-b1eb-565baa7ab7b3 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1588 microversion: 2.1 time: 0.361881 Aug 30 17:36:47.886570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1424/2727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:47 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1588 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:47.890914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ca421e-91dc-4948-a0f0-ac3cbab70eb3", "name": "network-vif-deleted", "tag": "1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:47.915460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.915960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.916399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.950119 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] Creating event network-vif-deleted:1ad2e63e-10cd-4ee1-a2da-4e80b4b214ce for instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 on n-h2-852771-11 Aug 30 17:36:47.962196 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8fb46aa1-5951-42e4-b1a3-a8d4e9698a33 req-a80b8b51-07e6-4c34-9990-9a7d9a85407d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074524 Aug 30 17:36:47.962854 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1425/2728] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:47.968240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:47.968871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 68ca421e-91dc-4948-a0f0-ac3cbab70eb3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:47.984605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.985672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.986539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:47.988162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:47.989447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:47.990083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.012200 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] HTTP exception thrown: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Request method failure captured: Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 HTTP/1.1 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpH1PLBC3AlR-u-mxUTO23ZBzV10CNNQ5xsvXbhGvUnFBybdW42BN1NVgOApRiu9Xhf3cYiyvhyyiT65nBscxucXfAviqC2YZgPPNTraCtnvR0n0g6NJlc8Dft1vXetKox51SGmLh39BaX9716-x3V3PIfrrgPtbDdzNjE9aRx-3mo Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ccddc9927f7349a5a02e4fde9842dcde"}]}] Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0150130ff67243309f43d31bf80f45ef Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '68ca421e-91dc-4948-a0f0-ac3cbab70eb3'} Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:48.016748 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:48.022682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Returning 404 to user: Instance 68ca421e-91dc-4948-a0f0-ac3cbab70eb3 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:48.025042 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f09cecc-d666-4eda-9170-3ddcc5294947 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3" status: 404 len: 111 microversion: 2.1 time: 0.060990 Aug 30 17:36:48.029928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1426/2729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:47 2022] GET /compute/v2.1/servers/68ca421e-91dc-4948-a0f0-ac3cbab70eb3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:48.030482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:48.031110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:48.039243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.040311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.041062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.042121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.042932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.043626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.225792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:48.237211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:48.240942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:48.246354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4969d499-9d90-41d1-af36-08823fc246be tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.219679 Aug 30 17:36:48.247341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1427/2730] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:48 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:48.259234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:48.260027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:48.272942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.274173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.280192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.281338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.282000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.282653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.479973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:48.528381 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e8ab8f5-6213-414b-b7d7-7775e5752f68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279612 Aug 30 17:36:48.529400 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1428/2731] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:36:48 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1/os-interface => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:48.535078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:48.538426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:48.554414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.554933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.556097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.557703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.559307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.560627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.613323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:48.758169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-926ab3d1-2d18-4562-8a7d-3f2da3faf5dc tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 204 len: 0 microversion: 2.1 time: 0.225343 Aug 30 17:36:48.762065 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1429/2732] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:48 2022] DELETE /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:48.896996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1080372344", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:48.964826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:48.965603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:48.966319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:48.966745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:48.967349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:48.977806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.978295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.978731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:48.979500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:48.980148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:48.980569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:49.011563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Getting quotas for project c51ffeee7ba24989a1825b1fd03c7930. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:49.020936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Getting quotas for user a7588c3aa1874049a4c5e43863f88acc and project c51ffeee7ba24989a1825b1fd03c7930. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:49.036893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:49.039375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:49.093323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c602323b-a6b2-4425-bf5a-bdf341eb3786 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.329662 Aug 30 17:36:49.094211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1430/2733] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:36:49.105023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:49.105992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:49.118538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:49.119177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:49.119962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:49.120960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:49.122305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:49.122994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:49.364855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:49.377126 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-000b0295-e49c-4cf3-9a0f-047e59caa231 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.281536 Aug 30 17:36:49.378412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1431/2734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:49 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:49.394431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:49.395976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:49.414392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:49.415148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:49.417500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:49.418453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:49.420622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:49.421330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:49.710210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:49.723504 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3347e5bb-f26e-40c0-80b4-9058d6bbb0e6 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1517 microversion: 2.1 time: 0.343764 Aug 30 17:36:49.729438 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1432/2735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:49 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1517 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:49.738385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:49.742713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:50.126908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.138111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.140259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.141834 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23403f9e-5114-45e9-b3a0-7cc8001935bd tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 200 len: 1278 microversion: 2.47 time: 0.410927 Aug 30 17:36:50.142936 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1433/2736] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:49 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:50.185460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:50.186101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:50.215806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.216327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.217212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.222072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.222609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.223129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.388694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.402713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.409028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:50.421045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e79d8a2-4e16-4746-a512-823df359400e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.276586 Aug 30 17:36:50.421663 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1434/2737] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:50 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:50.427516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-55325574", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:50.496028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:50.497330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:50.497809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:50.498224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:50.499223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:36:50.512432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.512908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.513462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.514262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.514716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.515201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.545949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Getting quotas for project c51ffeee7ba24989a1825b1fd03c7930. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:36:50.552268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Getting quotas for user a7588c3aa1874049a4c5e43863f88acc and project c51ffeee7ba24989a1825b1fd03c7930. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:36:50.594190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:36:50.596641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:36:50.680697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8902539c-dab7-421b-a3bd-e1c2d503bce6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.257829 Aug 30 17:36:50.684575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1435/2738] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:36:50.697909 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5ac5363-9d61-4c9b-91f1-a761996b8386 tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f/action" status: 202 len: 0 microversion: 2.25 time: 3.625284 Aug 30 17:36:50.698538 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1304/2739] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:36:47 2022] POST /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f/action => generated 0 bytes in 3627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:50.699867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:50.700818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:50.704113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-595a1280-d554-4352-b0a8-1d5666559b58 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:50.706582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-595a1280-d554-4352-b0a8-1d5666559b58 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:50.709041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:50.710943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.711970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.712664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.714459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.715286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.716094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.813260 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-595a1280-d554-4352-b0a8-1d5666559b58 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "PUT /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 990 microversion: 2.47 time: 0.113637 Aug 30 17:36:50.814569 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1305/2740] 10.222.0.50 () {62 vars in 1297 bytes} [Tue Aug 30 17:36:50 2022] PUT /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 990 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:36:50.820111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:50.820983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:50.827936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.828693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.829354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:50.830283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:50.830938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:50.831587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:51.023413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.037415 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-237f28df-3597-4d3a-ba68-8bbb9dbb5412 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.350374 Aug 30 17:36:51.038211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1436/2741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:50 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:51.058075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:51.058708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:51.067884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:51.068305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:51.068756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:51.069492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:51.069985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:51.070603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:51.394464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.406233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.407833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.409042 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66c80ae6-342a-4539-9f84-14c8892e5129 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.593339 Aug 30 17:36:51.411220 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1306/2742] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:50 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:51.418209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.431666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:51.433328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:51.444916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02620ef8-05a2-4a3d-a8ef-2ca0c91b2bcf tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1517 microversion: 2.1 time: 0.391965 Aug 30 17:36:51.449263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1437/2743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:51 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1517 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:51.461973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:51.463239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:51.473221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:51.475160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:51.480649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:51.481736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:51.483743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:51.485833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:51.619461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.634067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.642013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.652631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.668758 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-272d9f83-a9a0-4bd6-898f-5de9a21ccc9e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1276 microversion: 2.47 time: 0.256209 Aug 30 17:36:51.677909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.682057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:51.686326 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07a82733-d701-433a-8c68-47af2c28aee9 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.228641 Aug 30 17:36:51.688296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1438/2744] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:51 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:51.696770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1307/2745] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:51 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:52.058913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.059853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.067744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.068809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.069421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.070352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.070980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.071643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.093514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:52.249304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.260374 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5dc0a3de-9c15-45a8-ab9c-0944c4cf2941 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.205278 Aug 30 17:36:52.261557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1439/2746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:52.327241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394b99da-ae93-48de-9ed7-645b787e57d7", "name": "network-vif-deleted", "tag": "e2fb3d03-80d0-4e16-823e-2b9b7267c346"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:52.338530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.339280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.339738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.358896 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] Creating event network-vif-deleted:e2fb3d03-80d0-4e16-823e-2b9b7267c346 for instance 394b99da-ae93-48de-9ed7-645b787e57d7 on n-h1-852771-11 Aug 30 17:36:52.365037 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3b127678-f27e-4f19-aac9-12ef8237bfac req-1f16857d-6b0b-4660-873a-5e58fd627202 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041380 Aug 30 17:36:52.366190 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1308/2747] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:52.438280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.439179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.453566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.454791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.456674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.458657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.461506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.462296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.476365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.477152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.501433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.503713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.505447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.508425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.509084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.510184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.732893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.745888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.746492 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61753c86-56f7-4b9a-99c4-625f5f318b01 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1305 microversion: 2.1 time: 0.276037 Aug 30 17:36:52.747555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1309/2748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1305 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:36:52.757157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.758080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.761969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.766965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.768778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b371001-836b-4570-a192-6ccdb9f0bcbd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.336946 Aug 30 17:36:52.771400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.774664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.776659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.777719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.779931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.780992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.799576 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1440/2749] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:52.807036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.808215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.819215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.819998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.820629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.821912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.822536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.823266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.926957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.945594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.948235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.949706 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec5edc10-b773-4977-97e6-e28d22e37473 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1328 microversion: 2.47 time: 0.201126 Aug 30 17:36:52.950920 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1310/2750] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:52.964862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.978153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.979200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.986741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.987746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.988496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.989953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.990670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.991818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.034586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.040244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.044693 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c49996ff-8041-4fb6-b1b8-6d84862e6728 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.243666 Aug 30 17:36:53.059940 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1441/2751] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:53.289106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:53.290135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:53.297737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.298582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.299275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.301100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.302733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.303599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.448398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.460245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1de5d697-df27-4fd0-b879-8d13cc9864c6 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1588 microversion: 2.1 time: 0.492387 Aug 30 17:36:53.461205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1311/2752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1588 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:53.617104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.630954 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6dff074c-e8a2-46e6-a725-2aa4230a790c tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.348978 Aug 30 17:36:53.641545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1442/2753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:53 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:53.769871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:53.771204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:53.777623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.778408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.779026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.779905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.780349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.780916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.798170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:53.798755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:53.807268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.807933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.808442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.809300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.809828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.810326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.819105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.819808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.820392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.821017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lazy-loading 'fault' on Instance uuid 394b99da-ae93-48de-9ed7-645b787e57d7 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:36:53.882760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.899151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b577e67-a526-4039-8415-0611e371fd0c tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 200 len: 1310 microversion: 2.1 time: 0.133018 Aug 30 17:36:53.917351 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1312/2754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:53 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 1310 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:53.989914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:53.991230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:54.024499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.026568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.037904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.040553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.041229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.044631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.216853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.246025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.249336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.251214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2328fb62-b905-449e-84c4-175d042a2f52 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1328 microversion: 2.47 time: 0.271652 Aug 30 17:36:54.257825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1313/2755] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:53 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1328 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:54.264167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:54.269490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:54.272852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.282531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.283198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.283847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.284731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.287870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.288678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.289295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.298142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.302582 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ab76c9e0-4d25-4ccc-9202-2d22e5dcd2cd tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.506225 Aug 30 17:36:54.303410 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1443/2756] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:53 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:54.395576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.398801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47141bd6-d2c0-4f3b-a618-25ff021f2ad1", "tag": "79312d8d-4530-4a33-9863-3757aff5e83e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:54.405491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.417702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:54.419545 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2156c125-1d0e-4c92-af71-6f3387f325b6 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.160468 Aug 30 17:36:54.423136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.423920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.427745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.432139 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1314/2757] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:54 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:54.453726 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] Creating event network-changed:79312d8d-4530-4a33-9863-3757aff5e83e for instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 on n-h2-852771-11 Aug 30 17:36:54.462548 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-19491f24-433c-4522-9978-bb3df47df642 req-74347ff6-9435-415c-81a3-1bfb7de8b98a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067878 Aug 30 17:36:54.466511 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1444/2758] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:36:54.655389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:54.656102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:54.677342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.681422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.682144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.683595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.684754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.685210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.924071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:54.924867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 394b99da-ae93-48de-9ed7-645b787e57d7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:54.948638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.956504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.957225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.964130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.964789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.973296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.019140 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] HTTP exception thrown: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Request method failure captured: Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 HTTP/1.1 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpH1PLBC3AlR-u-mxUTO23ZBzV10CNNQ5xsvXbhGvUnFBybdW42BN1NVgOApRiu9Xhf3cYiyvhyyiT65nBscxucXfAviqC2YZgPPNTraCtnvR0n0g6NJlc8Dft1vXetKox51SGmLh39BaX9716-x3V3PIfrrgPtbDdzNjE9aRx-3mo Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ccddc9927f7349a5a02e4fde9842dcde"}]}] Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0150130ff67243309f43d31bf80f45ef Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '394b99da-ae93-48de-9ed7-645b787e57d7'} Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:36:55.027262 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Returning 404 to user: Instance 394b99da-ae93-48de-9ed7-645b787e57d7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:36:55.031456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7bc2e4d-80e0-48e0-be51-cd0c28fe389e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7" status: 404 len: 111 microversion: 2.1 time: 0.109851 Aug 30 17:36:55.034974 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1445/2759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:54 2022] GET /compute/v2.1/servers/394b99da-ae93-48de-9ed7-645b787e57d7 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:36:55.050147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.050932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.059469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.063855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.064433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.065314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.065850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.067925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.123649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:55.345400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.351991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:55.366898 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-591e0d7b-3494-46a7-8500-dd82dd732e67 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.713896 Aug 30 17:36:55.367428 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1315/2760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:54 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:55.375896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:55.387825 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef118a7f-c7b8-4490-af77-f3abda77f510 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 204 len: 0 microversion: 2.1 time: 0.351301 Aug 30 17:36:55.389072 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1446/2761] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:55 2022] DELETE /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:55.400818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.401443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.412843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.413621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.424823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.426713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.427548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.427996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.428752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.429176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.429601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.430380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.431128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.432067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.432690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.433280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.580491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.597367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.599793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.601372 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-359d4d47-e571-4ccd-a443-a98c6c8bd173 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1334 microversion: 2.47 time: 0.231833 Aug 30 17:36:55.621029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1316/2762] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:55 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1334 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:55.627200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.628261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.648128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.649417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.650404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.651630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.652518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.653207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.857354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.881261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.886350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.891503 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ebf890b6-a068-40f7-a74c-c0b729896d7c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.500080 Aug 30 17:36:55.912085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1447/2763] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:55 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:55.923812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.927039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.947473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.950652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.951293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.952213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.952957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.953553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.059591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.067836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.068414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.069870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.071005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ff8a5981-ad52-4f92-b33b-1c132d78cd4f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.157456 Aug 30 17:36:56.071587 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1448/2764] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:55 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:56.090514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ef2891f-19fe-4eb0-a69f-ead9b57af21b tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1517 microversion: 2.1 time: 0.467942 Aug 30 17:36:56.091260 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1317/2765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:55 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1517 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:56.392321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:56.393508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:56.405910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.408432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.409100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.410460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.411174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.411793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.630886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:56.640518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:56.672950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.673789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.674551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.675988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.677324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.678022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.909948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.924430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.927014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.929242 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d6f3f61a-60a0-4213-9537-eec1ab9f018d tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1334 microversion: 2.47 time: 0.305759 Aug 30 17:36:56.930521 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1318/2766] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:56 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1334 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:56.950618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:56.951469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:56.963271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.965029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.966547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.970038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.970588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.971887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.100500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.137761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2425b97e-2a8d-405f-a9ab-6db306445c53 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1472 microversion: 2.1 time: 0.749499 Aug 30 17:36:57.140648 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1449/2767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:56 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1472 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:57.158366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:57.159440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:57.178303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.188880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.192910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.209954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.213933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.214966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.339391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.347909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.349493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.350669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc652a33-891a-4e9d-8d98-f41928252bba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.411863 Aug 30 17:36:57.351236 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1319/2768] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:56 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:57.384331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:57.385236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:57.397203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.403198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.403902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.404850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.406620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.408725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.474194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.532108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.534005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.535315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b8e9c83-a3a4-4096-a02c-381653d0cb7c tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.393487 Aug 30 17:36:57.536021 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1450/2769] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:57 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:57.636160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.647425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b40a276f-cacb-4ebc-bcf1-ecdd6773138f tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1517 microversion: 2.1 time: 0.269605 Aug 30 17:36:57.672596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1320/2770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:57 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:57.954073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:57.954795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:57.977827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.978328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.978765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.979646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.983551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.984047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.161948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:58.162814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:58.172423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.173190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.173845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.174764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.175421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.176106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.355652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.376118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.377906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.382170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed664346-f23d-4052-90a1-4d65bdfaf2c4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1334 microversion: 2.47 time: 0.431933 Aug 30 17:36:58.387102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1451/2771] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:57 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1334 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:58.404829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:58.405740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:58.416709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.417780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.424661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.427093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.428542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.429156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.749753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.763923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.767980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.774356 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37aeb9db-e03f-4960-a85d-fce4a82b208e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.385702 Aug 30 17:36:58.777063 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1452/2772] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:58 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:58.783055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:58.784013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:58.813293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.813875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.814334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.818172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.818774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.822428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.956854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.974695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.978116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.980375 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e55daea1-fed2-48e2-afd0-e1f7f8d1e9ac tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.202113 Aug 30 17:36:58.980707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.997289 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1453/2773] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:58 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:59.002170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63c8a38a-c005-4bfc-916c-e803d9b74af6 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.833957 Aug 30 17:36:59.002400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:59.003015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:59.003548 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1321/2774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:58 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:36:59.027695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.028196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.028637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.029359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.029815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.030429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.271755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:59.283165 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9538fc4a-b7e5-4805-bc58-be87161fab8e tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1517 microversion: 2.1 time: 0.284404 Aug 30 17:36:59.283998 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1454/2775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:58 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1517 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:59.417687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:59.418196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:59.433565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.435332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.437287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.438797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.441909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.443610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.712385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:59.729490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:59.731586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:59.733050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e12e7c6c-06b1-45ef-8892-603bdeb8347e tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1355 microversion: 2.47 time: 0.320325 Aug 30 17:36:59.734705 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1322/2776] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:59 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1355 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:36:59.760772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:59.764395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:59.779959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.781599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.782209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.785310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.786154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.786961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.803057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:59.803720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:59.818561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.821458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.822690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.828724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.829294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.833887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.952124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:59.984854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:36:59.985317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:36:59.985969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:36:59.986793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:36:59.987363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:37:00.148834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.166502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.167015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.167466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.168214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.168674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.169105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.170849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.186489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.196192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.199460 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8eae29ff-a1ef-44e2-a42d-a5f1e8a0c86c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.402262 Aug 30 17:37:00.205424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1323/2777] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:36:59 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:00.210598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.211210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.238244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.244194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.247674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.248684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.249371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.252003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.284101 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c6981fe-ae3f-4953-8a72-2bdc66ae37f8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "POST /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4/action" status: 202 len: 1077 microversion: 2.47 time: 0.526332 Aug 30 17:37:00.287066 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1455/2778] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:36:59 2022] POST /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4/action => generated 1077 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 17:37:00.306195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.307012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.318012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.318803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.320012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.322879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.323598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.325532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.415421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.433925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.441319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.454371 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4050059e-ac89-4fcc-9732-c8f38f4df583 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.247813 Aug 30 17:37:00.455014 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1324/2779] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:00 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:00.471988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bc3b69-9072-4e4f-966b-d252862496b4", "name": "network-vif-deleted", "tag": "55de5b34-44fd-4c57-8174-eaa6bbb2d7cf"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:00.511895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.512671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.513264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.529765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:00.542924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] Creating event network-vif-deleted:55de5b34-44fd-4c57-8174-eaa6bbb2d7cf for instance 15bc3b69-9072-4e4f-966b-d252862496b4 on n-h1-852771-11 Aug 30 17:37:00.559842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ae71ee6b-680c-41f0-b741-45d4543c9bd7 req-936ad284-b4b2-4710-970c-c0f9332e091c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086951 Aug 30 17:37:00.561089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:00.562263 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1325/2780] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:00.585127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.594704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.609989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.610790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.611937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.612822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.613452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.623167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.795612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.810047 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ff37096-efb8-4be1-96a5-8cfd3cf9e6d9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.521531 Aug 30 17:37:00.811042 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1456/2781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:00 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:00.822207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.824598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.839636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.841290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.843288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.844184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.847706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.848373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.853384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.866183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.869719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:00.870954 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-149fb538-552e-4164-a427-3db747dc655b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.307203 Aug 30 17:37:00.871614 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1326/2782] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:00 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:00.922640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.923225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.923708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.924176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lazy-loading 'fault' on Instance uuid 15bc3b69-9072-4e4f-966b-d252862496b4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:01.003246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0150130ff67243309f43d31bf80f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccddc9927f7349a5a02e4fde9842dcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.015961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9dae45e-e53a-4e88-b1d4-da3fb0ca5cf4 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 200 len: 1311 microversion: 2.1 time: 0.202075 Aug 30 17:37:01.031744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1457/2783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:00 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:01.229517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:01.230124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:01.247064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.248438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.249437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.250334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.253860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.258457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.478732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:01.480008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:01.498800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.499464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.500098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.500910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.505559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.506297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.630830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:01.701654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.732128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.735154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.739898 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dbeb44dc-99a6-43db-9d4f-8a77dc311377 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.265561 Aug 30 17:37:01.759625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1458/2784] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:01 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:01.835351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:01.836890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:01.850087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.851242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.851948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.852913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.857170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.857952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.904295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.919854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.921948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:01.927251 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a1fd1dd-15a9-41ed-b838-17da6e3a6e1e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.698044 Aug 30 17:37:01.931263 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1327/2785] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:01 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:01.946341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:01.947214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:01.960023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.965010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.966125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:01.967027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:01.969267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:01.969902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.105567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:02.119576 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d48cb83-c0db-42c9-906a-3cda08be4ae9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.288539 Aug 30 17:37:02.121416 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1459/2786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:01 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:02.135935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:02.136748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] [instance: 15bc3b69-9072-4e4f-966b-d252862496b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:02.156452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.159720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.160462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.164406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.165122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.165687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.187026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:02.201641 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] HTTP exception thrown: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. Aug 30 17:37:02.203319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Request method failure captured: Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 HTTP/1.1 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkpH1PLBC3AlR-u-mxUTO23ZBzV10CNNQ5xsvXbhGvUnFBybdW42BN1NVgOApRiu9Xhf3cYiyvhyyiT65nBscxucXfAviqC2YZgPPNTraCtnvR0n0g6NJlc8Dft1vXetKox51SGmLh39BaX9716-x3V3PIfrrgPtbDdzNjE9aRx-3mo Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ccddc9927f7349a5a02e4fde9842dcde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ccddc9927f7349a5a02e4fde9842dcde"}]}] Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ccddc9927f7349a5a02e4fde9842dcde Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1575780812 Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0150130ff67243309f43d31bf80f45ef Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServerFiltersTestJSON-1575780812-project Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '15bc3b69-9072-4e4f-966b-d252862496b4'} Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:02.208248 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. Aug 30 17:37:02.212032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:02.212444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:02.212444 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66e296fa-ced0-42f9-8970-70a924246429 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.277721 Aug 30 17:37:02.217208 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1328/2787] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:01 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:02.218712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] Returning 404 to user: Instance 15bc3b69-9072-4e4f-966b-d252862496b4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:02.219924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73c6a34f-c61c-4718-9c19-a0bd0845eb18 tempest-ListServerFiltersTestJSON-1575780812 tempest-ListServerFiltersTestJSON-1575780812-project] 10.222.0.50 "GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4" status: 404 len: 111 microversion: 2.1 time: 0.094270 Aug 30 17:37:02.221290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1460/2788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:02 2022] GET /compute/v2.1/servers/15bc3b69-9072-4e4f-966b-d252862496b4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:37:02.291142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-unplugged", "status": "completed", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:02.316168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.317190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.317969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.388700 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] Creating event network-vif-unplugged:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:37:02.406482 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a606bd56-c446-4203-a0fe-4d75842b203a req-dfec60fc-0e36-4b73-8e65-96a3e2a8ca14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120190 Aug 30 17:37:02.414133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1329/2789] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:02.776533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:02.776533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:02.825154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.829675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.831792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.849066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.852413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.856606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.954616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:02.955653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:02.980961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.981537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.981898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:02.982619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:02.983065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:02.996546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:03.182762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.198755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.233469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.235118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efd521dd-4463-4f0f-84a9-5cdbb32f96ab tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.470398 Aug 30 17:37:03.247359 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1461/2790] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:02 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:03.269396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:03.272271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:03.293233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:03.294010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:03.299732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:03.304254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:03.306028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:03.309167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:03.546154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.562061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.565054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.568655 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac5737a0-09b7-4cb3-86e1-b665da1ebfac tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.618020 Aug 30 17:37:03.570065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1330/2791] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:02 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:03.580751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:03.581708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:03.594287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:03.596207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:03.597635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:03.599773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:03.600474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:03.601106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:03.815418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.839836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.841654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.842902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a8e3cec-bcef-42a7-b209-0b5775536d3c tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.271651 Aug 30 17:37:03.843473 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1331/2792] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:03 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:03.887171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:03.899735 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0f91c71d-0ada-42b5-8bc5-fab01d9dcaf9 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.643822 Aug 30 17:37:03.913657 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1462/2793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:03 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:04.268916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:04.269553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:04.292758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.294559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.295307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:04.296334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.296954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.297558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:04.463619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:04.474958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:04.476776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:04.480062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d5b7da4-7797-4819-a1a0-75b6afd9c13f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.221227 Aug 30 17:37:04.491534 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1332/2794] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:04 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:04.598729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:04.599653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:04.638706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.639421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.642900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:04.643793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.644290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.644728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:04.885472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:04.886398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:04.895722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.896690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.897826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:04.898730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:04.899346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:04.899986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.037195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.045046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:05.060143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.066041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.069631 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ecd38859-5948-40a1-b992-a93239156994 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.197952 Aug 30 17:37:05.071552 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1333/2795] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:04 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:05.095960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:05.096957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:05.110656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:05.111683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:05.112281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.113182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:05.115064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:05.115834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.223918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.241323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.242827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.244050 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54ea9004-9b77-46a5-8cce-a138f9aef83a tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.651263 Aug 30 17:37:05.244811 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1463/2796] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:04 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:05.343787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.357438 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3c083bb-f97c-4935-b373-2275352d23d2 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.265889 Aug 30 17:37:05.358662 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1334/2797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:05 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:05.506174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:05.506798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:05.523942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:05.524446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:05.524892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.525611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:05.526072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:05.526505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.595845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-plugged", "status": "completed", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:05.617692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:05.618187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:05.618643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:05.648793 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] Creating event network-vif-plugged:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:37:05.654166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-28fb5294-ec3f-4348-b192-714cc03ebd02 req-dd9a7cb2-a616-4fac-8ccd-90bcb3107e54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064956 Aug 30 17:37:05.655370 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1335/2798] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:05.760846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.784066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.789250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:05.793651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc12ac7f-97e2-4280-a035-961262818f35 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.290725 Aug 30 17:37:05.799467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1464/2799] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:05 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:06.097242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:06.101015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:06.112413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.113262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.114012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.115172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.115919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.116698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.239742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.255893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.260494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.268504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1980c12f-878c-4a10-a190-94d741ad4d98 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.177011 Aug 30 17:37:06.285260 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1336/2800] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:06 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:06.285708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:06.285708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:06.296884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.299122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.300041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.303571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.304237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.304955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.384205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:06.385538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:06.397485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.398828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.400124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.401190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.401920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.402593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.679999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.695855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5fc9d014-cb52-456f-8d17-ecde859e3142 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1478 microversion: 2.1 time: 0.318133 Aug 30 17:37:06.699065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1337/2801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:06 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1478 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:06.822714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:06.824064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:06.830896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.841736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.842226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.848999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:06.849710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:06.850619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:06.922364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.937654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.940717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.943209 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb34aa1b-2b95-49f0-b975-f7e8b784eb2b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.676139 Aug 30 17:37:06.944377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1465/2802] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:06 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:06.959612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.971147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.977179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:06.979448 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-339642d3-f8e3-4979-a178-ebfea79c453e tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.160614 Aug 30 17:37:06.980227 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1338/2803] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:06 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:07.206213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1331555231", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:07.298325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:07.306939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] validate_networks() for [('b04f80f1-00e2-4aae-9f21-9d1a2fe06163', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:37:07.308265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:07.328052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.328587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.329174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:07.337225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.337711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.338151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:07.441054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:07.456013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:07.459239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:07.462911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76c8e13e-ba71-4ea6-8998-14ef0d824346 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.168607 Aug 30 17:37:07.464444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1339/2804] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:07 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:07.721173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:07.722062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:07.729401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.730181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.730794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:07.731759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.732410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.732998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:07.923420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:07.934939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fea9311b-fc82-45b0-9aa5-e90caf6671c3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1463 microversion: 2.1 time: 0.217559 Aug 30 17:37:07.948240 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1340/2805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:07 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:07.974357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:07.974981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:07.983540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.984155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.984810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:07.985530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:07.986983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:07.987712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.200769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.214279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.216237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.217903 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aaceeeef-e290-4b62-a6e0-aed9f23510c8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.254690 Aug 30 17:37:08.218914 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1341/2806] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:07 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:08.225167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:08.227782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:08.237239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.238263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.239134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.240351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.240915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.241457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.326321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:37:08.326933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:37:08.327211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:37:08.327679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:37:08.328100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:37:08.353863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.354358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.354804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.355595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.356054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.356492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.395259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Getting quotas for project a449867d5cce467aa908bc70916ac4ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:08.409657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Getting quotas for user f4d4aec674684b42a0267356b8bfea00 and project a449867d5cce467aa908bc70916ac4ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:08.418959 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7e60125-5e0b-4889-8b40-fd1b6b56e29a tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 0 microversion: 2.1 time: 0.197796 Aug 30 17:37:08.423859 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1342/2807] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:37:08 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:37:08.436840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:37:08.437995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:08.440528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:37:08.443112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:08.462036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.462542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.462987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.466411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.466896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.467341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.543020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66e9e38c-71a2-472b-b428-1ca102f1fb42 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595011 Aug 30 17:37:08.545277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1466/2808] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:37:08.555370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:08.557371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:08.576337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.578133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.579919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.581588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.582281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.585504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.685499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.689230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.690882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.692321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lazy-loading 'fault' on Instance uuid 242cced2-dca9-4c9e-bc27-3e8abdd1848e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:08.698720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.712261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.719555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:08.722984 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8bc3edd-c77f-426e-9d3a-fb2d17516840 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1365 microversion: 2.57 time: 0.295861 Aug 30 17:37:08.725440 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1343/2809] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:08 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:08.738412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:08.741778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:08.775562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.777607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.778170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:08.781615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:08.782392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:08.799653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.102901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:09.124114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:09.128833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:09.140086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b531492f-be73-494b-b62c-57100c7e0696 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.405421 Aug 30 17:37:09.141489 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1344/2810] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:08 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:09.165490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfccbf72-79cb-4233-b0c9-9fbdcb1198c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:09.166458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfccbf72-79cb-4233-b0c9-9fbdcb1198c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:09.294433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfccbf72-79cb-4233-b0c9-9fbdcb1198c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:09.308220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfccbf72-79cb-4233-b0c9-9fbdcb1198c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1217 microversion: 2.1 time: 0.154447 Aug 30 17:37:09.310837 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1345/2811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:09 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:09.328708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:09.329480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:09.338051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.338597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.339031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.339972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.340585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.341170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.429141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-744bea67-3397-4df3-8000-78e950fa33b4 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1599 microversion: 2.1 time: 0.881491 Aug 30 17:37:09.431923 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1467/2812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:08 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1599 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:09.458489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:09.462628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:09.487100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.487763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.488284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.489479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.490134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.490567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.713289 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-abadbb8e-3301-4b3d-bf12-fc4b7ebb9857 tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action" status: 202 len: 0 microversion: 2.1 time: 0.261913 Aug 30 17:37:09.715182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1468/2813] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:37:09 2022] POST /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:37:09.736027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:09.737829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:09.749342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.751205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.752004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:09.755407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:09.757802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:09.759171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:10.154792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:10.174275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:10.181846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:10.189034 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b8a4cb9-5f3a-4246-a9cc-5ad2514df723 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.866137 Aug 30 17:37:10.194560 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1346/2814] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:09 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:10.210592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:10.211628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:10.233751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:10.235457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:10.237230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:10.241945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:10.246047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:10.248458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.002117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:11.009693 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-099f0cdd-3dc5-4e69-8e5d-dfb7d1b6a8ea tempest-ServersAdminTestJSON-1725554763 tempest-ServersAdminTestJSON-1725554763-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1616 microversion: 2.1 time: 1.278991 Aug 30 17:37:11.031386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1469/2815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:09 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1616 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:11.039071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:11.039694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:11.071515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.072016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.072463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.073205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.078396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.081083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.261845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.279677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.281446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.282868 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b406b266-2fe7-41ac-8d24-ae205eb19d68 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.250147 Aug 30 17:37:11.283644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1470/2816] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:11 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:11.293234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:11.294120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:11.307025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.311040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.311828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.312743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.315241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.319127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.331949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.342517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.355168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.358855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27da6e07-833e-492a-9dd9-ab46918b2c0b tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1371 microversion: 2.57 time: 1.162525 Aug 30 17:37:11.359642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1347/2817] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:10 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1371 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:11.375130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:11.378234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:11.406279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.412319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.414840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.417576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.418291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.421184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.470398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:11.541838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:11.556408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dadb7e19-4f05-4e82-a799-10ba9bb73e1e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1269 microversion: 2.1 time: 0.270721 Aug 30 17:37:11.577135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1471/2818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:11 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1269 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:11.588297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:11.589410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:11.599984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.606887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.607437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.613170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:11.614369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.614909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.615493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.662307 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ab9ee7a-d89d-4fd3-947b-3c4869d4336e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "DELETE /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 204 len: 0 microversion: 2.1 time: 0.299510 Aug 30 17:37:11.667232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1348/2819] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:37:11 2022] DELETE /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:37:11.680197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:11.680933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:11.709604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.710093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.710534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.711263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:11.711747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:11.712180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:11.723957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:12.135307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.147352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.149037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.150275 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95493100-f55f-499a-8d7d-d60c2959b7be tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.572080 Aug 30 17:37:12.150854 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1472/2820] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:11 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:12.317288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:12.318308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:12.327265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.328138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.328802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.329870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.330528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.331145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.563647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.578112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45fcead5-8202-49bc-baac-0fe848b9ed90 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1468 microversion: 2.1 time: 0.904230 Aug 30 17:37:12.582892 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1349/2821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:11 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1468 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:12.596038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:12.596994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:12.612853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.613343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.618251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.619381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.620067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.620661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.780118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.793484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.800391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.806192 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d46bd16e-09d9-42f5-9dfb-0ad20a8f3f6a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.497328 Aug 30 17:37:12.810476 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1473/2822] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:12 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:12.821486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cafd98f-7d60-455b-9d0b-406e7d81bf8f", "name": "network-vif-unplugged", "status": "completed", "tag": "0020fda5-9556-48f0-bc6b-3f28866810a1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:12.851753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.855838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.856537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.859786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.876928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.878436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:12.880052 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a50095c-fea0-4f17-a312-ee2083562c81 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1371 microversion: 2.57 time: 0.295812 Aug 30 17:37:12.881296 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1350/2823] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:12 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:12.885364 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] Creating event network-vif-unplugged:0020fda5-9556-48f0-bc6b-3f28866810a1 for instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f on n-h2-852771-11 Aug 30 17:37:12.893326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:12.894346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:12.899591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3f669439-f601-4b02-b868-2432c6fc50a6 req-ec7a4ff1-d56f-4b7c-819c-c3d5fb04ae44 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087469 Aug 30 17:37:12.902494 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1474/2824] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:12.911527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.912439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.914213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:12.916371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:12.917191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:12.919256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.061722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:13.073381 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd65f659-7fe5-495e-9b6d-40ba81920b54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1275 microversion: 2.1 time: 0.191091 Aug 30 17:37:13.084386 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1351/2825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:12 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:13.175676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:13.178017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:13.188538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.189038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.189481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.190202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.190678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.191088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.428516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:13.438247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:13.444431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:13.445736 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a88627d-6414-46a8-87f6-b6c7a28ba41f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.275370 Aug 30 17:37:13.446347 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1475/2826] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:13 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:13.605675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:13.606288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:13.614327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.615144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.615787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.616641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.617383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.618693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.836353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:13.837215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:13.851350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.852156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.852782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:13.857131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:13.858913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:13.859652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.127265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.158483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.161742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.163727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9da2c43-5d64-42a5-98f4-205e95fa70f4 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.331511 Aug 30 17:37:14.175758 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1476/2827] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:13 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:14.187829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:14.188519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:14.204872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.205516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.206030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.206862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.208063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.208550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.366112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.379935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.381847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.385004 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e27451c-532b-4229-8aad-a2b3eb9904f8 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1356 microversion: 2.57 time: 0.201311 Aug 30 17:37:14.386279 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1477/2828] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:14 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:14.392520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:14.394334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:14.402517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.403465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.404331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.406190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.407184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.416529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.516656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.523010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69b4562f-328f-497c-a1f6-95982ef0ad60 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1275 microversion: 2.1 time: 0.135258 Aug 30 17:37:14.523757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1478/2829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:14 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:14.530280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:14.531067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:14.538251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.539252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.540093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.541172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.541888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.542413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.574259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:14.695175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b577f145-cd74-40e2-a38a-73a5a3b48e15 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "DELETE /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 204 len: 0 microversion: 2.57 time: 0.169052 Aug 30 17:37:14.696443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1479/2830] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:37:14 2022] DELETE /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:37:14.703745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:14.705882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:14.714970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.716933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.719153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.724665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.727898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.728884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.890440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:14.903693 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-880a2fd9-1a82-4385-abcc-1ada16ec6e1e tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1468 microversion: 2.1 time: 1.301929 Aug 30 17:37:14.907210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1352/2831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:13 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1468 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:14.924424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:14.925318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:14.932527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.933274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.934097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:14.934963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:14.935604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:14.936176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.025204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.044096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.046662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.048782 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a145017-ece0-4935-b189-a82f6430b604 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.350439 Aug 30 17:37:15.049770 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1480/2832] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:14 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:15.084360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cafd98f-7d60-455b-9d0b-406e7d81bf8f", "tag": "0020fda5-9556-48f0-bc6b-3f28866810a1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:15.100361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:15.109299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.110044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.110642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.129276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] Creating event network-changed:0020fda5-9556-48f0-bc6b-3f28866810a1 for instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f on n-h2-852771-11 Aug 30 17:37:15.135327 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-da7f75b5-5daa-4410-b9c9-51e58d0baecc req-c9483baf-1904-48f0-be2d-535353acfdb8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054919 Aug 30 17:37:15.136325 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1481/2833] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:15.198881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:15.200392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:15.221097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.221957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.222681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.224417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.225527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.226355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.295720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.314182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.318867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.329535 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1cc7a5d1-17ba-4fa0-8a35-6f9a88d69a9f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1362 microversion: 2.57 time: 0.413638 Aug 30 17:37:15.330977 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1353/2834] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:14 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:15.445447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.463200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.469191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.474996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efe57ca8-9f1e-45f2-868d-56bb2632f6e9 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.287287 Aug 30 17:37:15.476838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1482/2835] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:15 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:15.549591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:15.551306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:15.566186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.567465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.568331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.569292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.570080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.570959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.899875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:15.908933 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7f997d8-91c2-4766-ab56-7f9722fe3c97 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1275 microversion: 2.1 time: 0.363837 Aug 30 17:37:15.912561 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1354/2836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:15 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:15.931206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:15.931875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:15.947619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.948415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.949025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:15.951124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:15.955511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:15.956837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.087553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:16.088556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:16.102501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.107409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.108148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.110028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.114988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.115880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.455207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.465577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ff5789d-6bea-484b-90bc-c65a1d8074e4 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1468 microversion: 2.1 time: 0.541378 Aug 30 17:37:16.466306 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1483/2837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:15 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1468 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:16.474157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:16.475007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:16.482471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.483261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.484065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.485204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.485881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.486767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.600713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.614456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.618451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.624774 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0f84e556-4aed-4927-9003-90ec2a017a7f tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1362 microversion: 2.57 time: 0.156355 Aug 30 17:37:16.626322 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1484/2838] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:16 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:16.636741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:16.639789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:16.656189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.658424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.662756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.664818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.666986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.667772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.749418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.761529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.781988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.786077 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-540135ec-9c33-4be0-a407-c4b7fd4cbc55 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.714098 Aug 30 17:37:16.787083 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1355/2839] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:16 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:16.802936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.823570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.826692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:16.829025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e09bb19-971f-4155-838e-d5bc6cd9a979 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.200009 Aug 30 17:37:16.840833 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1485/2840] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:16 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:16.940508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:16.942977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:16.965413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.971763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.972453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:16.973943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:16.978359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:16.979075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.208383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d9b699-9baa-4c5b-ba0e-0f004e7fd554", "name": "network-vif-deleted", "tag": "c1e872d3-9e18-4254-b7d1-799c0086c649"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:17.230544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.231032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.231498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.241923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:17.266467 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] Creating event network-vif-deleted:c1e872d3-9e18-4254-b7d1-799c0086c649 for instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 on n-h2-852771-11 Aug 30 17:37:17.289117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-491c971e-fd21-4f1c-9523-06ff0f90e3a5 req-9852f128-b5d2-4a73-ba72-812c41b0a8ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085019 Aug 30 17:37:17.290023 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1486/2841] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:17.489779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:17.491197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:17.515969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.518018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.518470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.519206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.520363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.520975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.626614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.628075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.630018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.630824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lazy-loading 'fault' on Instance uuid 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:17.854559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:17.865020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a91eaa3-4b49-4599-bc4e-313ce01c9dcc tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 200 len: 1304 microversion: 2.1 time: 0.378296 Aug 30 17:37:17.866018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1487/2842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:17 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 1304 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:17.877625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:17.878419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:17.894270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.895044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.895683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:17.898150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:17.901044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:17.901781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.169851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.182160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.183672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '858d6fad19f440b7a2e4c71540d44efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639bc23579034376bd2c131c30d6f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.189773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e095bc3d-117d-4b7b-98a9-3b7df97d1d83 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 200 len: 1362 microversion: 2.57 time: 0.319486 Aug 30 17:37:18.210018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1488/2843] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:17 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:18.217522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:18.219997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:18.238092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.240757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.241345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.243519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.244838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.245281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.373856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:18.382599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.390931 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be1b83b6-bc04-44d1-b030-d5330a7d4046 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 1.462301 Aug 30 17:37:18.395887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1356/2844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:16 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:18.400775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:18.408175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:18.419857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:18.440305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.441164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.441999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.443587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.445888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.446923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.596602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.607809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.612829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.616665 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-504d6250-a8e8-4da2-9646-0a8a4f4ced2e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.405528 Aug 30 17:37:18.619224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1489/2845] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:18 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:18.885375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:18.885923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 34d9b699-9baa-4c5b-ba0e-0f004e7fd554] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:18.899024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.901105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.904174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.907790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.908762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:18.913282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:18.914770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:18.923236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.939531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:18.943543 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7529b84a-3592-40f0-80d4-2deedad943de tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.546412 Aug 30 17:37:18.954122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] HTTP exception thrown: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Request method failure captured: Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 HTTP/1.1 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDko8NBY9Ancr2AKXapqzW2kcCEJse9yNnJHJSDgvfwt0xkYT4LbNOs1AErpXQ6U92lvtFAW9jCg42rDmYX4W8_rL9LcXe_osXcNkR-3ovdQJxBWzY88_XNGU2wIozW0m3TyaQSVaEuJfX31GRH7PVimzAtrRhB0qhDmxUA9eawVx_XU Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6e41fbe5fc754f1886dcd6a270efe36f"}]}] Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2ec4dfcb09b45d7b8fe7319077cc12a Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '34d9b699-9baa-4c5b-ba0e-0f004e7fd554'} Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:18.959963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. Aug 30 17:37:18.963812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:18.965896 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1357/2846] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:18 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:18.966463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Returning 404 to user: Instance 34d9b699-9baa-4c5b-ba0e-0f004e7fd554 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:18.969126 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d2543908-6747-40f2-bb50-d09d8e482900 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554" status: 404 len: 111 microversion: 2.1 time: 0.086185 Aug 30 17:37:18.971394 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1490/2847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:18 2022] GET /compute/v2.1/servers/34d9b699-9baa-4c5b-ba0e-0f004e7fd554 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:37:18.981420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:18.983363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:19.002065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.003587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.004271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.007139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.007955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.008557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.085753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:19.221360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:19.222427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] [instance: 77298c40-6bcd-492b-b18c-08a5c1d9ae23] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:19.237199 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0e4d63c-8ad4-4af6-8018-7180c01c4dee tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 204 len: 0 microversion: 2.1 time: 0.259482 Aug 30 17:37:19.240881 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1358/2848] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:37:18 2022] DELETE /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:37:19.250781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:19.252715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:19.257946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.258872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.259508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.260434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.260575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.260939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.261479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.262294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.262752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.262886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.263357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.272050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.308599 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] HTTP exception thrown: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. Aug 30 17:37:19.309171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Request method failure captured: Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 HTTP/1.1 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkqdTNyPF83VuKhB7hnoiwGtCjjlSsq83T2b4V8Y4jDVYGWsNwMfsryJ2HOONlSDsyDQ3Q3ZJeBU56-sg2o53-Sf9aGKF-pmiPuPnHEh79RPfFqvfos3ma4b3jPJ94FYvO6uwcHv-SLQSibKhkbzXDNKAgaZ8bdM3ResPDntkrmFa_I Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.57 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 639bc23579034376bd2c131c30d6f6e6 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerShowV257Test-1805976775 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/639bc23579034376bd2c131c30d6f6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/639bc23579034376bd2c131c30d6f6e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/639bc23579034376bd2c131c30d6f6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_639bc23579034376bd2c131c30d6f6e6"}]}] Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerShowV257Test-1805976775 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 639bc23579034376bd2c131c30d6f6e6 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerShowV257Test-1805976775 Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerShowV257Test-1805976775-project Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 858d6fad19f440b7a2e4c71540d44efc Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerShowV257Test-1805976775-project Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '77298c40-6bcd-492b-b18c-08a5c1d9ae23'} Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:19.313791 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. Aug 30 17:37:19.318903 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:19.325830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] Returning 404 to user: Instance 77298c40-6bcd-492b-b18c-08a5c1d9ae23 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:19.327911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e5a6f2b-8e59-4b0f-8abe-616f10dd3835 tempest-ServerShowV257Test-1805976775 tempest-ServerShowV257Test-1805976775-project] 10.222.0.50 "GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23" status: 404 len: 111 microversion: 2.57 time: 0.111748 Aug 30 17:37:19.328977 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1491/2849] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:19 2022] GET /compute/v2.1/servers/77298c40-6bcd-492b-b18c-08a5c1d9ae23 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:37:19.417464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:19.418439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:19.435762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.436513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.437167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.438127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.438783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.439505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.745415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:19.759221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ac859fe-24b1-4c33-a53d-eeb5d2e5d718 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.346351 Aug 30 17:37:19.765483 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1492/2850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:19 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:19.773640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:19.774293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:19.786182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.786829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.787286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:19.789364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:19.790049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:19.790675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:20.107623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.131464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.147056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.148660 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c7ce058-ee62-4f92-98fd-0108a1da8338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.382037 Aug 30 17:37:20.149476 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1493/2851] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:19 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:20.180099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:20.181149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:20.198936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:20.199471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:20.201638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:20.203882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:20.204401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:20.206488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:20.413190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.429861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.431602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.435608 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34cbea8d-2f99-4c7b-b8fd-a5385771c131 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.285264 Aug 30 17:37:20.451575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1494/2852] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:20 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:20.475157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:20.497243 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e73005cc-48a0-45bb-a817-7c575a9346d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1469 microversion: 2.1 time: 1.253789 Aug 30 17:37:20.498996 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1359/2853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:19 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1469 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:20.563080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:20.587031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:20.595799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:20.597800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:20.621682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] Creating event network-changed:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h1-852771-11 Aug 30 17:37:20.626784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a11bd318-983c-4d66-b32f-3e9b8a0be0b4 req-7a9baf10-e86f-4f37-b41f-39ed4a665d03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067827 Aug 30 17:37:20.628697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1495/2854] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:20.784822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:20.785472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:20.797684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:20.799027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:20.800636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:20.804957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:20.805566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:20.807254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.174949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:21.176052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:21.193503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.194005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.194470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.195205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.199844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.201541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.606462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.633566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.639433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.644046 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7fb9d4b-64ee-4bdf-916f-89dbebe82fcf tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.472688 Aug 30 17:37:21.647059 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1496/2855] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:21 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:21.659120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:21.668920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:21.684885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.685391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.685836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.690861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.693057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.693728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.751762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.764342 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c890651b-c8b4-4955-ab90-ffb6371a4a18 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.983278 Aug 30 17:37:21.764991 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1360/2856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:20 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:21.770276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:21.781932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:21.809092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.811581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.812229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.814854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.815553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.820014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.895721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.918353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.921147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.924921 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0fd71cc-48c1-413a-bd94-cb07efd3b931 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.276052 Aug 30 17:37:21.930430 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1497/2857] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:21 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:22.671390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:22.672210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:22.686667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.689419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.689949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:22.692156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.695976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.696627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:22.767119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:22.778270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54fd3040-ab53-4079-837b-04ca98405a41 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1469 microversion: 2.1 time: 1.012209 Aug 30 17:37:22.784066 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1361/2858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:21 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1469 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:22.797544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:22.800226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:22.824654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.825627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.828134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:22.831585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.833007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.835588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.114434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.132508 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89ed2b85-765a-4a74-b7ef-8410b5b170ce tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.346981 Aug 30 17:37:23.133371 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1362/2859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:22 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:23.138399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:23.139400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:23.157514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.158282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.159023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.159985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.161180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.161755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.173527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.183270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.188877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.195871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-319ee90e-dbb2-47ae-a357-bb0ac95c9cf6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.527575 Aug 30 17:37:23.202316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1498/2860] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:22 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:23.328067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.345719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.347651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.349090 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30f3fa79-a538-441f-af9f-8c38095b64c0 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.214469 Aug 30 17:37:23.350190 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1363/2861] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:23 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:23.494605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49998e5-567e-46db-907f-f0b481d2247a", "name": "network-vif-deleted", "tag": "97cd37f5-3dba-4d84-b226-9ae163d96ad4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:23.521797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.522189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.522618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.565208 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] Creating event network-vif-deleted:97cd37f5-3dba-4d84-b226-9ae163d96ad4 for instance e49998e5-567e-46db-907f-f0b481d2247a on n-h2-852771-11 Aug 30 17:37:23.574005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bf5848bd-7c00-4ca1-af36-5598ce56617a req-99e0e6b6-30d4-4b41-8d23-582de26a1c4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085185 Aug 30 17:37:23.578421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1499/2862] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:23.807071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:23.807700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:23.826984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.827500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.827999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.830455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.831225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.832671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.839862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:23.904677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.905399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.910293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.911305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lazy-loading 'fault' on Instance uuid e49998e5-567e-46db-907f-f0b481d2247a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:24.079179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:24.091438 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-af7ca4fb-1167-4f87-9e0a-e52bac4e4712 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 200 len: 1303 microversion: 2.1 time: 0.287960 Aug 30 17:37:24.095393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1364/2863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:23 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:24.154669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:24.155375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:24.171005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.171518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.176589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.177782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.178412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.179012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.222305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:24.223186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:24.241458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.241965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.242407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.243127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.243619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.244055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.526447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:24.545340 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc780ecc-559c-4be6-99ad-8fdc9ace0935 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.394700 Aug 30 17:37:24.548859 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1500/2864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:24 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:24.559358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:24.561662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:24.583412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.585310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.586848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.590298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.592852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.593520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.746422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:24.781636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:24.796339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:24.802207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c19684b7-2100-4bb8-b961-64956abbb5e5 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.249915 Aug 30 17:37:24.815511 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1501/2865] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:24 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:25.117772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:25.118934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: e49998e5-567e-46db-907f-f0b481d2247a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:25.130329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.132944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.135461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.140083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.141629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.142965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.203070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] HTTP exception thrown: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Request method failure captured: Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a HTTP/1.1 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDko8NBY9Ancr2AKXapqzW2kcCEJse9yNnJHJSDgvfwt0xkYT4LbNOs1AErpXQ6U92lvtFAW9jCg42rDmYX4W8_rL9LcXe_osXcNkR-3ovdQJxBWzY88_XNGU2wIozW0m3TyaQSVaEuJfX31GRH7PVimzAtrRhB0qhDmxUA9eawVx_XU Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6e41fbe5fc754f1886dcd6a270efe36f"}]}] Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2ec4dfcb09b45d7b8fe7319077cc12a Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e49998e5-567e-46db-907f-f0b481d2247a'} Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:25.206382 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Returning 404 to user: Instance e49998e5-567e-46db-907f-f0b481d2247a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:25.210664 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cff442f6-3f4c-4bb6-b016-9319c28e1d57 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a" status: 404 len: 111 microversion: 2.1 time: 0.095383 Aug 30 17:37:25.218887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1502/2866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:25 2022] GET /compute/v2.1/servers/e49998e5-567e-46db-907f-f0b481d2247a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:37:25.231743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:25.234531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:25.253276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.253819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.254891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.255689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.256155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.267467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.313176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:25.322582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:25.338914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:25.342008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:25.350572 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-551c350e-1304-4a3c-84c8-f71aea27648f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 1.131868 Aug 30 17:37:25.351582 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1365/2867] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:24 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:25.467819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9f55cc6-9b3e-4014-a056-df1f731cf0d5 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "DELETE /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 204 len: 0 microversion: 2.1 time: 0.246110 Aug 30 17:37:25.473828 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1503/2868] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:37:25 2022] DELETE /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:37:25.478434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:25.479256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:25.487137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.493422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.493973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.494737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.496079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.496675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.573810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:25.574520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:25.584376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.585624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.586932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.588587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.589273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.589771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.883186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:25.891056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:25.897849 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97d54680-e804-459b-9c54-1a4d0a81260e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.329138 Aug 30 17:37:25.903409 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1504/2869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:25 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:25.908713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:25.913813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:25.931659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.932492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.933257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.935007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:25.935758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:25.944380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.064592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.078935 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9a580df-1047-40ba-91cb-9411049b9556 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1469 microversion: 2.1 time: 0.604612 Aug 30 17:37:26.081256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1366/2870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:25 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:26.159094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.187466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.191266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.194055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3073df5-f199-4a1b-b5d7-653581283a84 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.289307 Aug 30 17:37:26.196927 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1505/2871] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:25 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:26.376568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:26.378206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:26.405183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.408696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.417489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.418335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.419537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.421760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.518155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8be49618-28f4-4604-bda9-847bf72c8630 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: .version_select at 0x7f2d9876f280>, body: {"keypair": {"name": "tempest-keypair-486761410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP1/Vyi5dziXZzC3r50dA19PMaYD+nK7XZFBF9dMLgC7JN+ZWk6B88Jo39KARHVRNl1bu19Tgt78XodUr0HyweF92HgHYh/IkayGof6Qf/CC1vUWeoB+bKf2vnJKH6zCA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:26.557648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8be49618-28f4-4604-bda9-847bf72c8630 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:26.566271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8be49618-28f4-4604-bda9-847bf72c8630 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:26.604328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8be49618-28f4-4604-bda9-847bf72c8630 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.455607 Aug 30 17:37:26.605622 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1367/2872] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:37:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:37:26.866825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.881542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.890836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.908952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24e1d9ac-6ce6-4d54-9021-9e366aec1b5f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1483 microversion: 2.25 time: 0.536263 Aug 30 17:37:26.913650 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1506/2873] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:26 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1483 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:26.933289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:26.933907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:26.956131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.958328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.958790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.963861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.964684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.965380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.104873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:27.106230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:27.134095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.135118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.140028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.143077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.148067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.151640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.639756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.649735 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88a46262-6c3e-4e85-851f-ffde10d7ec49 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1469 microversion: 2.1 time: 0.550874 Aug 30 17:37:27.653674 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1507/2874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:27 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1469 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:27.663438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:27.677581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:27.703715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.705064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.706605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.710318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.711418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.713055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.898556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.916795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.926514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.929346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aec69be0-6f13-4967-8163-ea3555d727a8 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.268848 Aug 30 17:37:27.949885 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1508/2875] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:27 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:27.963979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:27.980006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.981316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Searching by: {'deleted': False, 'project_id': '84ac52a6449e40999f9d74f115069bbb'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:37:27.997075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.008475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.010290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.010918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.012366 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69e40ae2-8401-4672-9d3c-54418f035139 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 1.092433 Aug 30 17:37:28.013892 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1368/2876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:26 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:28.015390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.020340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.021009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.032421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:28.035408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:28.057059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.062013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.065077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.066074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.068031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.068648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.111334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:37:28.208533 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1f07fc1e-cdd8-4ceb-9c53-44e5d8a33a68 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.256729 Aug 30 17:37:28.217923 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1509/2877] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:37:27 2022] GET /compute/v2.1/servers => generated 338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:28.224262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:28.237232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.239396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Searching by: {'deleted': False, 'project_id': '84ac52a6449e40999f9d74f115069bbb'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:37:28.255704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.257821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.260245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.262603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.265588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.268038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.391323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:37:28.509804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.519753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.520609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.521217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.717678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.746508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.758101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.765724 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99062705-f111-4ed2-aa36-50bf3d4be1b5 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1473 microversion: 2.25 time: 0.745336 Aug 30 17:37:28.769337 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1369/2878] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:28 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:28.782622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:28.784659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:28.795521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.800030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.801012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.804977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.805624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.809204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.995306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3557788-e24d-4b5d-ab40-3b50a0e688b9 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.775961 Aug 30 17:37:28.996542 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1510/2879] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:37:28 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:29.001451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-738624dc-88fb-4a31-bf67-ec58295c8f7a tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '.version_select at 0x7f2d98dcc5e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.012075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-738624dc-88fb-4a31-bf67-ec58295c8f7a tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.012854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-738624dc-88fb-4a31-bf67-ec58295c8f7a tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.013501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-738624dc-88fb-4a31-bf67-ec58295c8f7a tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.053311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-738624dc-88fb-4a31-bf67-ec58295c8f7a tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.048209 Aug 30 17:37:29.058069 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1511/2880] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 30 17:37:28 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:29.063108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.074409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:29.089397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.090764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.091420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.092524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.093193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.093831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.304635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.328517 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91863dcb-95b9-465b-ba71-849014b0c9d3 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1469 microversion: 2.1 time: 0.554384 Aug 30 17:37:29.331691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1370/2881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:28 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:29.342436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d574280-cbcb-460e-a765-628dddfa3c47 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.354115 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d574280-cbcb-460e-a765-628dddfa3c47 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020303 Aug 30 17:37:29.355945 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1371/2882] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:37:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:29.361148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.362259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:29.385106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.385612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.386227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.386756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.387210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.387670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.397128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.418094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.426729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.430913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-75b36450-4e6b-4a15-8c91-a16944b7a627 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.371442 Aug 30 17:37:29.435804 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1512/2883] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:29 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:29.462227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.462699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:29.499385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.504347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.505131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.506324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.513050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.514103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.918224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.935732 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f429ae2d-e24c-4976-aabe-d9df2502530d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.573099 Aug 30 17:37:29.937279 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1372/2884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:29 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:29.951689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.952213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:29.975329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.979097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.979766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.980698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.981854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.992230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.072478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:30.351133 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d7c088a-73ab-417a-96f3-bdee8ba943c4 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "DELETE /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 204 len: 0 microversion: 2.1 time: 0.412152 Aug 30 17:37:30.351781 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1373/2885] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:37:29 2022] DELETE /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:37:30.376772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] Lazy-loading 'services' on Instance uuid 1cafd98f-7d60-455b-9d0b-406e7d81bf8f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:30.383761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242cced2-dca9-4c9e-bc27-3e8abdd1848e", "name": "network-vif-deleted", "tag": "2a1e46ae-6706-4f9f-b47c-24b0db0181c7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:30.397117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.397653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.398876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.416958 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] Creating event network-vif-deleted:2a1e46ae-6706-4f9f-b47c-24b0db0181c7 for instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e on n-h2-852771-11 Aug 30 17:37:30.423856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57cb42d4-f8f7-4713-b126-1418edfcd74c tempest-LiveAutoBlockMigrationV225Test-921139107 tempest-LiveAutoBlockMigrationV225Test-921139107-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1965 microversion: 2.25 time: 0.985070 Aug 30 17:37:30.428479 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1513/2886] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:29 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1965 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:30.431408 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-027a5aff-f977-4f5c-ad09-e36b7d2eed00 req-b83c7921-cbab-4627-af1d-8f5f29f33a42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078594 Aug 30 17:37:30.432064 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1374/2887] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:30.438265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:30.439147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:30.442454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:30.446209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:30.447620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.448271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.448886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.450151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.450815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.451560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.484463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.485039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.486263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.489390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.494733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.498505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.582131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.582629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.583558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.584221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lazy-loading 'fault' on Instance uuid 242cced2-dca9-4c9e-bc27-3e8abdd1848e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:30.662711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:30.674219 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-062e3acd-e256-4d0c-b14c-8197f587b32f tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1303 microversion: 2.1 time: 0.243612 Aug 30 17:37:30.679717 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1514/2888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:30 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:30.700270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:30.700919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:30.708095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.708616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.709103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.709874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.710337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.710766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.759313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:30.935009 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-018e207f-164c-438b-9f2c-ddf3c25afcc8 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 204 len: 0 microversion: 2.25 time: 0.246826 Aug 30 17:37:30.936789 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1515/2889] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:37:30 2022] DELETE /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:37:30.954280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:30.955252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:30.976799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.980365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.980822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.984185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.984672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.988729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.113219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.130279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.144097 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a09935ec-4a79-4c80-9cd1-eaf5e4faac0e tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1713 microversion: 2.1 time: 0.709855 Aug 30 17:37:31.145205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1375/2890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:30 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1713 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:31.153450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "name": "network-vif-plugged", "status": "completed", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:31.162482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.164902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.166593 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91d53bfc-f9cb-42b2-b140-2eea7a66f4ea tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1364 microversion: 2.47 time: 0.228675 Aug 30 17:37:31.168595 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1516/2891] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:30 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:31.175021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:31.176559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:31.183110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.184298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.185112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.185732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.186275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.186985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.187620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.188643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.190317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.222267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] Creating event network-vif-plugged:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h1-852771-11 Aug 30 17:37:31.234497 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4e64c20e-6c5a-47c5-8c7b-fce78378604a req-1988a8cb-bd96-499c-a1f8-9fefd20e1c40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085632 Aug 30 17:37:31.240344 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1376/2892] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:31.251717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:31.255680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:31.270815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.271348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.271820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.272536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.272993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.273426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.606736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.631023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.632841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.634715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ca33d72-3ff9-4bc2-a0be-3d9a002ac97b tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1479 microversion: 2.25 time: 0.464045 Aug 30 17:37:31.636336 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1517/2893] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:31 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1479 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:31.704764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:31.705361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:31.714050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.714547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.714987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.715727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.716183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.716605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.893179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:31.894368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:31.904955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.906299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lazy-loading 'fault' on Instance uuid 242cced2-dca9-4c9e-bc27-3e8abdd1848e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:31.917843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:31.979204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ec4dfcb09b45d7b8fe7319077cc12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fbe5fc754f1886dcd6a270efe36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.989102 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfcea267-baa8-4491-90de-d2780abfd60a tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 200 len: 1303 microversion: 2.1 time: 0.290132 Aug 30 17:37:31.992232 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1518/2894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:31 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 1303 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:32.006248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1533540602", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59938744-e1cd-4152-9402-9a2134605439"}], "security_groups": [{"name": "tempest-securitygroup--294197294"}], "key_name": "tempest-keypair-486761410", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:32.181342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] validate_networks() for [('59938744-e1cd-4152-9402-9a2134605439', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:37:32.245058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:32.259064 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-072f5446-17dc-4548-a037-6a9bc483ec6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 1.014926 Aug 30 17:37:32.272214 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1377/2895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:31 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:32.284696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:32.285931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:32.292672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.293168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.293605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.294321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.294831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.295260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.939423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:37:32.940018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:37:32.940342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:37:32.940960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:37:32.942202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:37:32.954374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.954865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.955318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.956257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.956780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.957595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.974653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:32.974875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:32.980821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:32.987232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:32.990238 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c9a8bdb-735a-4b20-992a-64012251168b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1713 microversion: 2.1 time: 0.716074 Aug 30 17:37:32.993382 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1378/2896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:32 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1713 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:33.003117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:37:33.006609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:37:33.009077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:33.010402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:33.028796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.029919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.034619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.039924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.044250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.045439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.105745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe2a6dea-724e-4c8d-a7f9-c80640c0614b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.108961 Aug 30 17:37:33.106767 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1519/2897] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:37:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:37:33.112611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:33.113417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:33.123061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.123627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.124076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.126388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.126857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.127291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.259949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.275014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.276783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.277843 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ae91869-4e0f-468a-809f-2b062709ffe6 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1370 microversion: 2.47 time: 0.283473 Aug 30 17:37:33.283133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1379/2898] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:32 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:33.289871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:33.290500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] [instance: 242cced2-dca9-4c9e-bc27-3e8abdd1848e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:33.306088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.306590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.307034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.315764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.316849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.317402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.343655 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] HTTP exception thrown: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Request method failure captured: Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e HTTP/1.1 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDko8NBY9Ancr2AKXapqzW2kcCEJse9yNnJHJSDgvfwt0xkYT4LbNOs1AErpXQ6U92lvtFAW9jCg42rDmYX4W8_rL9LcXe_osXcNkR-3ovdQJxBWzY88_XNGU2wIozW0m3TyaQSVaEuJfX31GRH7PVimzAtrRhB0qhDmxUA9eawVx_XU Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6e41fbe5fc754f1886dcd6a270efe36f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6e41fbe5fc754f1886dcd6a270efe36f"}]}] Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6e41fbe5fc754f1886dcd6a270efe36f Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminTestJSON-1731837909 Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: c2ec4dfcb09b45d7b8fe7319077cc12a Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminTestJSON-1731837909-project Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '242cced2-dca9-4c9e-bc27-3e8abdd1848e'} Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:33.345346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] Returning 404 to user: Instance 242cced2-dca9-4c9e-bc27-3e8abdd1848e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:33.350234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-092c1f16-1edf-49d8-b47e-4ffbeec01938 tempest-ServersAdminTestJSON-1731837909 tempest-ServersAdminTestJSON-1731837909-project] 10.222.0.50 "GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e" status: 404 len: 111 microversion: 2.1 time: 0.062476 Aug 30 17:37:33.355737 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1380/2899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:33 2022] GET /compute/v2.1/servers/242cced2-dca9-4c9e-bc27-3e8abdd1848e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:37:33.364614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1c3704a-1eef-4e99-97f1-33b962a757fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:33.366200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1c3704a-1eef-4e99-97f1-33b962a757fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:33.415613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.429087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.434680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.436233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d178d873-ae08-4948-b642-50019891baa3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1479 microversion: 2.25 time: 0.328509 Aug 30 17:37:33.444022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1520/2900] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:33 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1479 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:33.449668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:33.452334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:33.459767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.460901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.461738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.463437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:33.465393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:33.467115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:33.493755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f1c3704a-1eef-4e99-97f1-33b962a757fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.519044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1c3704a-1eef-4e99-97f1-33b962a757fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1238 microversion: 2.1 time: 0.161173 Aug 30 17:37:33.529343 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1381/2901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:33 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:33.839067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:33.847306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b667c66d-8713-4434-b8f9-90941fe797b9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1317 microversion: 2.1 time: 0.402154 Aug 30 17:37:33.857131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1521/2902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:33 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:34.011826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:34.013319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:34.026996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.034972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.036134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.037753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.040186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.040946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.310567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:34.311191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:34.321367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.324119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.324617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.327601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.328117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.328554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.474929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.486818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.490102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.492578 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-082776b9-c8df-4928-813b-bbb340756b77 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1370 microversion: 2.47 time: 0.186872 Aug 30 17:37:34.493682 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1522/2903] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:34 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:34.498799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:34.499643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:34.509502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.510381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.511016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.512379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.512853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.513339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.752069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.763705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.766243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.767873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d928f4f8-ef43-49de-8f29-2eadaef6291d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1479 microversion: 2.25 time: 0.273064 Aug 30 17:37:34.780394 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1523/2904] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:34 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1479 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:34.791815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:34.796517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:34.805188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.807683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.808523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.809524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.810538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.811364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.896389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:34.907420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10a58ee0-ce86-4bdf-b6c2-1f8dced29b7e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1290 microversion: 2.1 time: 0.125501 Aug 30 17:37:34.908541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1524/2905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:34 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:34.941829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:34.942811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:34.952989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.953963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.955147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.958103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.960472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.961403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:35.146332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:35.156144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2432d258-9ba9-409f-a1db-544079fee181 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.246099 Aug 30 17:37:35.157522 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1525/2906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:34 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:35.347100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1344005894", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:35.420386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:35.433724 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-caead90a-f4cb-42de-b970-243e9b4f229b tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1713 microversion: 2.1 time: 1.426357 Aug 30 17:37:35.435156 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1382/2907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:34 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1713 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:35.474642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] validate_networks() for [('b04f80f1-00e2-4aae-9f21-9d1a2fe06163', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:37:35.520245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:35.521231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:35.527268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:35.552221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:35.553198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:35.556461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:35.562979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:35.564479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:35.568346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:35.856772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:35.861432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:35.880545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:35.883971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:35.889685 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2caf0c77-9e02-4397-adbd-b27fbbaaba38 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1370 microversion: 2.47 time: 0.372992 Aug 30 17:37:35.890874 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1383/2908] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:35 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:35.929903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:35.934531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:35.966575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:35.970013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:35.970717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:35.972236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:35.973116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:35.975269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:36.943697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:36.961691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:36.971211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:36.973252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d58153a-b9df-4257-b705-bd638d548800 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1479 microversion: 2.25 time: 1.079466 Aug 30 17:37:36.974508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1384/2909] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:35 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1479 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:36.980884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:36.991250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:36.999616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.000662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.002003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.003452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.005565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.007592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.306517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:37:37.307024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:37:37.307265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:37:37.307620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:37:37.308046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:37:37.329137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.330935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.331400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.334036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.337426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.340567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.375068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:37.398175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Getting quotas for project a449867d5cce467aa908bc70916ac4ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:37.413346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c67d0e45-051d-490d-ab43-43cd1dfc04de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1296 microversion: 2.1 time: 0.432377 Aug 30 17:37:37.414393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1385/2910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:36 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1296 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:37.417660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Getting quotas for user f4d4aec674684b42a0267356b8bfea00 and project a449867d5cce467aa908bc70916ac4ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:37.454015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:37.455740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:37.479291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:37:37.481993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:37:37.500378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.505095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.518579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.525265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.527727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.528898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.568240 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-548da5b6-88bf-4dec-bba2-e622583d330c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225183 Aug 30 17:37:37.576015 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1526/2911] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:37:37.583637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:37.584582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:37.595067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.596558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.597780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.598870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.599935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.601603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.716852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.720445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.723626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.726788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lazy-loading 'fault' on Instance uuid 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:37.914415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a9adbb5a849dbbdd4c81ef2e42f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ac52a6449e40999f9d74f115069bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:37.926967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2bff3e0-6aef-4661-bb69-703ca24f7d18 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 200 len: 1366 microversion: 2.1 time: 0.500079 Aug 30 17:37:37.930895 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1386/2912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:37 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:37.940532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cafd98f-7d60-455b-9d0b-406e7d81bf8f", "name": "network-vif-deleted", "tag": "0020fda5-9556-48f0-bc6b-3f28866810a1"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:37.962534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:37.962938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:37.963435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:37.963881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:37.977195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:37.987635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:37.993913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f65a49b4-7f29-401f-8792-f892c526e24f tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1355 microversion: 2.47 time: 0.414126 Aug 30 17:37:37.999431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1527/2913] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:37 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1355 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:38.020610 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] Creating event network-vif-deleted:0020fda5-9556-48f0-bc6b-3f28866810a1 for instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f on n-h1-852771-11 Aug 30 17:37:38.023243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42b3c210-d60d-44ab-9f1d-aaef1b6f2b8b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:38.024362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42b3c210-d60d-44ab-9f1d-aaef1b6f2b8b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:38.040026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c43cebb0-8a8e-441c-9664-406e6fa082b3 req-224e61a1-b623-49d4-93d2-6569a64e4600 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107514 Aug 30 17:37:38.040651 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1387/2914] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:38.060755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:38.061494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:38.081712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.082041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.096750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.099791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.104936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.105450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.466693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42b3c210-d60d-44ab-9f1d-aaef1b6f2b8b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:38.492598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42b3c210-d60d-44ab-9f1d-aaef1b6f2b8b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1217 microversion: 2.1 time: 0.491342 Aug 30 17:37:38.500507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1528/2915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:38 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1217 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:38.516106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:38.518833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:38.534563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:38.541847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Searching by: {'deleted': False, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:37:38.560901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.562015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.563795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.564917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:38.567239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.568411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.570245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.576540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:38.580540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc7fab27-acad-4e29-9569-94e0a068d37e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.537306 Aug 30 17:37:38.581344 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1388/2916] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:38 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:38.608563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:38.610648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:38.642439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.642972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.643417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.647794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:38.648279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:38.648719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:38.991395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:37:39.086802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:39.096384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7f76b0e-bac9-498f-a2ff-c9451065c61d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.509077 Aug 30 17:37:39.099016 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1389/2917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:38 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:39.116516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:39.120044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] [instance: 47141bd6-d2c0-4f3b-a618-25ff021f2ad1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:39.135160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.135717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.147458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.149738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.151880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.152487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.202723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] HTTP exception thrown: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Request method failure captured: Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 HTTP/1.1 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqXa104F2zT8kswFJGIxq3yUKK3fCulo_GDwFt_YRVtQtLdykmvoHbrxLYbK8KIPJe8sX2t3dPGnGQD3rz7Sx63hW9g3-RzdCXzIu3ml-qrHkvT24cnay9Xn_MhSG_7XatilGGUzOLS2hC_t2pZ-MCwMTQw3-Pq2KtFyc7PoAwYwWE Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 84ac52a6449e40999f9d74f115069bbb Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestManualDisk-920391870 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84ac52a6449e40999f9d74f115069bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84ac52a6449e40999f9d74f115069bbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84ac52a6449e40999f9d74f115069bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84ac52a6449e40999f9d74f115069bbb"}]}] Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestManualDisk-920391870 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 84ac52a6449e40999f9d74f115069bbb Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestManualDisk-920391870 Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestManualDisk-920391870-project Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8a8a9adbb5a849dbbdd4c81ef2e42f7e Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestManualDisk-920391870-project Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '47141bd6-d2c0-4f3b-a618-25ff021f2ad1'} Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:39.205200 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. Aug 30 17:37:39.210806 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:39.212384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Returning 404 to user: Instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:39.213435 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1" status: 404 len: 111 microversion: 2.1 time: 0.112714 Aug 30 17:37:39.217740 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1390/2918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:39 2022] GET /compute/v2.1/servers/47141bd6-d2c0-4f3b-a618-25ff021f2ad1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:37:39.219108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:39.220328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb4e45db-25b3-46c3-8dd2-14ca2d23dd4c tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001483 Aug 30 17:37:39.232725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:39.248084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.249199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.249789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.253720 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1391/2919] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 30 17:37:39 2022] GET /compute/ => generated 377 bytes in 33 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 17:37:39.266298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:39.268994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:39.276718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6520a63-f380-49d9-b459-731dcf479156 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] Calling method '.version_select at 0x7f2d9952d5e0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:39.358260 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6520a63-f380-49d9-b459-731dcf479156 tempest-ServersTestManualDisk-920391870 tempest-ServersTestManualDisk-920391870-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252654289" status: 202 len: 0 microversion: 2.1 time: 0.103136 Aug 30 17:37:39.358871 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1392/2920] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252654289 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:37:39.526186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:39.527966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:39.549355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.550230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.552443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.553387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.556322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.556991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.825661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:39.841695 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9739e945-9ca3-45b4-bd46-a1153d186e83 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1269 microversion: 2.1 time: 0.322621 Aug 30 17:37:39.844719 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1393/2921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:39 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1269 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:39.858846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:39.861034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:39.883660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.885063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.886871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:39.888326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:39.893470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:39.896392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.125019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:40.143194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:40.147352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:40.154648 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8c61658-80d0-4b0f-a26d-57fb5cf517b3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.307807 Aug 30 17:37:40.173971 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1394/2922] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:39 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:40.197327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:40.204432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:40.225535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.226319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.226767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.227510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.228145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.228583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.414373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a66f3561-5aa2-4968-a521-bfdf4b7be0b7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.912343 Aug 30 17:37:40.416499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1529/2923] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 30 17:37:38 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:40.462442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:40.464373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:40.478442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.480593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.484222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.485267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.486016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.486860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.593550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:40.809633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f37675b-431d-49dc-9209-54b65facb737 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 204 len: 0 microversion: 2.47 time: 0.355750 Aug 30 17:37:40.810595 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1530/2924] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:37:40 2022] DELETE /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:37:40.828212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47141bd6-d2c0-4f3b-a618-25ff021f2ad1", "name": "network-vif-deleted", "tag": "79312d8d-4530-4a33-9863-3757aff5e83e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:40.859708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.877550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.878406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:40.919091 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] Creating event network-vif-deleted:79312d8d-4530-4a33-9863-3757aff5e83e for instance 47141bd6-d2c0-4f3b-a618-25ff021f2ad1 on n-h2-852771-11 Aug 30 17:37:40.939854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:40.942428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cc003b03-e79a-4b21-a875-e1e6a231fba2 req-aef9f1af-98f1-451f-a6c7-4ae7585abed9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129431 Aug 30 17:37:40.953982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-181a7b12-99af-4b51-92a4-468e980bb0a0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.778771 Aug 30 17:37:40.954515 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1531/2925] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:40.955982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1395/2926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:40 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:40.967202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:40.968214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:40.993398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:40.998268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:40.999972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.002282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.008742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.009381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.319929 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f1ecf88-5a27-49c3-9ec8-1b2dd376220f tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T17%3A37%3A40.484065&end=2022-08-31T17%3A37%3A40.484065" status: 404 len: 112 microversion: - time: 0.363835 Aug 30 17:37:41.323961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1532/2927] 10.222.0.50 () {58 vars in 1316 bytes} [Tue Aug 30 17:37:40 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T17%3A37%3A40.484065&end=2022-08-31T17%3A37%3A40.484065 => generated 112 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 17:37:41.348510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:41.350584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:41.372102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.372892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.374624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.377216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.377866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.380320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.391039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.402623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.412505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.414092 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f9489e0-cc17-4820-b403-809b7d5e9cff tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1361 microversion: 2.47 time: 0.456825 Aug 30 17:37:41.433413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1396/2928] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:40 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:41.438555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:41.442643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:41.462035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.462784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.463377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.464270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.467125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.467787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.580994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.598323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72a026ce-6aaf-45ac-8750-d1e5917ff150 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1275 microversion: 2.1 time: 0.267714 Aug 30 17:37:41.599831 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1533/2929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:41 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:41.620528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:41.654078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.654563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.655681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.685711 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] Creating event network-changed:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:37:41.713962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-20a84c09-2ee5-4e1b-9293-9e5b512854fe req-e14546da-c4e3-46fa-b799-b11e1ab9d5ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096865 Aug 30 17:37:41.718600 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1534/2930] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:41.738727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2258ab58-984e-43fd-a229-12c21dfb4e61 tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] Calling method '.version_select at 0x7f2d98f9be50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:41.753600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2258ab58-984e-43fd-a229-12c21dfb4e61 tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2258ab58-984e-43fd-a229-12c21dfb4e61 tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] Request method failure captured: Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-simple-tenant-usage/587e2edfb9454417b0fde608d5b944e9?start=2022-08-31T17%3A37%3A40.484065&end=2022-08-29T17%3A37%3A40.484065 HTTP/1.1 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrkUlK5neOkVUpI-4dhhYRntufqmiQR-J54FtikZrcSyQ9hGzV9YwK9EpBwN5nXEfAA3H3LmjGhte4CQCH2xJEsHo60oQXV7xSa6ur1NSLZNhVQHAtwY9tyVsBm50hsXtrPX3Q-fgBCYz0fySOKK83vXmyd7dxCW-HlEcAbs3DD9MM Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 637e37b95735472283075c709a22ab06 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2065139937 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/637e37b95735472283075c709a22ab06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/637e37b95735472283075c709a22ab06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/637e37b95735472283075c709a22ab06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_637e37b95735472283075c709a22ab06"}]}] Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2065139937 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 637e37b95735472283075c709a22ab06 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2065139937 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a35b2a23ac714b3593011a7c45040f00 Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid start time. The start time cannot occur after the end time. Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '587e2edfb9454417b0fde608d5b944e9'} Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 30 17:37:41.764450 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.770544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2258ab58-984e-43fd-a229-12c21dfb4e61 tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:41.771632 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2258ab58-984e-43fd-a229-12c21dfb4e61 tempest-TenantUsagesNegativeTestJSON-2065139937 tempest-TenantUsagesNegativeTestJSON-2065139937-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/587e2edfb9454417b0fde608d5b944e9?start=2022-08-31T17%3A37%3A40.484065&end=2022-08-29T17%3A37%3A40.484065" status: 400 len: 111 microversion: 2.1 time: 0.051525 Aug 30 17:37:41.772362 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1535/2931] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 30 17:37:41 2022] GET /compute/v2.1/os-simple-tenant-usage/587e2edfb9454417b0fde608d5b944e9?start=2022-08-31T17%3A37%3A40.484065&end=2022-08-29T17%3A37%3A40.484065 => generated 111 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:37:41.950790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd500f83-c332-4f4e-a660-11561d8e40fb tempest-TenantUsagesNegativeTestJSON-984703009 tempest-TenantUsagesNegativeTestJSON-984703009-project] Calling method '.version_select at 0x7f2d990854c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:41.956121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd500f83-c332-4f4e-a660-11561d8e40fb tempest-TenantUsagesNegativeTestJSON-984703009 tempest-TenantUsagesNegativeTestJSON-984703009-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f06ca8e6cb05498291dbbe8a462354ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587e2edfb9454417b0fde608d5b944e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd500f83-c332-4f4e-a660-11561d8e40fb tempest-TenantUsagesNegativeTestJSON-984703009 tempest-TenantUsagesNegativeTestJSON-984703009-project] Request method failure captured: Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T17%3A37%3A40.484065&end=2022-08-31T17%3A37%3A40.484065&detailed=1 HTTP/1.1 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkriouRT4e7hwrS7vVFtJ2g796ogFn7iNj_Vzh595rse0UTC-Lf7TsrT0UKQvtz6oXui7N82XPE4KuHrg1bgFNFRc1emejcooVCgXn2ghp6bfetMqqKeDf0G9tMB_cK1l78U_rcmqpcAp3-LMYmF-1z0wMxMCDZIYT-AVDfptQSa73A Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 587e2edfb9454417b0fde608d5b944e9 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-984703009 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/587e2edfb9454417b0fde608d5b944e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/587e2edfb9454417b0fde608d5b944e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/587e2edfb9454417b0fde608d5b944e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_587e2edfb9454417b0fde608d5b944e9"}]}] Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-984703009 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 587e2edfb9454417b0fde608d5b944e9 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-984703009 Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TenantUsagesNegativeTestJSON-984703009-project Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f06ca8e6cb05498291dbbe8a462354ab Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-984703009-project Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: action_args: {} Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:37:41.958973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd500f83-c332-4f4e-a660-11561d8e40fb tempest-TenantUsagesNegativeTestJSON-984703009 tempest-TenantUsagesNegativeTestJSON-984703009-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd500f83-c332-4f4e-a660-11561d8e40fb tempest-TenantUsagesNegativeTestJSON-984703009 tempest-TenantUsagesNegativeTestJSON-984703009-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T17%3A37%3A40.484065&end=2022-08-31T17%3A37%3A40.484065&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.180880 Aug 30 17:37:41.963555 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1536/2932] 10.222.0.50 () {58 vars in 1335 bytes} [Tue Aug 30 17:37:41 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T17%3A37%3A40.484065&end=2022-08-31T17%3A37%3A40.484065&detailed=1 => generated 123 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:37:41.976273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:41.977608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:41.984714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:41.985008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.985602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.986169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:41.988537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:41.990204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:41.990765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:42.006008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.018475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.020450 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a925899-30bf-412f-90cd-c8e3b268c3b2 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.585677 Aug 30 17:37:42.022759 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1397/2933] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:41 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:42.417395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.428977 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c828bd0a-b22d-4860-9f8c-19521fb9de41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.458682 Aug 30 17:37:42.430163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1537/2934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:41 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:42.447140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:42.447795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:42.463568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:42.464062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:42.464510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:42.465278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:42.465723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:42.466329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:42.623147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:42.624385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:42.638613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:42.639372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:42.640020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:42.640945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:42.641572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:42.648743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:42.729219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.744544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.746009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.759534 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-05d37368-0d88-48e6-95f3-140d8b860c31 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1361 microversion: 2.47 time: 0.311339 Aug 30 17:37:42.760878 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1398/2935] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:42 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:42.857587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:42.875952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-24e339c6-2cfc-41f7-9691-aff01fa97dcb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1275 microversion: 2.1 time: 0.256620 Aug 30 17:37:42.883699 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1538/2936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:42 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:43.043135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:43.044111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:43.055925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.063447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.064203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.065212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.065952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.073837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.449931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:43.450566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:43.469379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.469883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.470321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.471229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.472250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.475808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.506533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:43.553429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:43.747317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:43.763817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:43.772870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:43.774253 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ffc4bd6-e9c6-49b7-822d-bf434958983d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.735402 Aug 30 17:37:43.791523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1399/2937] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:43 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:43.794248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:43.794912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:43.814368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.814940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.815384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.817113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.817575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.827671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.921511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:43.944426 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7a5be3f-87eb-4be5-ada0-56a91cfdcdf2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.488580 Aug 30 17:37:43.959288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1539/2938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:43 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:43.968697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:43.969319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:43.982735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.991257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.991912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:43.992801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:43.993408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:43.994027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:44.184305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.195986 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a24f96d-29d6-44b5-8cfa-220dc5aaf12b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1275 microversion: 2.1 time: 0.235348 Aug 30 17:37:44.221094 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1540/2939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:43 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:44.244124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.280378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.284673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.295259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-055160f7-697c-4b98-85be-8cb65824b51a tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 200 len: 1361 microversion: 2.47 time: 0.511071 Aug 30 17:37:44.296584 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1400/2940] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:43 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:44.805535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:44.806156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:44.837878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:44.838749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:44.839343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:44.844370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:44.846915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:44.847445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:44.952334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.964529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.966216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:44.967584 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42badb01-cbc3-44c5-8ccd-8fd5dc9a7855 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.170886 Aug 30 17:37:44.969755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:44.984106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:44.992131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1541/2941] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:44 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:45.015835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.016441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.016893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.022618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.025520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.026008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.229447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:45.230314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:45.248620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.250590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.251697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.253924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.254677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.255856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.395618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:45.408756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c7f1904-79fc-4e92-a6fe-d3058707b816 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1275 microversion: 2.1 time: 0.183037 Aug 30 17:37:45.412459 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1542/2942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:45 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:45.429290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:45.430173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: c74b074b-e02d-401f-9edd-4aa8b82d7cf4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:45.438756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.439567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.440300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.441233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.441862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.442452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.466804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] HTTP exception thrown: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Request method failure captured: Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 HTTP/1.1 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkqwgh6sN-CF7DD_qaFiWeI4pk6XaYQNIR1W4ee_G3hFqMjEUjnplTTV7t6u_GuB1yBrSqUQEuW-OtKRT4LXQZk-NeXeIdomL1fpw6xZevb_bO4H0oY7UYrFhEih3EIKHhAiiZcEBBMHEDDA3g7KKTlzDOWnZ_lBihboI1WT6mkbyYg Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c51ffeee7ba24989a1825b1fd03c7930 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c51ffeee7ba24989a1825b1fd03c7930"}]}] Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c51ffeee7ba24989a1825b1fd03c7930 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerShowV247Test-1007259095-project Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a7588c3aa1874049a4c5e43863f88acc Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerShowV247Test-1007259095-project Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c74b074b-e02d-401f-9edd-4aa8b82d7cf4'} Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:45.472020 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. Aug 30 17:37:45.477205 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:45.480745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Returning 404 to user: Instance c74b074b-e02d-401f-9edd-4aa8b82d7cf4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:45.481885 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15c21be4-e8b0-42d6-a9e4-5a6c6330a388 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4" status: 404 len: 111 microversion: 2.47 time: 0.068290 Aug 30 17:37:45.487796 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1543/2943] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:45 2022] GET /compute/v2.1/servers/c74b074b-e02d-401f-9edd-4aa8b82d7cf4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:37:45.497498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:45.498903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:45.519321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.520197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.520868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.521776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.522402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.523798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.597551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:45.762710 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d312f69e-b1dc-4ef9-8546-390235492253 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 204 len: 0 microversion: 2.47 time: 0.272557 Aug 30 17:37:45.763308 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1544/2944] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:37:45 2022] DELETE /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:37:45.794664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:45.795008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:45.827024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.836096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.836665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.837414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:45.838049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:45.838489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:45.983501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.002955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.005122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.010628 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-551b6831-ef0a-44cf-9c29-8f1b741daee7 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 200 len: 1363 microversion: 2.47 time: 0.239295 Aug 30 17:37:46.011672 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1545/2945] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:45 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:46.023604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:46.024571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:46.048891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:46.049777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:46.050553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:46.052468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:46.053216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:46.053915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:46.163206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.188504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fd9334a-c611-4139-8e83-53a20475c521 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 1.225792 Aug 30 17:37:46.191787 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1401/2946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:44 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:46.231058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.241399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.244184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:46.256751 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c23a902-3715-42de-8ce4-931dd9bde26f tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1263 microversion: 2.25 time: 0.243629 Aug 30 17:37:46.274480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1546/2947] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:46 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1263 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:46.435941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:46.436787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:46.450035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:46.452653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:46.453104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:46.453837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:46.461026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:46.462488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.045491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:47.047756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:47.063317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.065146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.065837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.067796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.068420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.069170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.384020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:47.396398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:47.398621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:47.419936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:47.421483 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3db1bcee-83e9-4764-8e42-32eb37f0f564 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 200 len: 1363 microversion: 2.47 time: 0.387031 Aug 30 17:37:47.442920 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1547/2948] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:47 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:47.447938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b5ec619-3336-4e5e-9f57-90b7098441cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 1.015888 Aug 30 17:37:47.450006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:47.457652 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1402/2949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:46 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:47.465824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:47.467946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:47.469379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:47.491616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.498612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.499196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.503151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.503966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.504825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.507357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.512906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.527680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.528956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.552058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.552940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.639399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:47.674992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:47.676479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:47.679000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:47.680034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'fault' on Instance uuid 1cafd98f-7d60-455b-9d0b-406e7d81bf8f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:47.828890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:47.840799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac23994d-2149-4592-8d8a-f0430e7a065a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.412319 Aug 30 17:37:47.845075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1548/2950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:47 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:48.138045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfa914de-d1ee-49e4-8e32-44c2b4acbd86 tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:48.156410 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfa914de-d1ee-49e4-8e32-44c2b4acbd86 tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.310149 Aug 30 17:37:48.160353 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1549/2951] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:37:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:48.165975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-plugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:48.179252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.180963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.181953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.204161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] Creating event network-vif-plugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:37:48.217631 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4743daa2-c018-4db0-8e5a-e6f1f28e18e1 req-d729f16d-fcee-4146-8e0b-c398dd6b17b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054387 Aug 30 17:37:48.220463 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1550/2952] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:48.366585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.382420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.384045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.385292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4319c4dc-67b6-413c-8a9e-23dbc65692c3 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 200 len: 1191 microversion: 2.25 time: 0.926293 Aug 30 17:37:48.385925 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1403/2953] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:47 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 1191 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:48.453541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:48.458674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:48.478601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:48.479884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:48.488967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.493284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.494479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.495453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.496436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.497030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.499047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.499189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.499860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.501017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.503458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.504715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.639026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.656826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.658506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:48.659790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-334e6eb5-b347-4977-93dc-fb112048cd79 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 200 len: 1363 microversion: 2.47 time: 0.213154 Aug 30 17:37:48.670467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1551/2954] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:48 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:48.873288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:48.873897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:48.875883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:48.876987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:48.889666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.890146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.890551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:48.891270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:48.891755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:48.892184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.130417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:49.141585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-160e396b-2b4a-4778-b55a-9cca668428e1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1363 microversion: 2.1 time: 0.272294 Aug 30 17:37:49.155290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1552/2955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:48 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:49.155290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-250767036", "imageRef": "60ea132a-64ce-4349-a77b-7a756756c882", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:49.156463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:49.171379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd91a53a-6958-442c-bc13-3d5be3836227 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 0.696557 Aug 30 17:37:49.188801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1404/2956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:48 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:49.217582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:49.247721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:37:49.416815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:49.429245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 1cafd98f-7d60-455b-9d0b-406e7d81bf8f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:49.450079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:49.450822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:49.453104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.455846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:49.456495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:49.458042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.509440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] HTTP exception thrown: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Request method failure captured: Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f HTTP/1.1 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkkxPJmy4kmEIfMpuOtRbJsP0aulfMm7q8lX67bYRUXSPjisRpdlvAnM-Nxpk1DXLPpIcMyNtLbnzjQDlyhIpT0szLbO5bKvIujhw97loc7lbPNNeSlHpNfK4b0cuLFPwsyVFPgbVKqfcJJ5afyjeR9-f1c29FZSrnNSEg-SQH769Oo Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36850e3f45ae4558a78f5f78dd09c806"}]}] Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 859d8e930c434d519e4208e58246b471 Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '1cafd98f-7d60-455b-9d0b-406e7d81bf8f'} Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. Aug 30 17:37:49.517306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. Aug 30 17:37:49.522006 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.526994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Returning 404 to user: Instance 1cafd98f-7d60-455b-9d0b-406e7d81bf8f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:49.529239 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ef7f424-6d4c-43c0-a028-82d4a29e2ca6 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f" status: 404 len: 111 microversion: 2.25 time: 0.122616 Aug 30 17:37:49.529818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1405/2957] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:49 2022] GET /compute/v2.1/servers/1cafd98f-7d60-455b-9d0b-406e7d81bf8f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:37:49.688632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:49.689480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 30 17:37:49.690463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] Request method failure captured: Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 142 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrr6wCkB0nkUUBN1dJ64NtlWif7tknXldQvabsWzMVyImgC5GmmaAEUWvjqTrqAicwrmdFvt90Zl5wdq7rqylyosy-guoJe-3LTusbGE-R-DWS_afUhyRxNAM6TmgnfX909TxaC3DMANk60HYkSMoiPxN_OfOEcVFFBquJ_njg8Yp4 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 52a87ae9fefe4200a58d4b38f50694a8 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FlavorsV2NegativeTest-577123448 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52a87ae9fefe4200a58d4b38f50694a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52a87ae9fefe4200a58d4b38f50694a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/52a87ae9fefe4200a58d4b38f50694a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_52a87ae9fefe4200a58d4b38f50694a8"}]}] Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FlavorsV2NegativeTest-577123448 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 52a87ae9fefe4200a58d4b38f50694a8 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-577123448 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FlavorsV2NegativeTest-577123448-project Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 79d97c4c4c9d4307b1e2d03d5d121781 Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FlavorsV2NegativeTest-577123448-project Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-250767036", "imageRef": "60ea132a-64ce-4349-a77b-7a756756c882", "flavorRef": "452"}} Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor's memory is too small for requested image. Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-250767036', 'imageRef': '60ea132a-64ce-4349-a77b-7a756756c882', 'flavorRef': '452'}}} Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:37:49.695923 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a032faf7-f41a-4747-b41b-82e8f935053d tempest-FlavorsV2NegativeTest-577123448 tempest-FlavorsV2NegativeTest-577123448-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.553778 Aug 30 17:37:49.699808 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1553/2958] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:37:49 2022] POST /compute/v2.1/servers => generated 93 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:37:49.716188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:49.718950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:49.720679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.723015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:49.725111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:49.728194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.842198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:49.844634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:49.847651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:49.850237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lazy-loading 'fault' on Instance uuid d2c15bdc-1900-4e32-8d9d-a2df4e41b720 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:37:50.163142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:50.163802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:50.183258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:50.183786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:50.184228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:50.187403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:50.192021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:50.193096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:50.246873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:50.299000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:50.304947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7588c3aa1874049a4c5e43863f88acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51ffeee7ba24989a1825b1fd03c7930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:50.308576 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21ad3027-181f-41e6-a837-aca2f7d72ed3 tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 200 len: 1368 microversion: 2.47 time: 0.626202 Aug 30 17:37:50.312016 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1406/2959] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:49 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 1368 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:50.325226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:50.328222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:50.349705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:50.350941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:50.351403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:50.354528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:50.356826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:50.357287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.033123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:51.048487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-558f205a-315e-4087-9580-8a32fe9e96f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1549 microversion: 2.1 time: 0.889812 Aug 30 17:37:51.052377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1554/2960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:50 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1549 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:51.064661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3e733e-7964-40cc-9510-c771e03e23cc", "tag": "20be11bc-7612-4d74-a98f-3e1b779552c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:51.092473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:51.096981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:51.098279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.145463 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] Creating event network-changed:20be11bc-7612-4d74-a98f-3e1b779552c4 for instance 5a3e733e-7964-40cc-9510-c771e03e23cc on n-h2-852771-11 Aug 30 17:37:51.161049 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-85ab3518-f73f-4cbd-95e6-beacf94fadd8 req-013c3079-f702-4a57-b6a8-20bdfab49122 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105068 Aug 30 17:37:51.164443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1555/2961] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:51.183546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:51.186057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:51.207965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:51.208462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:51.211010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.212003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:51.215562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:51.217999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.518256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:51.527829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1a63bfc-4478-4f20-9803-9cec1bfdf69b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 1.214690 Aug 30 17:37:51.530874 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1407/2962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:50 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:51.542591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:51.544031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] [instance: d2c15bdc-1900-4e32-8d9d-a2df4e41b720] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:51.573707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:51.574351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:51.576284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.578077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:51.580397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:51.582861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:51.634434 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] HTTP exception thrown: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Request method failure captured: Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 HTTP/1.1 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkqwgh6sN-CF7DD_qaFiWeI4pk6XaYQNIR1W4ee_G3hFqMjEUjnplTTV7t6u_GuB1yBrSqUQEuW-OtKRT4LXQZk-NeXeIdomL1fpw6xZevb_bO4H0oY7UYrFhEih3EIKHhAiiZcEBBMHEDDA3g7KKTlzDOWnZ_lBihboI1WT6mkbyYg Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c51ffeee7ba24989a1825b1fd03c7930 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c51ffeee7ba24989a1825b1fd03c7930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c51ffeee7ba24989a1825b1fd03c7930"}]}] Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c51ffeee7ba24989a1825b1fd03c7930 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerShowV247Test-1007259095 Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerShowV247Test-1007259095-project Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a7588c3aa1874049a4c5e43863f88acc Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerShowV247Test-1007259095-project Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd2c15bdc-1900-4e32-8d9d-a2df4e41b720'} Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:51.644018 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] Returning 404 to user: Instance d2c15bdc-1900-4e32-8d9d-a2df4e41b720 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:51.651721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-211576f9-4b42-4f38-9a0c-b30eee11399b tempest-ServerShowV247Test-1007259095 tempest-ServerShowV247Test-1007259095-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720" status: 404 len: 111 microversion: 2.47 time: 0.114985 Aug 30 17:37:51.663107 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1408/2963] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:51 2022] GET /compute/v2.1/servers/d2c15bdc-1900-4e32-8d9d-a2df4e41b720 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:37:51.931272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47d5a5b3-afeb-4c40-80e8-4e57260b6487 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.763542 Aug 30 17:37:51.932175 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1556/2964] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:37:51 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/os-interface => generated 284 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:52.565917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:52.568787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:52.581023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:52.590491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:52.591218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:52.592162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:52.598046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:52.598808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:53.537922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:53.580851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed60eadc-71fd-440f-a678-86777b9a196a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 1.032093 Aug 30 17:37:53.583118 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1409/2965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:52 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:54.606508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:54.607050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:54.630834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:54.638126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:54.645016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:54.646099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:54.647019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:54.648105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:56.440301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:56.459532 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a07d0fd0-79e1-4359-b20f-1b9325288e89 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 1.854044 Aug 30 17:37:56.462736 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1557/2966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:54 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:56.502937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:56.506699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:56.529497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:56.531778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:56.533469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:56.535932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:56.542550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:56.544386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:56.613397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:37:56.760570 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b14ad28e-b9f9-4079-88f1-c16439dd095d tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 204 len: 0 microversion: 2.25 time: 0.261012 Aug 30 17:37:56.761628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1410/2967] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:37:56 2022] DELETE /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:37:56.771003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:56.771924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:56.790829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:56.791330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:56.791802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:56.792531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:56.798923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:56.799384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:57.123016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:57.143198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:57.144749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:57.145595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:57.179140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] Creating event network-changed:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:37:57.199314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-22317773-2e3e-4d6e-a881-2e0d77fcf5db req-1bb3d83c-b3c6-4ea6-a48d-1804b4d21c3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082294 Aug 30 17:37:57.204236 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1411/2968] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:57.496454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:57.499778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:57.538239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:57.541801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:57.543704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:57.546896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:57.548002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:57.550009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:57.734536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:57.742464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:57.753256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:57.755318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:57.756827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7cb2a260-bd69-427f-aa0a-dddd2e594aba tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1731 microversion: 2.25 time: 0.990248 Aug 30 17:37:57.775946 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1558/2969] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:56 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1731 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:37:58.161139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3e733e-7964-40cc-9510-c771e03e23cc", "name": "network-vif-plugged", "status": "completed", "tag": "20be11bc-7612-4d74-a98f-3e1b779552c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:58.166974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:58.180081 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ecaa0369-e395-434c-aaf3-36b905b3ff1b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 0.688256 Aug 30 17:37:58.180639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:58.181350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:58.188068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:58.193781 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1412/2970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:57 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:37:58.208953 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] Creating event network-vif-plugged:20be11bc-7612-4d74-a98f-3e1b779552c4 for instance 5a3e733e-7964-40cc-9510-c771e03e23cc on n-h2-852771-11 Aug 30 17:37:58.224956 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-fd7358f5-50df-42b6-a68d-5ae74047168c req-5ff5b1ff-9611-473f-8e45-17cf51a02a1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068517 Aug 30 17:37:58.233186 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1559/2971] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:37:58.794143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:58.797356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:58.819155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:58.819940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:58.820691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:58.821633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:58.823195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:58.825117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:59.209522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:59.215075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:59.231993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:59.232977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:59.233824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:59.235347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:59.236819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:59.238419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:59.297757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:59.310498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:59.312974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:59.315284 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfa71c6e-3e3a-471c-81f5-5dfe1a9828d1 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1731 microversion: 2.25 time: 0.527670 Aug 30 17:37:59.317640 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1413/2972] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:37:58 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1731 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:37:59.631021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:59.643061 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92811dc1-70c2-4248-af0f-3e2909fc3c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1317 microversion: 2.1 time: 0.441207 Aug 30 17:37:59.648667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1560/2973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:59 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:00.340778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:00.341395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:00.352085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:00.352609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:00.366854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:00.367687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:00.368171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:00.368610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:00.520120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:00.535906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:00.539587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:00.544027 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69f52adc-19c7-46ae-b25a-bf40b15eda5c tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1663 microversion: 2.25 time: 0.206569 Aug 30 17:38:00.544823 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1414/2974] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:00 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1663 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:00.669027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:00.670205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:00.697511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:00.698018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:00.698457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:00.699179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:00.716922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:00.717495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.356277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5354c76-5ec6-47dd-8d98-f7239648742f", "name": "network-vif-deleted", "tag": "ea04f574-d62f-4bc3-8622-d12bac8a1c9f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:01.385186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.385676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.386113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.409599 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] Creating event network-vif-deleted:ea04f574-d62f-4bc3-8622-d12bac8a1c9f for instance b5354c76-5ec6-47dd-8d98-f7239648742f on n-h2-852771-11 Aug 30 17:38:01.423959 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-17cf8bee-80e5-4ca3-a663-37932084293e req-4fd57df5-311b-4f85-bfdc-f55362994d88 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078073 Aug 30 17:38:01.431818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1415/2975] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:38:01.508958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:01.524020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8689917-21a1-450b-950c-8dc0edd4c5d4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1506 microversion: 2.1 time: 0.859139 Aug 30 17:38:01.549381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:01.550289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:01.560040 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1561/2976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:00 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1506 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:01.569030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.572329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.572795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.576468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:01.577087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:01.580267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.585709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.586610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.587138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.587877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.588485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.589365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.590172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.591087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.674057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:01.674676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:38:01.676432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:01.677139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:01.677814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'fault' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:38:01.822570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:01.843133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:01.846991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:01.849841 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12af1e8f-dd13-450f-b5e9-b287bf0fb9b9 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1375 microversion: 2.25 time: 0.284540 Aug 30 17:38:01.853726 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1562/2977] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:01 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1375 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:38:01.979421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de3abfce-4317-4db5-9315-af1c61647f7c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 204 len: 0 microversion: 2.1 time: 0.433415 Aug 30 17:38:01.979845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1416/2978] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:38:01 2022] DELETE /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:38:01.991184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:01.991875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:02.014348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:02.018463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:02.019746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:02.024017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:02.024545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:02.025431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:02.431543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:02.441570 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7aa81f12-07a8-468d-b931-584798623dcf tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1512 microversion: 2.1 time: 0.454984 Aug 30 17:38:02.444539 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1563/2979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:01 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:02.875097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:02.875816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:02.891275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:02.891794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:02.892230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:02.892931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:02.893383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:02.893802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:02.983521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:02.984021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:02.984433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:02.984886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'fault' on Instance uuid b5354c76-5ec6-47dd-8d98-f7239648742f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:38:03.469877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:03.471712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:03.501387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:03.502375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:03.503055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:03.507307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:03.509133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:03.509905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:03.543220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:03.551311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:03.552817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:03.553982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d22411e-74c8-458a-af77-a18da7250dc0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 200 len: 1375 microversion: 2.25 time: 0.683299 Aug 30 17:38:03.554551 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1417/2980] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:02 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 1375 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:04.298965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:04.308232 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-636b7614-cb2b-46b0-a2be-6b125f5e8303 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 200 len: 1512 microversion: 2.1 time: 0.844500 Aug 30 17:38:04.311316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1564/2981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:03 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 1512 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:04.353982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3e733e-7964-40cc-9510-c771e03e23cc", "name": "network-vif-deleted", "tag": "20be11bc-7612-4d74-a98f-3e1b779552c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:04.379334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:04.379853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:04.380283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:04.403064 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] Creating event network-vif-deleted:20be11bc-7612-4d74-a98f-3e1b779552c4 for instance 5a3e733e-7964-40cc-9510-c771e03e23cc on n-h2-852771-11 Aug 30 17:38:04.419757 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7454896a-cd6a-48a1-acc3-763c322012b0 req-c3280f07-f1c1-4e81-9101-89f09d8ad3eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069803 Aug 30 17:38:04.421094 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1418/2982] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:04.584910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:04.585535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: b5354c76-5ec6-47dd-8d98-f7239648742f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:04.604226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:04.605293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:04.605736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:04.610148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:04.613708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:04.614219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:04.687344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] HTTP exception thrown: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Request method failure captured: Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f HTTP/1.1 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkkxPJmy4kmEIfMpuOtRbJsP0aulfMm7q8lX67bYRUXSPjisRpdlvAnM-Nxpk1DXLPpIcMyNtLbnzjQDlyhIpT0szLbO5bKvIujhw97loc7lbPNNeSlHpNfK4b0cuLFPwsyVFPgbVKqfcJJ5afyjeR9-f1c29FZSrnNSEg-SQH769Oo Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36850e3f45ae4558a78f5f78dd09c806"}]}] Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 859d8e930c434d519e4208e58246b471 Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b5354c76-5ec6-47dd-8d98-f7239648742f'} Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. Aug 30 17:38:04.693482 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:04.697449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Returning 404 to user: Instance b5354c76-5ec6-47dd-8d98-f7239648742f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:04.699533 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a95be35c-99cb-409b-8fa8-74bc8e737506 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f" status: 404 len: 111 microversion: 2.25 time: 0.120970 Aug 30 17:38:04.703022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1565/2983] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:04 2022] GET /compute/v2.1/servers/b5354c76-5ec6-47dd-8d98-f7239648742f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:04.712701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec70535f-5936-4501-af59-297d6102fa16 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '.version_select at 0x7f2d9cb6fb80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:04.748750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec70535f-5936-4501-af59-297d6102fa16 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900656860" status: 204 len: 0 microversion: 2.25 time: 0.041647 Aug 30 17:38:04.751635 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1419/2984] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 30 17:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900656860 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:38:05.333974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:05.334624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:05.343167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:05.343695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:05.344131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:05.344840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:05.345292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:05.345716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:05.382611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc HTTP/1.1 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5a3e733e-7964-40cc-9510-c771e03e23cc'} Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:05.384347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:38:05.389731 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:05.391210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:05.392473 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a91ca2ab-4585-4588-a330-9c86fe6d28bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 404 len: 111 microversion: 2.1 time: 0.063053 Aug 30 17:38:05.403783 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1566/2985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:05 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:38:05.414249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:05.416167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:05.437407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:05.438611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:05.439387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:05.440378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:05.441557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:05.443820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:05.451287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:05.799258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:05.813845 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0ef3417-073b-42bf-bca7-363b36492bea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.405173 Aug 30 17:38:05.819264 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1420/2986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:05 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:06.105653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae93a84b-ef66-4f1e-b17e-34de043874c8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae93a84b-ef66-4f1e-b17e-34de043874c8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 163 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": 12345, "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 12345 Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:06.109510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae93a84b-ef66-4f1e-b17e-34de043874c8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae93a84b-ef66-4f1e-b17e-34de043874c8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009502 Aug 30 17:38:06.113966 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1567/2987] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:06 2022] POST /compute/v2.1/servers => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:06.121999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:06.122727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:06.124819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:06.136883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:06.139166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:06.139744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:06.141166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:06.144591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:06.145533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:07.042889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:07.056310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1dbee19-33e0-4fdd-bb43-b3f12eda981f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.938323 Aug 30 17:38:07.056921 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1421/2988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:06 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:07.085707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:07.087120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:07.138804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:07.145406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:07.146280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:07.148767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:07.154196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:07.161862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:07.755471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:07.768062 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5b0f7bd-7add-46cb-80ad-d37b4dbf0ca4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.690453 Aug 30 17:38:07.768657 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1568/2989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:07 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:08.999015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:09.000215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:09.012273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:09.013929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:09.016279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:09.018468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:09.020301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:09.021931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:09.085432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:38:09.248731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-84c22b4a-3ce2-4b9d-9b04-0654ff5663ed tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 204 len: 0 microversion: 2.25 time: 0.256342 Aug 30 17:38:09.250055 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1422/2990] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:38:08 2022] DELETE /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:38:09.269050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:09.270519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:09.301534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:09.302741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:09.303411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:09.304354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:09.310508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:09.311263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:09.948107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9c3917d-3205-4ef7-a348-21aa688b6afc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Action: 'create', calling method: .version_select at 0x7f2d982551f0>, body: {"keypair": {"name": "tempest-keypair-1907443127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJydRLhVimMuriIgeeRxB94+JEE3Eribla89s4H4muCkc70i6G5s/6YRlM5tFbnJOxawUIX+oMRVETYuZNys26Cl4JPa0Z1tFCLb1/m+Agr2FlZTBDfeVhknM+igG0Y4tQ=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:10.004595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d9c3917d-3205-4ef7-a348-21aa688b6afc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Getting quotas for project 90a7e4b51e574eedbd25ece987c09b8f. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:38:10.023017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:10.030895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d9c3917d-3205-4ef7-a348-21aa688b6afc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Getting quotas for user 3425189160ed4a2ca2eede57b605bf66 and project 90a7e4b51e574eedbd25ece987c09b8f. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:38:10.046915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:10.051315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:10.053598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4af66140-772f-4270-aef1-fc8c4c4b4597 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1548 microversion: 2.25 time: 0.799648 Aug 30 17:38:10.054938 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1569/2991] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:09 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1548 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:38:10.138000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9c3917d-3205-4ef7-a348-21aa688b6afc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.194266 Aug 30 17:38:10.151389 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1423/2992] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:38:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:38:10.912928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5f232c-737e-4544-bf65-ca0a86598157", "name": "network-vif-deleted", "tag": "2e7a491d-2d06-4f61-ba6c-9e4bb543ad18"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:10.950126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:10.951808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:10.953212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:11.001128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] Creating event network-vif-deleted:2e7a491d-2d06-4f61-ba6c-9e4bb543ad18 for instance 6c5f232c-737e-4544-bf65-ca0a86598157 on n-h2-852771-11 Aug 30 17:38:11.033906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-12016729-219d-4a78-98bf-f7ea39dfeb0f req-df4051a6-4340-4352-a8a8-09336016c2c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127107 Aug 30 17:38:11.046799 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1570/2993] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:11.080165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:11.081500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:11.105058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:11.105815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:11.106621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:11.109492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:11.113566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:11.115340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:11.231823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:11.233205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:11.235951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:11.236690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'fault' on Instance uuid 6c5f232c-737e-4544-bf65-ca0a86598157 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:38:11.364294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:11.385915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:11.392142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:11.396981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0cadc95-9ed7-49e8-819f-75e04c5237e4 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 200 len: 1351 microversion: 2.25 time: 0.320388 Aug 30 17:38:11.398973 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1424/2994] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:11 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 1351 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:12.264997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-199ff5bb-e052-4ec3-9fc1-e0f987c85dcd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337401598", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "193a52ed-aaa2-4018-929e-b879fc9dfd29", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:12.427285 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-199ff5bb-e052-4ec3-9fc1-e0f987c85dcd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-199ff5bb-e052-4ec3-9fc1-e0f987c85dcd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 357 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337401598", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "193a52ed-aaa2-4018-929e-b879fc9dfd29", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: exception: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-337401598', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '193a52ed-aaa2-4018-929e-b879fc9dfd29'}], 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:12.441096 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. Aug 30 17:38:12.445285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.448434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-199ff5bb-e052-4ec3-9fc1-e0f987c85dcd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Block Device 193a52ed-aaa2-4018-929e-b879fc9dfd29 is not bootable. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:12.449595 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-199ff5bb-e052-4ec3-9fc1-e0f987c85dcd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.190770 Aug 30 17:38:12.453404 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1571/2995] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:12.461255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:12.461541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c5f232c-737e-4544-bf65-ca0a86598157] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:12.478642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:12.480654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:12.482585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:12.484445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:12.485919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:12.487224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:12.526444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] HTTP exception thrown: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Request method failure captured: Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 HTTP/1.1 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkkxPJmy4kmEIfMpuOtRbJsP0aulfMm7q8lX67bYRUXSPjisRpdlvAnM-Nxpk1DXLPpIcMyNtLbnzjQDlyhIpT0szLbO5bKvIujhw97loc7lbPNNeSlHpNfK4b0cuLFPwsyVFPgbVKqfcJJ5afyjeR9-f1c29FZSrnNSEg-SQH769Oo Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36850e3f45ae4558a78f5f78dd09c806"}]}] Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 859d8e930c434d519e4208e58246b471 Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6c5f232c-737e-4544-bf65-ca0a86598157'} Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. Aug 30 17:38:12.533195 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Returning 404 to user: Instance 6c5f232c-737e-4544-bf65-ca0a86598157 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4d7099a-ffdb-46b3-8bf3-d97e6babfef0 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157" status: 404 len: 111 microversion: 2.25 time: 0.081199 Aug 30 17:38:12.540633 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1572/2996] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:12 2022] GET /compute/v2.1/servers/6c5f232c-737e-4544-bf65-ca0a86598157 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:12.552812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:12.554906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:12.569375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:12.569953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:12.572354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:12.573201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:12.573764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:12.574266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:12.729933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-824925186", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "410e9fc4-5dde-4843-b748-ff4d5066e9b2"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:12.881463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] validate_networks() for [('410e9fc4-5dde-4843-b748-ff4d5066e9b2', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:38:13.198669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:13.226371 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23b52eb9-17aa-49f9-b866-15fd341cc236 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.682536 Aug 30 17:38:13.229077 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1573/2997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:12 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:13.246726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:13.251909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:13.283717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.286157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.286638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:13.287422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.287974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.293708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:13.356197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:38:13.543471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcf9210e-c39a-44b5-8449-847167e24786 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 204 len: 0 microversion: 2.25 time: 0.311429 Aug 30 17:38:13.552744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1574/2998] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:38:13 2022] DELETE /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:38:13.568680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:13.570040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:13.590529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.593418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.594795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:13.596880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.599388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.602700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:13.879157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:13.903468 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f55f8dd1-6b1f-4662-a252-6d87a09328fe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.348351 Aug 30 17:38:13.923791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1575/2999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:13 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:13.944222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:13.946031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:13.980981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.982744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.983245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:13.983996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:13.984456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:13.984882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:14.464793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:14.488127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:14.497308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:14.502084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8645bac-dbfb-44fa-afec-b5a119981e73 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1562 microversion: 2.25 time: 0.574151 Aug 30 17:38:14.523942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1576/3000] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:13 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1562 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:14.600920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:38:14.601423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:38:14.601796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:38:14.602308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:38:14.602589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:38:14.625380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:14.625923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:14.626369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:14.627133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:14.627617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:14.632077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:14.677224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Getting quotas for project f6ad7bc471e04326a2ca6044e4a294c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:38:14.690029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Getting quotas for user 977cd713892540e59847f3934585e7dc and project f6ad7bc471e04326a2ca6044e4a294c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:38:14.731232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:38:14.766333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:38:14.924617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29b8db75-91c7-4234-a211-0bb153b38c83 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.539851 Aug 30 17:38:14.929321 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1425/3001] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:38:14.954096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef727406-32e2-4136-aa6b-b217279a8765 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:14.959072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef727406-32e2-4136-aa6b-b217279a8765 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:15.436249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ef727406-32e2-4136-aa6b-b217279a8765 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:15.445450 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef727406-32e2-4136-aa6b-b217279a8765 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1223 microversion: 2.1 time: 0.508844 Aug 30 17:38:15.448283 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1577/3002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:14 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1223 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:15.536094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:15.536967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:15.576348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:15.585806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:15.589338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:15.590950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:15.594065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:15.596422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:16.340222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2110829182", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9cab1629-8217-48b1-b9c2-dfaf640a27f1"}, {"port": "bba0f423-cf95-45e7-abed-c65ef8c0787e", "tag": "port-1"}, {"port": "cea117f2-8389-4c69-b47b-df839fe977be", "tag": "port-2"}, {"uuid": "ef55dc85-9758-4a29-b766-0ce9dcdcb635", "tag": "net-1"}, {"uuid": "ef55dc85-9758-4a29-b766-0ce9dcdcb635"}, {"uuid": "a6143589-53f8-4924-9de3-c6b9b0509502", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a6143589-53f8-4924-9de3-c6b9b0509502", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b3fb81c5-f2f7-47fb-bea2-5a16d8ecf5f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1c5635d8-46a9-4072-9af9-b1ce974a3fd9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d2133f6b-2575-4fb7-8580-698abe1fc16e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--485952233"}], "key_name": "tempest-keypair-1907443127", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:16.669406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] validate_networks() for [('9cab1629-8217-48b1-b9c2-dfaf640a27f1', None, None, None, None, None), (None, None, 'bba0f423-cf95-45e7-abed-c65ef8c0787e', None, None, None), (None, None, 'cea117f2-8389-4c69-b47b-df839fe977be', None, None, None), ('ef55dc85-9758-4a29-b766-0ce9dcdcb635', None, None, None, None, None), ('ef55dc85-9758-4a29-b766-0ce9dcdcb635', None, None, None, None, None), ('a6143589-53f8-4924-9de3-c6b9b0509502', '10.2.2.100', None, None, None, None), ('a6143589-53f8-4924-9de3-c6b9b0509502', '10.2.2.200', None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:38:16.755667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:16.782591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:16.793660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:16.800240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-59b76ec4-f302-4196-85db-0354c0578e4e tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1562 microversion: 2.25 time: 1.270025 Aug 30 17:38:16.803180 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1426/3003] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:15 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1562 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:16.821807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:16.826468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:16.847890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:16.850183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:16.855267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:16.857038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:16.859923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:16.862038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:17.031339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:17.058198 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cad00215-5794-422a-bef9-946c85144d98 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1275 microversion: 2.1 time: 0.241496 Aug 30 17:38:17.058957 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1427/3004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:16 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:17.079042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2f303c-c54d-4932-bf97-de42b5d5bd41", "name": "network-vif-deleted", "tag": "c37faeb8-2d36-4136-9715-a28dc7c62936"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:17.091312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:17.092109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:17.092776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:17.116831 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] Creating event network-vif-deleted:c37faeb8-2d36-4136-9715-a28dc7c62936 for instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 on n-h1-852771-11 Aug 30 17:38:17.133241 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d40f793d-88e6-4882-9b9e-900ff5c81e71 req-e08cfe9d-6102-41f7-a85f-c865ecc76446 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060038 Aug 30 17:38:17.136797 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1428/3005] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:17.831680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:17.833111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:17.844756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:17.845233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:17.856949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:17.859739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:17.862906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:17.868754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:17.982842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:17.987063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:17.988538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:17.989205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lazy-loading 'fault' on Instance uuid 6c2f303c-c54d-4932-bf97-de42b5d5bd41 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:38:18.070990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:18.089203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:18.095816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d8e930c434d519e4208e58246b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36850e3f45ae4558a78f5f78dd09c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:18.105166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1a55c63-619f-41b8-9391-ca66fcd9d338 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 200 len: 1351 microversion: 2.25 time: 0.278034 Aug 30 17:38:18.106326 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1429/3006] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:17 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:18.114353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:18.115002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:18.142279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:18.142804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:18.143370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:18.149498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:18.152199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:18.152713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:18.355266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:18.366379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17ab8373-5727-47fe-9db9-1b49be87f407 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1281 microversion: 2.1 time: 0.259063 Aug 30 17:38:18.390020 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1430/3007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:18 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1281 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:18.416812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab3f3d6d-a9df-4ab7-adf6-34155ee4b35f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251136206", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "565db0f0-616b-43a3-8762-95a8e129a515", "destination_type": "local"}, {"source_type": "volume", "uuid": "3eeb07fb-8d2e-4463-88ab-7e0247cad272", "destination_type": "invalid"}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab3f3d6d-a9df-4ab7-adf6-34155ee4b35f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 494 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251136206", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "565db0f0-616b-43a3-8762-95a8e129a515", "destination_type": "local"}, {"source_type": "volume", "uuid": "3eeb07fb-8d2e-4463-88ab-7e0247cad272", "destination_type": "invalid"}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-251136206', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '565db0f0-616b-43a3-8762-95a8e129a515', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3eeb07fb-8d2e-4463-88ab-7e0247cad272', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:18.425707 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 17:38:18.429408 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:18.433798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab3f3d6d-a9df-4ab7-adf6-34155ee4b35f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:18.435086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab3f3d6d-a9df-4ab7-adf6-34155ee4b35f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022289 Aug 30 17:38:18.439578 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1431/3008] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:18 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:18.455136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:18.456797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:18.475036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:18.483267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:18.483969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:18.485496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:18.486418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:18.487047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:18.972486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:18.982190 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97d889b7-3259-4d59-b522-58f00908130f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.537718 Aug 30 17:38:18.985541 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1432/3009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:18 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:19.012160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:19.012981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:19.024020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.028689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.029206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.031043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.032804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.033279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.477450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:19.492183 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1841baa7-5976-45dd-9fdf-de52862a06e6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.484346 Aug 30 17:38:19.497469 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1433/3010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:19 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:19.512415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:19.513282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] [instance: 6c2f303c-c54d-4932-bf97-de42b5d5bd41] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:19.526086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.526750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.528826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.529740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.531427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.532568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.577791 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] HTTP exception thrown: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Request method failure captured: Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 HTTP/1.1 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkkxPJmy4kmEIfMpuOtRbJsP0aulfMm7q8lX67bYRUXSPjisRpdlvAnM-Nxpk1DXLPpIcMyNtLbnzjQDlyhIpT0szLbO5bKvIujhw97loc7lbPNNeSlHpNfK4b0cuLFPwsyVFPgbVKqfcJJ5afyjeR9-f1c29FZSrnNSEg-SQH769Oo Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36850e3f45ae4558a78f5f78dd09c806"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36850e3f45ae4558a78f5f78dd09c806"}]}] Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 36850e3f45ae4558a78f5f78dd09c806 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 859d8e930c434d519e4208e58246b471 Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1256113465-project Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '6c2f303c-c54d-4932-bf97-de42b5d5bd41'} Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. Aug 30 17:38:19.580526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. Aug 30 17:38:19.584892 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.588565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] Returning 404 to user: Instance 6c2f303c-c54d-4932-bf97-de42b5d5bd41 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:19.594236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-226e2009-fa28-4fb1-b12f-4936d167ef03 tempest-LiveAutoBlockMigrationV225Test-1256113465 tempest-LiveAutoBlockMigrationV225Test-1256113465-project] 10.222.0.50 "GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41" status: 404 len: 111 microversion: 2.25 time: 0.095477 Aug 30 17:38:19.595098 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1434/3011] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:19 2022] GET /compute/v2.1/servers/6c2f303c-c54d-4932-bf97-de42b5d5bd41 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:19.603230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:19.625988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:19.656150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.669884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.675878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.677438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.678157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.680146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.867365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:19.876530 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2634be0-e0fd-4acc-8ac4-df20fd53ca3a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1281 microversion: 2.1 time: 0.280071 Aug 30 17:38:19.877119 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1435/3012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:19 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1281 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:19.904950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48bf398c-ca6b-4e93-bceb-8dc2ff4d8452 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1258915172", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48bf398c-ca6b-4e93-bceb-8dc2ff4d8452 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 492 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1258915172", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1258915172', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.919866 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48bf398c-ca6b-4e93-bceb-8dc2ff4d8452 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48bf398c-ca6b-4e93-bceb-8dc2ff4d8452 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025910 Aug 30 17:38:19.924099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1436/3013] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:19 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:19.930232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:19.930717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:19.947902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.948377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.948808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:19.949639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:19.950360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:19.951048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:20.310590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:20.320727 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2cd95bab-2b81-4b93-b775-44bff4e87ebc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.394236 Aug 30 17:38:20.325178 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1437/3014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:19 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:20.345153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:20.346082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:20.359410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:20.359951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:20.360386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:20.361083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:20.361535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:20.361934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:21.170831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:21.180093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e9db200-4440-49d6-85ee-862fc9893420 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.838765 Aug 30 17:38:21.196951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1438/3015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:20 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:21.202084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:21.213785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:21.234863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:21.235640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:21.236238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:21.237152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:21.238444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:21.239199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:21.280424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:21.480140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:38:21.480566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:38:21.481047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:38:21.481468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:38:21.481878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:38:21.486570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:21.501381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:21.502071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:21.502679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:21.503725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:21.506337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:21.506938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:21.561843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Getting quotas for project 90a7e4b51e574eedbd25ece987c09b8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:38:21.589757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Getting quotas for user 3425189160ed4a2ca2eede57b605bf66 and project 90a7e4b51e574eedbd25ece987c09b8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:38:21.872114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:38:21.875096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b3fb81c5-f2f7-47fb-bea2-5a16d8ecf5f1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1c5635d8-46a9-4072-9af9-b1ce974a3fd9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2133f6b-2575-4fb7-8580-698abe1fc16e',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:38:21.999642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.009384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f48f008b-65d9-42dc-a346-c206f32622ef tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 0.811058 Aug 30 17:38:22.009992 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1439/3016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:21 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:22.049609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fb52369-2479-43e7-9c64-d54d7af50023 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fb52369-2479-43e7-9c64-d54d7af50023 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 416 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.054945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:38:22.058130 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:22.073816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3fb52369-2479-43e7-9c64-d54d7af50023 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:22.077609 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3fb52369-2479-43e7-9c64-d54d7af50023 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.046533 Aug 30 17:38:22.078417 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1440/3017] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:22 2022] POST /compute/v2.1/servers => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:22.088205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:22.095785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:22.109142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.115714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.116505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.117529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.119576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.120264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.431286 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad286c5e-fb16-4e70-a3b5-7d7d8801d9b1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.095789 Aug 30 17:38:22.432266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1578/3018] 10.222.0.50 () {62 vars in 1189 bytes} [Tue Aug 30 17:38:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 6098 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 17:38:22.455892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:22.457258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:22.550388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.561162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.562569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.566193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c41f660-63b4-44f1-8eef-e5bbd7c06e4b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1286 microversion: 2.32 time: 0.126357 Aug 30 17:38:22.568347 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1579/3019] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:22 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:38:22.582667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:22.588651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:22.595408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.599224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.599901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.601236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.602517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.603233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.789520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.806939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a99b2f8-2971-49d9-a386-2919ca93d8c1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.720598 Aug 30 17:38:22.811454 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1441/3020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:22 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:22.840968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:22.841866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:22.852060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.853007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.853439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.854176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.854697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.855118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.920202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:22.928845 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-381867d9-c5a1-4951-a9dc-625f91c7db71 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.351800 Aug 30 17:38:22.943598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1580/3021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:22 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:22.953370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:22.954019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:22.971301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.971758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.973720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.974598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:22.975265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:22.975921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:22.998485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:23.250968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:23.264346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ada14249-a044-454e-b9b6-d63bbda075bd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.314510 Aug 30 17:38:23.267107 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1581/3022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:22 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:23.291658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:23.292775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:23.301982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:23.302703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:23.303380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:23.307460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:23.321856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:23.322608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:23.561790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:23.575043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f203f3ed-9fe6-4dd3-be44-b20a3a93d5d5 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 0.306633 Aug 30 17:38:23.595994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1582/3023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:23 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:23.599647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:23.603181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:23.621131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:23.621667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:23.622190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:23.623121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:23.623980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:23.624779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:23.832259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:23.846160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e7c8e2d-b909-48e8-8656-81d69780155f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.257421 Aug 30 17:38:23.847378 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1583/3024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:23 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:23.852336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:23.852951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:23.982528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:23.989710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:24.005546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:24.008320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:24.010311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb108091-b71c-4b0d-8a61-a4e20228b52a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1286 microversion: 2.32 time: 0.161613 Aug 30 17:38:24.011422 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1584/3025] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:23 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:24.012836 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-10a4827e-e141-4e77-ac0b-db43ce92301b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.176043 Aug 30 17:38:24.018038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1095762767"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:24.022414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:24.023266 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1442/3026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:22 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:24.037944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.039502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.040208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.041622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.041996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.042706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.339058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afe90a81-0be6-4ee5-bc21-ecfecd56ddf5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1058363202", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": -1, "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:24.371265 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-afe90a81-0be6-4ee5-bc21-ecfecd56ddf5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Flavor -1 could not be found. Aug 30 17:38:24.389513 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d2fc53f-ef68-42e5-ac20-7b1865d0deb9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.376424 Aug 30 17:38:24.390206 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1585/3027] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:38:24 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afe90a81-0be6-4ee5-bc21-ecfecd56ddf5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 206 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1058363202", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": -1, "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: exception: Flavor -1 could not be found. Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1058363202', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': -1, 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:24.416316 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afe90a81-0be6-4ee5-bc21-ecfecd56ddf5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:24.423455 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afe90a81-0be6-4ee5-bc21-ecfecd56ddf5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.083409 Aug 30 17:38:24.426563 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1443/3028] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:24 2022] POST /compute/v2.1/servers => generated 73 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 30 17:38:24.433592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:24.434604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:24.455032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.455544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.456212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.457275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.458619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.459342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.530885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:24.547446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.548268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.548933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.563022 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] Creating event network-changed:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:38:24.581880 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-be14ecd2-c7cb-4b96-9d1d-7e16221ee96b req-57ee5311-4d31-431e-bebb-5ee580115000 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053331 Aug 30 17:38:24.584015 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1444/3029] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:38:24.605103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:24.606313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:24.619001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.621387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.623861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.624882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.625567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.627786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.669671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:24.691246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:24.703545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8afe4ead-0ff1-4cb1-991f-d082d441a3f6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.272291 Aug 30 17:38:24.707141 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1586/3030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:24 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:24.718265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:24.728499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:24.729501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:24.738131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.739089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.740032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.741611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:24.742465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:24.743200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:24.937972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:24.949221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bfe2336-d991-40a0-b96e-7c8dfe8a02cc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.225271 Aug 30 17:38:24.950590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1587/3031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:24 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:25.036027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:25.036935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:25.048369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.049518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.050255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:25.051846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.052576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.058087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:25.180085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:25.199245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:25.203721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:25.209220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f26f795-49ec-4749-b1e4-4296b4b8950f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1520 microversion: 2.32 time: 0.178829 Aug 30 17:38:25.215163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:25.225311 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1588/3032] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:25 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:38:25.234223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf1a014e-371f-4d4b-815a-e336878fe511 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 0.633626 Aug 30 17:38:25.234839 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1445/3033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:24 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:25.321924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b07f80c-6551-41f8-bc19-fa96b832c6f8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523749913", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b07f80c-6551-41f8-bc19-fa96b832c6f8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 173 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523749913", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1523749913', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi -1 Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:25.330755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b07f80c-6551-41f8-bc19-fa96b832c6f8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:25.336216 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b07f80c-6551-41f8-bc19-fa96b832c6f8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020694 Aug 30 17:38:25.340245 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1589/3034] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:25 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:25.344132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:25.344766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:25.358890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.359387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.359916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:25.360626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.361262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.361697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:25.778292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:25.797873 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc25445d-0664-4a2d-a449-945672e50fbd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.455562 Aug 30 17:38:25.799564 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1446/3035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:25 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:25.822121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:25.823348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:25.832307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.833370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.844716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:25.845873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:25.846517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:25.848043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.178672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:26.196491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18ee7a54-fad3-4227-a350-205418d19b5c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.378350 Aug 30 17:38:26.211743 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1590/3036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:25 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:26.234999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:26.236182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:26.263713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.264459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.292016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:26.298631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:26.307084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.315015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.315282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.316539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.317587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.318080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.324177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.324358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.326619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.327321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.560341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:26.578266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:26.589337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:26.590776 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f5f18f6-f07e-4ad6-8754-a6a5028d65aa tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1594 microversion: 2.32 time: 0.360448 Aug 30 17:38:26.591504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1447/3037] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:26 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1594 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:26.603033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98c9befe-f7d6-4cc8-a01c-4e8ef0f97c7b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561149958", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:26.632640 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-98c9befe-f7d6-4cc8-a01c-4e8ef0f97c7b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98c9befe-f7d6-4cc8-a01c-4e8ef0f97c7b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 216 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561149958", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1561149958', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:26.634577 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98c9befe-f7d6-4cc8-a01c-4e8ef0f97c7b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98c9befe-f7d6-4cc8-a01c-4e8ef0f97c7b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.037608 Aug 30 17:38:26.642225 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1448/3038] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:26 2022] POST /compute/v2.1/servers => generated 123 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:26.650561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:26.651235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:26.670801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.671321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.671928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.672717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:26.673204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:26.673659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:26.919234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:26.928430 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b9c0f0e-32b7-467c-9f2e-e9af524caf46 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 0.669846 Aug 30 17:38:26.950773 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1591/3039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:26 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:27.366164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:27.390662 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ccc7a90-f5f6-4763-bcc7-f4173b71c095 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.744103 Aug 30 17:38:27.394379 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1449/3040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:26 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:27.417771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:27.418406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:27.429248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:27.435184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:27.436813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:27.437756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:27.445690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:27.446145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:27.621589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:27.622220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:27.634246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:27.634753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:27.635197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:27.635994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:27.641458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:27.645912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:27.910792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:27.932129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc5f5e4b-7000-4770-be21-f816f2d6b3b2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.508691 Aug 30 17:38:27.948268 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1592/3041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:27 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:27.979129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:27.986711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:28.009395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:28.009940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:28.014847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:28.016893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:28.019373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:28.021112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:28.830521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:28.859992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3def4b65-db3a-4a44-92d1-9c7c1eacbfd0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 0.896462 Aug 30 17:38:28.868155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1593/3042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:27 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:28.886973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1078150701", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-key-1073313100", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:29.009046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:29.038761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] validate_networks() for [('b04f80f1-00e2-4aae-9f21-9d1a2fe06163', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:38:29.039409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:29.046181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:29.052717 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32020913-3802-49d5-a259-db08a88f5b0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1661 microversion: 2.32 time: 1.435269 Aug 30 17:38:29.056152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1450/3043] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:27 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1661 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:29.887836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:29.888637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:29.902397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:29.913988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:29.924423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:29.940056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:29.941427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:29.941850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:30.059108 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Invalid key_name provided. Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 247 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1078150701", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-key-1073313100", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid key_name provided. Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1078150701', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'key_name': 'tempest-key-1073313100', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1073313100 not found for user f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:30.061000 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid key_name provided. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:30.067242 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-616efe05-2432-4bdd-a903-41324481fe76 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.193250 Aug 30 17:38:30.069883 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1594/3044] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:28 2022] POST /compute/v2.1/servers => generated 70 bytes in 1201 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:38:30.078015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:30.078638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:30.103296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:30.118687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:30.118687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:30.118687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:30.118687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:30.118687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:30.581985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:30.592294 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-583b5516-758b-497f-91b7-27b01e445bfd tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.518064 Aug 30 17:38:30.613806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1595/3045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:30 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:30.619045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:30.626295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:30.641444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:30.642642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:30.644538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:30.645818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:30.656248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:30.656950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:31.202228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:31.260065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:31.270484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:31.284919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c88969d-e910-4e6b-ab2e-66fb0a4f7200 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1661 microversion: 2.32 time: 0.662905 Aug 30 17:38:31.298552 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1596/3046] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:30 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1661 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:31.340771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:31.342818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:31.368099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:31.372694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:31.374182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:31.385826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:31.386537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:31.389634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:31.538323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:31.607600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:31.622583 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f7bf727-5cdd-48bd-9513-53f28011741d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 1.738496 Aug 30 17:38:31.626032 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1451/3047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:29 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:31.645614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-plugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:31.687685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:31.690011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:31.690523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:31.741491 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] Creating event network-vif-plugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:38:31.761105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-02170161-98ea-4393-a897-6f65d4a96eee req-79766b13-7146-40a5-b9a8-a5927f94b1cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127246 Aug 30 17:38:31.763496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1452/3048] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:32.038763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:32.050434 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ddc91a49-3b32-4a77-b81f-17839a449a10 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.732405 Aug 30 17:38:32.073835 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1597/3049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:31 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:32.325192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:32.326008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:32.349662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:32.351638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:32.353072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:32.354098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:32.355662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:32.359685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:32.492401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-374224262", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:32.738256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Neutron security group does_not_exist not found {{(pid=122124) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 30 17:38:32.739148 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 257 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-374224262", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-374224262', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 30 17:38:32.759357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 30 17:38:32.763761 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:32.774739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:32.781736 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59dacdc7-6d1b-4f58-9346-001349d94bbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.295584 Aug 30 17:38:32.782712 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1598/3050] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:32 2022] POST /compute/v2.1/servers => generated 106 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:38:32.798189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:32.808272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:32.822939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:32.824642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:32.826039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:32.828250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:32.830076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:32.830775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:34.004542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:34.121571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:34.135302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:34.136808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:34.146562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8013a9cd-2324-4265-846a-b528aaca17d1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1707 microversion: 2.32 time: 1.827327 Aug 30 17:38:34.149590 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1453/3051] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:32 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1707 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:34.161244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:34.162642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:34.182973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:34.185493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:34.186505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:34.192391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:34.194170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:34.195757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:34.288108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:34.298745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-956445a4-760f-4ce9-944c-2f7de4f1692c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 1.512989 Aug 30 17:38:34.299852 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1599/3052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:32 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:35.172998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:35.175597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:35.189380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.191773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.194082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.196731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.199420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.200273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.423222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:35.464075 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3315bc0-01fc-46da-8a84-e7be45e619fb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.313225 Aug 30 17:38:35.475421 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1454/3053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:34 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:35.499757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:35.500542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:35.525454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.530078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.531847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.537082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.537963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.545013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.722657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:35.726252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:35.745779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:35.750845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:35.754855 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fdb733e-80e1-49ac-b7f2-8cc1cca8a544 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1707 microversion: 2.32 time: 0.588341 Aug 30 17:38:35.758022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1600/3054] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:35 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1707 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:35.764927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "name": "network-vif-plugged", "status": "completed", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:35.798885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.800431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.801723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.841600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] Creating event network-vif-plugged:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:38:35.854319 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-09fc595a-e246-427f-a8e1-c4ed5b793f9a req-cc2e979e-3649-46a5-946a-18bc99bb916c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093360 Aug 30 17:38:35.856888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1601/3055] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:35.874330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:35.880992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:35.898779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.900575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.900956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:35.904313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:35.904915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:35.905451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:36.443988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:36.458794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92fb8a8c-672e-47db-bca8-6096ea1b824b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.598974 Aug 30 17:38:36.481303 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1602/3056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:35 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:36.498708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:36.503420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 573fc90d-f47a-4b17-a288-94f8d305949e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:36.517764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/573fc90d-f47a-4b17-a288-94f8d305949e HTTP/1.1 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '573fc90d-f47a-4b17-a288-94f8d305949e'} Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:36.520222 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. Aug 30 17:38:36.524106 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:36.531163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 573fc90d-f47a-4b17-a288-94f8d305949e could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:36.533443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b9e7933-00ea-4b42-8199-52654f280d91 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/573fc90d-f47a-4b17-a288-94f8d305949e" status: 404 len: 111 microversion: 2.1 time: 0.046966 Aug 30 17:38:36.543926 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1603/3057] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:38:36 2022] DELETE /compute/v2.1/servers/573fc90d-f47a-4b17-a288-94f8d305949e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:38:36.558521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:36.560241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:36.579127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:36.581575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:36.584024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:36.585040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:36.585828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:36.587726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:37.208503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:37.220087 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae23a6f3-86c9-495e-b738-62e2481e68b3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1323 microversion: 2.1 time: 1.742846 Aug 30 17:38:37.238817 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1455/3058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:35 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1323 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:37.259468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:37.263927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:37.293448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:37.302454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:37.303451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:37.306563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:37.308493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:37.315634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:37.317335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:37.523767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:37.540029 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc84883e-e199-4b20-9068-246ec8f38995 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.993680 Aug 30 17:38:37.564199 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1604/3059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:36 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:37.591572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:37.593913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:37.620177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:37.622680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:37.624235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:37.625183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:37.629101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:37.629777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:38.470496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:38.482863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:38.484790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:38.486277 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e402920-0e93-4f01-941e-9f03a3e29e89 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1753 microversion: 2.32 time: 1.245340 Aug 30 17:38:38.488520 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1456/3060] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:37 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1753 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:38.493450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:38.494391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:38.501273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:38.502261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:38.502876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:38.504019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:38.504622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:38.505294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:39.193209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:39.229684 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0014381f-89d3-41b9-98af-173d9d8fdc70 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.650273 Aug 30 17:38:39.233541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1605/3061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:37 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:39.257993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:39.260535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:38:39.261282 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 9223372036854775808 could not be found. Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9223372036854775808'} Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:39.269546 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:39.277023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:39.277023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:39.277023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:39.277023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 30 17:38:39.277023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:39.280382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:39.281476 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1786975f-e048-4696-9982-8e68c4e74e2f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.029596 Aug 30 17:38:39.284702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1606/3062] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 30 17:38:39 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:38:39.302631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:39.307633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:39.365878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:39.366390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:39.366831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:39.380164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:39.380835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:39.381403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:39.690024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:39.710628 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa75ce0b-6907-45c1-8559-fa6c1efac02d tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 200 len: 1518 microversion: 2.1 time: 1.220336 Aug 30 17:38:39.714233 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1457/3063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:38 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 1518 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:39.724918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:39.727200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:39.742151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:39.743099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:39.745135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:39.748331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:39.749171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:39.749770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:40.959113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:40.991182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:40.997257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:41.005767 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73dc968c-7eab-48dd-9970-08f4763f7366 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1753 microversion: 2.32 time: 1.289762 Aug 30 17:38:41.006752 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1458/3064] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:39 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1753 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:41.024820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57355965-39ce-4d1e-ac42-8e2a4df07155 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'create', calling method: .version_select at 0x7f2d986dcca0>, body: {"pool": null} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:41.071290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:41.083592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e07d88dd-192c-44a4-897a-5ef80a43b36d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.793239 Aug 30 17:38:41.096188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1607/3065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:39 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:41.126251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:41.128009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:41.160424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:41.161242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:41.163456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:41.170714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:41.171543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:41.176316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:42.125680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:42.135071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09f07180-7c1d-455f-ade7-4973bd6b83cb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.013076 Aug 30 17:38:42.141074 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1608/3066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:41 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:42.161550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:42.162629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:42.182199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:42.183947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:42.185212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:42.187235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:42.192022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:42.193320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:43.415767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:43.445358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:43.448636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:43.452764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73fdd44a-0679-4e84-91a8-062acf710032 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1799 microversion: 2.32 time: 1.309410 Aug 30 17:38:43.468805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1609/3067] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:42 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1799 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:43.490375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:43.491142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Failed to fetch instance by id -1 {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:38:43.492725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance -1 could not be found. Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance -1 could not be found. Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '-1'} Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:43.495712 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:43.500622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:43.500622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:43.500622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 30 17:38:43.500622 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:43.504567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:43.505637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-096c72dd-bc94-48eb-8d43-0df9ce3552b7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034064 Aug 30 17:38:43.508398 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1610/3068] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:38:43 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:38:43.530039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:43.530915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:43.553473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:43.554243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:43.555003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:43.556737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:43.557382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:43.557974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:43.954138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:43.965679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c96b26a2-e74f-4fc8-8dc5-4e56eeda384a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.452392 Aug 30 17:38:43.967922 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1611/3069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:43 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:43.990970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:43.991966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:44.009445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:44.010530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:44.011141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:44.014000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:44.016204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:44.016805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:44.394735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:44.405071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0be9246-1646-40b8-9487-5c11d080d36a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.419388 Aug 30 17:38:44.409432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1612/3070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:43 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:44.435826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:44.437311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: ba3970f4-52cc-4390-bd8e-143a22ac1cb8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:44.461034 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/ba3970f4-52cc-4390-bd8e-143a22ac1cb8/action HTTP/1.1 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 19 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: {"forceDelete": {}} Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'ba3970f4-52cc-4390-bd8e-143a22ac1cb8', 'body': {'forceDelete': {}}} Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:44.477663 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:44.482463 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:44.482463 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:44.482463 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. Aug 30 17:38:44.482463 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:44.483999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance ba3970f4-52cc-4390-bd8e-143a22ac1cb8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:44.485024 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-33458983-b38a-435a-86de-32759360afc5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/ba3970f4-52cc-4390-bd8e-143a22ac1cb8/action" status: 404 len: 111 microversion: 2.1 time: 0.055556 Aug 30 17:38:44.486340 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1613/3071] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:38:44 2022] POST /compute/v2.1/servers/ba3970f4-52cc-4390-bd8e-143a22ac1cb8/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:38:44.499045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:44.506356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:44.530967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:44.535079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:44.537051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:44.541010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:44.544976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:44.545605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:45.120151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:45.136020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:45.155201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:45.165140 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71a7729d-8670-4e36-9da1-536ded8abbcb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1799 microversion: 2.32 time: 0.669803 Aug 30 17:38:45.166120 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1614/3072] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:44 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1799 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:45.185472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:45.191200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:45.210034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:45.212047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:45.215726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:45.217172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:45.218121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:45.219079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:45.834356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:45.849311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d0f6065-a09c-471a-a8ef-2ca32a3555a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.677389 Aug 30 17:38:45.859737 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1615/3073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:45 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:45.882970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:45.883633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:45.919067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:45.928120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:45.934113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:45.934951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:45.935439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:45.939715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:47.637062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:47.664014 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a18b0ae-46e5-4021-a573-877ae32aef24 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.782593 Aug 30 17:38:47.666367 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1616/3074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:45 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:47.687455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:47.688241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:47.741179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:47.741691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:47.742118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:47.757146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:47.760386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:47.761149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:48.443302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:48.458840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:48.461489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:48.466887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f155882-beaf-4e60-83d2-785bd973c10f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1845 microversion: 2.32 time: 0.799209 Aug 30 17:38:48.474310 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1617/3075] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:47 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1845 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:48.490933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:48.512597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 8cb52bd0-f30a-46ed-88d4-095e89d93e6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:48.521744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/8cb52bd0-f30a-46ed-88d4-095e89d93e6b/action HTTP/1.1 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 39 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: {"os-getConsoleOutput": {"length": 10}} Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8cb52bd0-f30a-46ed-88d4-095e89d93e6b', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:48.530788 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. Aug 30 17:38:48.535085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:48.537586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 8cb52bd0-f30a-46ed-88d4-095e89d93e6b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:48.538701 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8145314c-1589-41d7-a9d5-a3337b499090 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/8cb52bd0-f30a-46ed-88d4-095e89d93e6b/action" status: 404 len: 111 microversion: 2.1 time: 0.062834 Aug 30 17:38:48.539779 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1618/3076] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:38:48 2022] POST /compute/v2.1/servers/8cb52bd0-f30a-46ed-88d4-095e89d93e6b/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:38:48.557239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:48.558580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:48.570860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:48.577880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:48.578905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:48.582940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:48.584361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:48.585051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:49.180708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:49.188734 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a1641aa-1820-48e9-905c-f0b8da1ec896 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.645134 Aug 30 17:38:49.199428 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1619/3077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:48 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:49.220966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "9e866e5a-f52d-4312-8c67-fb8506e0b7a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:49.251230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:49.252038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:49.253059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:49.295854 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] Creating event network-changed:9e866e5a-f52d-4312-8c67-fb8506e0b7a6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:38:49.305077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-efa5f415-a4bb-4e86-ba51-ec16c98e5caa req-53dab353-d9c8-4857-a946-571c077323a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104051 Aug 30 17:38:49.306336 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1620/3078] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:49.318015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:49.320288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:49.332336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:49.335171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:49.341883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:49.343043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:49.343760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:49.344418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:49.741265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:50.337212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:50.350028 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a8b189c-e79d-4804-a24d-f2920ee4dfcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.042209 Aug 30 17:38:50.359750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1621/3079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:49 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:50.380739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:50.386934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:50.412421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:50.414313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:50.415327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:50.415997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:50.417228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:50.417894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:50.418524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:50.967233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=91 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:51.035812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:51.060127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:51.069031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:51.070422 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04dd1ab5-3fd6-496e-a07a-c08cf93fbf48 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1866 microversion: 2.32 time: 0.709238 Aug 30 17:38:51.082602 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1622/3080] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:50 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1866 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:51.089621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:51.090266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: f3aee140-df0a-45ce-86b1-feddfd309361] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:51.125489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f3aee140-df0a-45ce-86b1-feddfd309361 HTTP/1.1 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f3aee140-df0a-45ce-86b1-feddfd309361'} Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:51.133943 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:51.138047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:51.138047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:38:51.138047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:38:51.138047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. Aug 30 17:38:51.138047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:51.143465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance f3aee140-df0a-45ce-86b1-feddfd309361 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:51.144542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b94c380-6425-4fab-8abe-d6bbda3482bc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/f3aee140-df0a-45ce-86b1-feddfd309361" status: 404 len: 111 microversion: 2.1 time: 0.070616 Aug 30 17:38:51.161839 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1623/3081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:51 2022] GET /compute/v2.1/servers/f3aee140-df0a-45ce-86b1-feddfd309361 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:38:51.177258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:51.178389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:51.197800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:51.200347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:51.201012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:51.202736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:51.204308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:51.205357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:52.546413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:52.550850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:38:52.596886 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6bf6f8a-6ce1-4b96-810b-a98e063e8e05 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.425999 Aug 30 17:38:52.597522 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1624/3082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:51 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:52.643134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:52.643891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:52.666898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:52.669163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:52.671163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:52.675393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:52.691332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:52.692070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:53.196506 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57355965-39ce-4d1e-ac42-8e2a4df07155 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 12.187767 Aug 30 17:38:53.197458 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1459/3083] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:38:41 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 12189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:53.202777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "bba0f423-cf95-45e7-abed-c65ef8c0787e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:53.282050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:53.282980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:53.284304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:53.371029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] Creating event network-changed:bba0f423-cf95-45e7-abed-c65ef8c0787e for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:38:53.389743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-716551a8-865b-451d-80fc-b372ad8408e8 req-84c45a57-17ab-406a-bf99-8b62c06ee72d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183741 Aug 30 17:38:53.409142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1460/3084] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:53.437121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:53.445370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:53.459281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:53.460063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:53.460668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:53.465285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:53.467159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:53.468937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:53.487785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:53.505923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:53.507494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:53.512912 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f0becb39-c38d-4375-b7a6-892535272e0f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1866 microversion: 2.32 time: 0.908141 Aug 30 17:38:53.535874 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1625/3085] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:52 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1866 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:53.604372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-289131047", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "410e9fc4-5dde-4843-b748-ff4d5066e9b2"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:53.734223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] validate_networks() for [('410e9fc4-5dde-4843-b748-ff4d5066e9b2', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:38:54.391264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:54.414378 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a4a95df-d2a7-44c6-a564-27cb4908f048 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.996525 Aug 30 17:38:54.436843 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1461/3086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:53 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:54.539356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:54.540023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:54.571026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:54.576917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:54.577433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:54.582571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:54.585643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:54.586104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:55.369626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:55.390179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:55.396832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:55.402513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ce607a5-063e-4b7e-bb27-bcb5dd0d3ffe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1866 microversion: 2.32 time: 0.864590 Aug 30 17:38:55.405648 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1462/3087] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:54 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1866 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:38:55.425359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70358038-cb0e-45a7-b8ee-cf5ac4f1607d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1963121692", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70358038-cb0e-45a7-b8ee-cf5ac4f1607d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 238 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1963121692", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1963121692', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.463770 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70358038-cb0e-45a7-b8ee-cf5ac4f1607d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70358038-cb0e-45a7-b8ee-cf5ac4f1607d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.056083 Aug 30 17:38:55.468464 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1463/3088] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:55.474436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:55.475055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:55.512147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:55.512670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:55.513128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:55.513867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:55.514322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:55.514752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:55.903132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:55.913397 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3b55dfd-719d-475e-8445-2a600ed9ca52 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.442742 Aug 30 17:38:55.921488 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1464/3089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:55 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:38:55.951804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:55.953895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:55.974065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:55.974958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:55.977561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:55.981778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:55.983068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:55.985867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:56.373015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:56.384165 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a9438cf-7095-4817-ab61-1be1c910f3e9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.440854 Aug 30 17:38:56.385449 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1465/3090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:55 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:56.432687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:56.433440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:56.449337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:56.450182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:56.451348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:56.453029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:56.454364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:56.457213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:56.787662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:38:56.788645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:38:56.789316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:38:56.789919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:38:56.790522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:38:56.821378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:56.829320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:56.831201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:56.837464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:56.848363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:56.856181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:56.997715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Getting quotas for project f6ad7bc471e04326a2ca6044e4a294c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:38:57.036546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Getting quotas for user 977cd713892540e59847f3934585e7dc and project f6ad7bc471e04326a2ca6044e4a294c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:38:57.093776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:38:57.100949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:38:57.319711 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7eb3e77-7938-427d-830e-87e6686edaa3 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.717574 Aug 30 17:38:57.328026 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1626/3091] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:38:57.341092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6bc538-1178-402c-9cf6-3f4df553fed0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-665921667", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6bc538-1178-402c-9cf6-3f4df553fed0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 234 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-665921667", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-665921667', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.366019 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 17:38:57.370937 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:38:57.374730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6bc538-1178-402c-9cf6-3f4df553fed0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:38:57.380314 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e6bc538-1178-402c-9cf6-3f4df553fed0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050631 Aug 30 17:38:57.386711 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1627/3092] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:38:57 2022] POST /compute/v2.1/servers => generated 133 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:38:57.409285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-51752a7c-773c-4b9c-b9be-e38be517ebb2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:57.414573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-51752a7c-773c-4b9c-b9be-e38be517ebb2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:57.500882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:57.526112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:57.536851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:57.542684 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e8d5e55-fb1d-4cbd-8b93-c31cbb5c5744 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 1.115161 Aug 30 17:38:57.547865 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1466/3093] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:56 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:57.571638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:57.573859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:57.595275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:57.596178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:57.597522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:57.598262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:57.600528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:57.601179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:57.805911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51752a7c-773c-4b9c-b9be-e38be517ebb2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:57.813550 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-51752a7c-773c-4b9c-b9be-e38be517ebb2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1223 microversion: 2.1 time: 0.425779 Aug 30 17:38:57.819843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1628/3094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:57 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1223 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:57.854180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "cea117f2-8389-4c69-b47b-df839fe977be"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:38:57.934725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:57.935208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:57.935668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:57.986124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] Creating event network-changed:cea117f2-8389-4c69-b47b-df839fe977be for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:38:57.997935 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-40f32fc5-0258-4929-8b25-bf2623bdd28e req-41ec172f-8df6-4b89-af35-abd62b1b2502 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174704 Aug 30 17:38:58.000482 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1629/3095] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:38:58.274188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:58.285223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aaccedfd-15cf-4f45-bd36-d88f1cee0434 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.736263 Aug 30 17:38:58.314176 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1467/3096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:57 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:38:58.333113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:58.338761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:58.360955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:58.362135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:58.362648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:58.363818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:58.364294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:58.364733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:58.573831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:58.574972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:58.590126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:58.591269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:58.599615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:58.600504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:58.601037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:58.601450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:59.323880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:59.342276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:59.344372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:59.348446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-424e7fa9-916f-4cdb-8d52-c05ab0e8d57e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 0.780864 Aug 30 17:38:59.371686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1468/3097] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:38:58 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:38:59.378432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:38:59.379321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:38:59.392842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:59.394675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:59.397612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:59.398674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:38:59.399324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:38:59.399965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:38:59.582074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:38:59.590604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-725b422d-95dd-4aec-bbee-4192df8efaa9 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1275 microversion: 2.1 time: 0.216760 Aug 30 17:38:59.600465 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1469/3098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:59 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:00.379846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:00.380657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:00.394971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:00.395496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:00.395952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:00.413589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:00.414124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:00.420806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:00.930981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:00.945925 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c56435f0-8a42-4e3a-8284-36d6fea4bfdc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 2.623163 Aug 30 17:39:00.965821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1630/3099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:38:58 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:00.978601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:00.994169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:01.046316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.046799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.047258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:01.048087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.048553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.049015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:01.117166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:01.154457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:01.163717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:01.165339 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66fd613d-dc38-4dbd-bf42-8ed876ddf88b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 0.791006 Aug 30 17:39:01.187388 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1470/3100] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:00 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:39:01.195472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:01.203354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 3d124da0-977e-4f55-a98c-621c61c8d658] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:01.241483 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/3d124da0-977e-4f55-a98c-621c61c8d658/action HTTP/1.1 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 13 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: {"pause": {}} Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3d124da0-977e-4f55-a98c-621c61c8d658', 'body': {'pause': {}}} Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:01.256714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:01.263337 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:01.263337 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:01.263337 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. Aug 30 17:39:01.263337 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:01.276860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 3d124da0-977e-4f55-a98c-621c61c8d658 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:01.278110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff5f4267-3aa6-451a-bded-042bb77a99be tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/3d124da0-977e-4f55-a98c-621c61c8d658/action" status: 404 len: 111 microversion: 2.1 time: 0.089344 Aug 30 17:39:01.279372 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1471/3101] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:01 2022] POST /compute/v2.1/servers/3d124da0-977e-4f55-a98c-621c61c8d658/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:01.289853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:01.294518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:01.308126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.320944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.321611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:01.323110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.323707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.324244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:01.671464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:01.765779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ecb66643-e9d9-4261-b40b-572440a86760 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1281 microversion: 2.1 time: 0.790310 Aug 30 17:39:01.766437 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1631/3102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:00 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1281 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:01.781542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:01.800515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d1a9ec9-9908-4ac7-a6b4-076113a55381 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.505140 Aug 30 17:39:01.803648 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1472/3103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:01 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:01.840182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:01.846334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:01.889562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.894072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.894718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:01.897325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:01.899185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:01.900095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:02.192583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:02.193321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:02.213320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:02.220603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:02.221832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:02.230373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:02.233285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:02.236235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:02.868190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:02.881756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d31492ad-0635-4a11-af81-4fcfb6dfab41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.048158 Aug 30 17:39:02.888168 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1632/3104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:01 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:02.920015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:02.920685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:02.937483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:02.938242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:02.938859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:02.940334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:02.941109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:02.943186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:03.555716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:03.570063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-050e03c3-96a9-42e2-8c45-fb4fbb7c2f20 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.667179 Aug 30 17:39:03.578984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1633/3105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:02 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:03.600104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:03.602035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:03.624668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:03.626883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:03.628291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:03.630725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:03.632124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:03.632751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:03.959121 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4566aebc-521d-4cdd-902c-deced6c39c57 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 0.371648 Aug 30 17:39:03.964259 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1634/3106] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:03 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:39:03.977656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:03.993920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "1efd1cbc-14b8-4af8-af6a-74336c6365e6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:04.031611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:04.044416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:04.045248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:04.047877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:04.051644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:04.052911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8c15a3a-98d5-4d69-994e-034df720a80d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 1.864912 Aug 30 17:39:04.053498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1473/3107] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:02 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:04.093775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:04.094406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:04.099900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] Creating event network-changed:1efd1cbc-14b8-4af8-af6a-74336c6365e6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:04.117873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-453fec3f-8906-4837-bcea-f36e95f40424 req-865c9a12-5277-4e8c-bf20-53535e6e5d02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151280 Aug 30 17:39:04.126517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1635/3108] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:04.131551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:04.132619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:04.136081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:04.140159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:04.144286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:04.145015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:04.593484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:04.594812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:04.613951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:04.614822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:04.615561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:04.616525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:04.617232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:04.617891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:05.093987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:05.118178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e6387f7-0e3c-4007-81f5-79e2fe07eb54 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1511 microversion: 2.1 time: 1.063394 Aug 30 17:39:05.120265 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1474/3109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:04 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1511 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:05.127053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:05.128411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:05.144061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:05.146894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:05.147701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:05.150526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:05.152424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:05.153986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:05.352989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:05.367273 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0aca2f7e-18f5-4abb-af4c-ff0b593ccee7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.773147 Aug 30 17:39:05.368297 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1636/3110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:04 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:05.379030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:05.379746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:05.392577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:05.393037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:05.393611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:05.397546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:05.398127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:05.398569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.006103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.017586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67374cbe-7737-4886-8f0d-44cbc227815e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.895712 Aug 30 17:39:06.036416 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1475/3111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:05 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:06.150530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:06.152058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:06.176891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:06.177372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:06.177821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.180528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:06.183072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:06.183994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.292974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.309905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.311506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.312694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48170070-857b-4222-bbd2-1ea32575ba45 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 0.943426 Aug 30 17:39:06.315304 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1637/3112] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:05 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:06.324381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "8cfef511-9507-4a90-acfe-8095b6186336"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:06.352723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:06.353457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:06.354607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.380199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] Creating event network-changed:8cfef511-9507-4a90-acfe-8095b6186336 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:06.392318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e4c0f9c1-32e1-463e-acf0-cc70a3bf4f17 req-8e8ba009-396a-43db-8200-0feaa6e9f30b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075229 Aug 30 17:39:06.395848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1638/3113] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:06.401370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:06.415244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:06.423468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:06.424882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:06.427393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.428340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:06.430511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:06.431140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:06.724915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.734238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30290eb6-969f-4f73-8042-9894301b41a8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.336928 Aug 30 17:39:06.738987 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1639/3114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:06 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:06.927118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:06.937756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55be7ea9-ccd3-4aeb-8033-478122b4175b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1491 microversion: 2.1 time: 0.795378 Aug 30 17:39:06.964155 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1476/3115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:06 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1491 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:06.969092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:06.975089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:06.976243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:07.006057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7a2b29-e2b9-4056-a5eb-f0ed44875db3", "tag": "3217ffd2-3830-4650-bd51-83a67cea3160"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:07.006875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.015559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.016324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.020347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.021823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.023802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.042189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.043191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.043852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.098422 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'pause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state paused Aug 30 17:39:07.098637 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] Creating event network-changed:3217ffd2-3830-4650-bd51-83a67cea3160 for instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 on n-h1-852771-11 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 13 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: {"pause": {}} Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'pause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state paused Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'pause': {}}} Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state paused. Cannot pause while the instance is in this state. Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state paused Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:07.101638 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:07.105780 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:07.105780 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:07.105780 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:07.105780 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state paused Aug 30 17:39:07.105780 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:07.108448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'pause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state paused {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:07.109806 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3f56295-b8ce-4088-ab5c-831fe8ec4382 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 143 microversion: 2.1 time: 0.141535 Aug 30 17:39:07.115123 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1640/3116] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:06 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 143 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:39:07.123420 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-bd461554-7a9c-47e5-afd6-1438fc9f4107 req-b671741f-d530-44d0-8e66-9794f21f999b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122406 Aug 30 17:39:07.124262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:07.125637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:07.134611 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1477/3117] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:07.140374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.141085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.141907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.143442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.144132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.144774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.167740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:07.168260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:07.192777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.193729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.194757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.195992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.196936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.197764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.343510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:07.369836 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cb8e8060-0832-4417-9a62-53ae12f581d8 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 0.233687 Aug 30 17:39:07.370756 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1478/3118] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:07 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:39:07.387047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:07.388265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:07.400451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.401237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.401912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.403285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:07.406563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:07.407275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:07.813146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:07.994048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:07.997427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:08.021703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69089bb5-9989-4e68-b43c-0c7667129762 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.905153 Aug 30 17:39:08.041518 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1641/3119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:07 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:08.045903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:08.048397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:08.066723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fcf7b7fa-ac2a-45a2-bda7-499554ef664c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1887 microversion: 2.32 time: 0.694343 Aug 30 17:39:08.110131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:08.112006 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1479/3120] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:07 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1887 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:08.118686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:08.129111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:08.138917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:08.154030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.156034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.156737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.159210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.160511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.163113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.163919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.164413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.166291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.167197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.169566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.170185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.490246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:08.512424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79908c0a-b57d-4696-991f-b7775cfa3a8b tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.398107 Aug 30 17:39:08.513657 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1480/3121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:08 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:08.520451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-332401435"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:08.524834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:08.534504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.535175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.535883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.536754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.537446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.538133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.576699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:08.587666 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-61a25bd5-f0e7-4842-ab65-adb4b6f1e651 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.540630 Aug 30 17:39:08.588277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1642/3122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:08 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:08.632383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-unplugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:08.666775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.672442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.674980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.703238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] Creating event network-vif-unplugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:39:08.722789 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6793b5fe-0803-40ad-8bc4-0c03e97326f7 req-8fa2543e-3cea-4074-98ff-3eccf201daad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106026 Aug 30 17:39:08.729226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1643/3123] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:08.747413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "2e46b3c6-fd82-4521-b768-ee324e18d75b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:08.767028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.768642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.772257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.791875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] Creating event network-changed:2e46b3c6-fd82-4521-b768-ee324e18d75b for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:08.803590 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1fc173f2-b37a-4da7-9c05-a804ff0809de req-f20de550-0b1a-4b8d-a9c7-070e25a752be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071067 Aug 30 17:39:08.806374 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1644/3124] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:08.817918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:08.823038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:08.848654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.849538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.852737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.855142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:08.857159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:08.859072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:08.887539 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-840d6816-4f50-40a3-8e35-e83bd128bbe5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.370295 Aug 30 17:39:08.902787 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1481/3125] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:08 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 17:39:09.108389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:09.109365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:09.132979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.138627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.139550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.143645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.147294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.148392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.209860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:09.219911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf0f4a84-85c7-449f-a070-3b85f591610c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.411985 Aug 30 17:39:09.224844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1645/3126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:08 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:09.249813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:09.253410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:09.268880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.270591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.271899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.273795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.275116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.275937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.321505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action HTTP/1.1 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 28 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: {"reboot": {"type": "SOFT"}} Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5a3e733e-7964-40cc-9510-c771e03e23cc', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:09.324770 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:09.329850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7626ead8-b628-414c-8c98-2c6f69adf237 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action" status: 404 len: 111 microversion: 2.1 time: 0.084317 Aug 30 17:39:09.332257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1646/3127] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:09 2022] POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:09.342824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:09.343464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:09.356242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.356743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.360476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.362716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.363516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.363951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.412035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:09.616636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:09.630629 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8bc1713-9142-4583-812f-dbc0248f116e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.291945 Aug 30 17:39:09.638247 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1647/3128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:09 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:09.657423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:09.659581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:09.670975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.671775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.672621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.673996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.675366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.676037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.840397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:09.850323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:09.859805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:09.862579 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-895c071d-bba4-413f-ac3c-38d39b52dfa9 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.760108 Aug 30 17:39:09.864017 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1482/3129] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:09 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:09.887797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:09.889055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:09.897687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.898784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.899566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:09.900637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:09.901648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:09.902326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:10.030289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:10.042418 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86096f87-62dc-4f53-9610-d8dba70375f6 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.401735 Aug 30 17:39:10.045386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1648/3130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:09 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:10.781575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:10.794637 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec6829db-9f1d-4aa5-8081-180b9117ea84 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.915374 Aug 30 17:39:10.810378 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1483/3131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:09 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:10.816995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:10.820238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 17b91413-eff3-4c4b-91dc-64b1d8b51cfa] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:10.833989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/17b91413-eff3-4c4b-91dc-64b1d8b51cfa/action HTTP/1.1 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 28 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: {"reboot": {"type": "SOFT"}} Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '17b91413-eff3-4c4b-91dc-64b1d8b51cfa', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. Aug 30 17:39:10.835525 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 17b91413-eff3-4c4b-91dc-64b1d8b51cfa could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b8af35b-712b-4da5-ae75-bbc7f3db1f37 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/17b91413-eff3-4c4b-91dc-64b1d8b51cfa/action" status: 404 len: 111 microversion: 2.1 time: 0.027225 Aug 30 17:39:10.843471 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1649/3132] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:10 2022] POST /compute/v2.1/servers/17b91413-eff3-4c4b-91dc-64b1d8b51cfa/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:10.850534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "e09b0ace-5e6d-4599-8184-2fba845cccf9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:10.851136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:10.852558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:10.864835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:10.867355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:10.868453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:10.869960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:10.871310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:10.872183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:10.875161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:10.875673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:10.876106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:10.899752 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] Creating event network-changed:e09b0ace-5e6d-4599-8184-2fba845cccf9 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:10.916992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6e7f0852-38ab-453b-aa2b-94f515eb7015 req-95fbb645-d4d9-4175-807d-23b56a2cb964 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069866 Aug 30 17:39:10.921215 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1650/3133] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:39:10.952585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:10.953924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:10.973519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:10.976085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:10.976543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:10.977274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:10.977729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:10.978156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.309926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.320958 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cdf528eb-0eb4-496c-ac4e-1d06d8864d9f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.475035 Aug 30 17:39:11.337145 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1484/3134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:10 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:11.337827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:11.339035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:11.349576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.350516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.351183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.352168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.352961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.353644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.613941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.626493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1e3af96a-969c-4ebb-9a2b-b56a7e837437 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.293035 Aug 30 17:39:11.627301 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1485/3135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:11 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:11.633296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:11.635358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:11.643973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.644851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.645460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.647196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.647895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.648836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.763789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.778304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.781784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.788884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-071680a2-7775-4578-bf77-66e4cd126100 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.855433 Aug 30 17:39:11.789976 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1651/3136] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:10 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:11.943416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:11.953556 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00b38b2c-a456-4b54-b5d3-8693527a1447 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.325023 Aug 30 17:39:11.957731 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1486/3137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:11 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:11.978849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:11.982996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:11.993629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.994556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.995211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:11.996188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:11.996893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:11.997532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.040934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action HTTP/1.1 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 65 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5a3e733e-7964-40cc-9510-c771e03e23cc', 'body': {'rebuild': {'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515'}}} Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 17:39:12.046637 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:39:12.051379 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:12.055435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:12.058805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba6f5003-7ae8-4bdd-a0ed-203dcb98c01b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action" status: 404 len: 111 microversion: 2.1 time: 0.085288 Aug 30 17:39:12.070006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:12.071188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:12.075215 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1652/3138] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:11 2022] POST /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:12.079667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.081146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.081810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.082777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.083453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.084133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.302907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:12.316156 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-936ed78d-f6d1-43d8-b490-3818ec477072 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.251586 Aug 30 17:39:12.317067 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1487/3139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:12 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:12.345022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:12.346204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:12.356538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.359422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.359422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.359422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.363570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.364040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.652474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:12.653532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:12.666150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.670445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.676220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.679721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.681268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.683795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.885589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:12.910730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6131c7a6-f0fa-4070-b4f0-cbb477fed2e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.570947 Aug 30 17:39:12.914564 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1653/3140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:12 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:12.929476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:12.936818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:12.966405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.983377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.984467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:12.985728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.989194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:12.989701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:12.990149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:12.996664 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5522aba-a2ac-43a5-9a19-bfcd49ff9aac tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.348666 Aug 30 17:39:12.998208 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1488/3141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:12 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:39:13.004045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:13.007788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 0cd00ebb-1d08-49a4-adee-208ee2e66e2a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:13.017044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/0cd00ebb-1d08-49a4-adee-208ee2e66e2a/action HTTP/1.1 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 65 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0cd00ebb-1d08-49a4-adee-208ee2e66e2a', 'body': {'rebuild': {'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515'}}} Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 17:39:13.020618 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. Aug 30 17:39:13.025242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:13.027514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 0cd00ebb-1d08-49a4-adee-208ee2e66e2a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:13.028398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74da05f0-d7ae-4e50-8068-aacd93499f2c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/0cd00ebb-1d08-49a4-adee-208ee2e66e2a/action" status: 404 len: 111 microversion: 2.1 time: 0.029169 Aug 30 17:39:13.030633 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1489/3142] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:12 2022] POST /compute/v2.1/servers/0cd00ebb-1d08-49a4-adee-208ee2e66e2a/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:13.043253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:13.043910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:13.064794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:13.065384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:13.065671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:13.068536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:13.070064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:13.072362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:13.387666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:13.405767 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-569173c1-d1eb-44d6-a825-983f2d73d844 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.367415 Aug 30 17:39:13.406716 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1490/3143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:13 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:13.607908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:13.622988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:13.627869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:13.629373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e1a47db-3dbc-4200-a223-1148a750af93 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.712905 Aug 30 17:39:13.633533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1654/3144] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:12 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:13.647386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:13.648049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:13.661355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:13.661867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:13.662315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:13.663036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:13.663520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:13.663956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:13.783528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d30a053-e5ec-43b2-a935-e403b78732ea tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Calling method '.version_select at 0x7f2d9cb6fd30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:14.161772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:14.173609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3a7a5c3d-3189-425f-b14b-fc900586fcbb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.536932 Aug 30 17:39:14.184968 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1655/3145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:13 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:14.185732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:14.196393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:14.207559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:14.208064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:14.209422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:14.210188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:14.210699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:14.211200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:14.545310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d30a053-e5ec-43b2-a935-e403b78732ea tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 371 microversion: 2.1 time: 1.137062 Aug 30 17:39:14.561876 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1491/3146] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:39:13 2022] GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 371 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:14.576950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:14.578660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 63188ec0-fa67-480f-9f80-291a336107e7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:14.605849 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/63188ec0-fa67-480f-9f80-291a336107e7/action HTTP/1.1 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: {"restore": {}} Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '63188ec0-fa67-480f-9f80-291a336107e7', 'body': {'restore': {}}} Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:14.620047 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:14.624789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:14.624789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:14.624789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. Aug 30 17:39:14.624789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:14.627951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 63188ec0-fa67-480f-9f80-291a336107e7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:14.634590 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d66004e7-13bc-4224-9877-3a6e82ca238b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/63188ec0-fa67-480f-9f80-291a336107e7/action" status: 404 len: 111 microversion: 2.1 time: 0.071100 Aug 30 17:39:14.649495 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1492/3147] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:14 2022] POST /compute/v2.1/servers/63188ec0-fa67-480f-9f80-291a336107e7/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:14.660536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-plugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:14.697447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:14.712405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98842691-f3ee-4c83-8101-507a012478e0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.533137 Aug 30 17:39:14.712853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:14.714872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:14.715329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:14.739132 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1656/3148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:14 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:14.742023 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] Creating event network-vif-plugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:39:14.754261 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-74f9fec4-e5bf-4bf5-8186-866ff413f590 req-f91e6e02-c326-43cd-8501-5b0cbd51cfda service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102998 Aug 30 17:39:14.755227 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1493/3149] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:14.765837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:14.767558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d93d0e280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:14.772093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:14.789310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:14.790182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:14.790902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:14.791870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:14.796710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:14.797760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.136645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:15.149672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b9ca515-9bac-41ee-9e54-16e4f030c878 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.389678 Aug 30 17:39:15.154147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1494/3150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:14 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:15.161677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:15.162558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:15.189171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.194254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.196723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.199434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.201690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.205874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.452281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.452876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.453096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.453820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.454267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.469132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.678794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2035109a-7f48-4cba-a0ee-3b32f125df0f tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 328 microversion: 2.1 time: 0.935957 Aug 30 17:39:15.680061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1657/3151] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:14 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 328 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:15.686653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:15.687908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:15.699700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.700648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.701420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.706756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.707594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.708204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.916818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:15.916818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:15.916818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:15.916818 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bbf0f586-e7f4-489d-be57-fa823187dadd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.746211 Aug 30 17:39:15.934770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1495/3152] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:15 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:15.940341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:15.941022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:15.957310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.957815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.959394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:15.960377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:15.961058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:15.961672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:16.117542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:16.129360 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f909404-e5aa-4b73-847f-ee476c589d9b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.447951 Aug 30 17:39:16.130463 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1658/3153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:15 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:16.465759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:16.479289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-332bfa1c-4393-4bfd-bc59-d6c92739fa2a tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.543255 Aug 30 17:39:16.483104 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1496/3154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:15 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:16.491263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:16.498773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:16.553451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:16.556420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:16.560171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:16.561397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:16.564505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:16.565166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:16.583853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-108915597", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:16.602579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:16.640549 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'restore' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: {"restore": {}} Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'restore' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'restore': {}}} Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state active. Cannot restore while the instance is in this state. Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:16.645553 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'restore' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00d37a83-fa3e-422f-b721-fa17303daebe tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 145 microversion: 2.1 time: 0.165961 Aug 30 17:39:16.654219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1497/3155] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:16 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 145 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:39:16.669974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:16.670613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:16.682704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:16.683197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:16.686879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:16.688429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:16.692457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:16.696244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:16.756416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:16.977610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:16.990635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c97b4311-0794-4519-8902-ace4b60b8de3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.335532 Aug 30 17:39:16.992238 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1498/3156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:16 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:17.010971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7a2b29-e2b9-4056-a5eb-f0ed44875db3", "name": "network-vif-plugged", "status": "completed", "tag": "3217ffd2-3830-4650-bd51-83a67cea3160"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:17.026355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.026911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.027342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.045995 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] Creating event network-vif-plugged:3217ffd2-3830-4650-bd51-83a67cea3160 for instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 on n-h1-852771-11 Aug 30 17:39:17.057518 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-047211cf-1f0a-4cea-b494-aa5cff4332bb req-3a7d9b1e-79ea-4052-8d94-be7d4ed6b7d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063890 Aug 30 17:39:17.058334 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1499/3157] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:17.075888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:17.076854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:17.096895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.098142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.098823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.102215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.104169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.104904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.573494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:17.587222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:17.588979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:17.591186 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f7e68fc-ae8f-45a0-9bc9-2b39556aa038 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.530929 Aug 30 17:39:17.592265 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1500/3158] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:17 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:17.599265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:17.600045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:17.608372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.609169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.609705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.610516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.611093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.612225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.871085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:17.883021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2671dfaa-accb-4329-9a5f-cb6494795dd6 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.289476 Aug 30 17:39:17.885977 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1501/3159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:17 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:17.893657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:17.894469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:17.906707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.907201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.912539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:17.913592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:17.914796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:17.915954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.163628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:18.175066 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1789ee1c-cb13-4f8f-8319-865b0c3b336c tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1323 microversion: 2.1 time: 0.287836 Aug 30 17:39:18.192388 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1502/3160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:17 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:18.198829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:18.199704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: baf9612d-72be-49d0-9768-4e9238b1bb2c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:18.207705 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/baf9612d-72be-49d0-9768-4e9238b1bb2c/action HTTP/1.1 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 14 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: {"resume": {}} Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'baf9612d-72be-49d0-9768-4e9238b1bb2c', 'body': {'resume': {}}} Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:18.227832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance baf9612d-72be-49d0-9768-4e9238b1bb2c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2db1494c-fa25-4798-a60a-8f48b79acf7e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/baf9612d-72be-49d0-9768-4e9238b1bb2c/action" status: 404 len: 111 microversion: 2.1 time: 0.035716 Aug 30 17:39:18.233305 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1503/3161] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:18 2022] POST /compute/v2.1/servers/baf9612d-72be-49d0-9768-4e9238b1bb2c/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:18.243217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:18.244728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:18.254156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.255061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.256024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.262709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.266348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.266834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.457024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:18.466386 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0cb52155-7a85-4fc6-9cde-abd0ff2293f3 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.229789 Aug 30 17:39:18.467573 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1504/3162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:18 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:18.489293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:18.490177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:18.496914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.497682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.498592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.499559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.500237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.500793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.704472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:18.724216 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48b742de-2908-4a74-8ae1-90d48b590c1f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.239476 Aug 30 17:39:18.725529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1505/3163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:18 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:39:18.741983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:18.746776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:18.758971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.760307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.761117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:18.762363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:18.763109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:18.764081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.048023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.062232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.064117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.066388 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c324ffd-1356-4cc0-8bc0-31d91744bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.339774 Aug 30 17:39:19.067450 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1506/3164] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:18 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:19.073486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:19.074026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:19.080782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.081261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.081697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.082383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.082826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.083248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.108864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'resume' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 14 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: {"resume": {}} Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'resume' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'resume': {}}} Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state active. Cannot resume while the instance is in this state. Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:19.110591 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'resume' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19ad0012-937b-4532-94c3-dada7bb22b11 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 144 microversion: 2.1 time: 0.043315 Aug 30 17:39:19.119101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1507/3165] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:19 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 144 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:39:19.125263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:19.126094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:19.135201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.136292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.136885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.137761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.138353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.138917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.320959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.332616 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c99e42d-6817-4f31-a948-2ba2c0781dca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.211341 Aug 30 17:39:19.346619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1508/3166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:19 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:19.346619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:19.346619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:19.346619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:19.349403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.350149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.350767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.351705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.352357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.352939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.549873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977cd713892540e59847f3934585e7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ad7bc471e04326a2ca6044e4a294c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.560531 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ea7ce32-5457-4817-97fe-c7086dbafb5f tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 200 len: 1519 microversion: 2.1 time: 0.225496 Aug 30 17:39:19.561474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1509/3167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:19 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:19.567867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:19.568657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:19.575834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.576540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.577182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.578030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.578633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.579210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.774942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:19.791811 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f728ce8-6a2b-4b49-81c2-edb9f0c1627e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.228865 Aug 30 17:39:19.792721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1510/3168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:19 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:19.828889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.5"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:19.832605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:19.840440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.840932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.841425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.842147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:19.842576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:19.842999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:19.906056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:39:19.906056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquired lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:39:20.573256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:39:20.873176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:39:20.873900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:39:20.874545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:39:20.875193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:39:20.875671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:39:20.886421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:20.886905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:20.887639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:20.888545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:20.889173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:20.889767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:20.915574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:39:20.922059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for user f9748b9d952140239f3d5c4463feadc0 and project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:39:20.936699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.utils [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] cores quota exceeded for a629c0d86ce04e0cb35284e044b9e72d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122124) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 17:39:20.938795 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Request method failure captured: Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 144 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDks-5UFyHtJJITHaEcLELujrP64bo99x6kdYBE6-lYZp1MBr3SfKNQ7U-gmNOXfPKZHTzrsDEnvYmebQV-uPuqfTX6Uopc6C5pgnn3zMxHw5igTXnQaxrLsvcqxVVHA8Ky_bW13zlx8mj96NSfh4E9u53aktoC3ojEkwfdl6Bloc5mc Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a629c0d86ce04e0cb35284e044b9e72d"}]}] Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f9748b9d952140239f3d5c4463feadc0 Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-108915597", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-108915597', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452'}}} Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:39:20.981327 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39f14c38-6dca-461e-981f-98b8a83f23fb tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 4.849147 Aug 30 17:39:20.988755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1659/3169] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:39:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 4851 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:20.995961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af3cef08-0fca-4f19-a2c1-c449144dae4e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af3cef08-0fca-4f19-a2c1-c449144dae4e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 160 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "b04f80f1-00e2-4aae-9f21-9d1a2fe06163"}]}} Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': '', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'networks': [{'uuid': 'b04f80f1-00e2-4aae-9f21-9d1a2fe06163'}]}}} Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi '' Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:39:21.006704 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af3cef08-0fca-4f19-a2c1-c449144dae4e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af3cef08-0fca-4f19-a2c1-c449144dae4e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.025084 Aug 30 17:39:21.015230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1660/3170] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:39:20 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:39:21.032791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:21.036146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:21.067919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:21.070309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:21.075891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:21.077506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:21.078423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:21.079069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:21.619840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:21.640666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:21.655541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:21.658653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e61f187-4271-468e-bb12-28284c367bbc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.642872 Aug 30 17:39:21.658653 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1661/3171] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:21 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:21.673687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9397e9d0>, body: {"quota_set": {"cores": 20}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:22.197579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Building network info cache for instance {{(pid=122123) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:22.335253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:22.336426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:22.337379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:22.339398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:22.340374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:22.342287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:22.496954 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12bca123-171b-4c63-b759-1ce999f3feb5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 329 microversion: 2.1 time: 0.837885 Aug 30 17:39:22.498710 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1662/3172] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:21 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 329 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:22.511974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:22.516142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:22.532181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:22.533674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:22.541712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:22.543765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:22.544467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:22.546227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.105259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:23.118215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37efee81-01d1-40c1-8e4c-1e8a3f4c5d16 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.615115 Aug 30 17:39:23.118835 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1663/3173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:22 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:23.130491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:23.160830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.161334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.161856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.192034 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] Creating event network-changed:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:39:23.206266 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d8abb299-4af7-4c96-ac9f-4ae7125bdb66 req-b5b7a605-953e-4b3e-a795-bc3c67e89587 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086182 Aug 30 17:39:23.208858 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1664/3174] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:23.228930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a9cc7cf-0292-47af-b39f-4c4cd0e673b3 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Calling method '.version_select at 0x7f2d9397e160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:23.268322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Updating instance_info_cache with network_info: [{"id": "93893f71-fe27-482c-a47c-32715890f79d", "address": "fa:16:3e:cd:5b:11", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93893f71-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:23.299578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Releasing lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:39:23.300603 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fda22b0-29e2-475f-a14a-b86158a68eca tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action" status: 202 len: 0 microversion: 2.1 time: 3.496346 Aug 30 17:39:23.301779 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1511/3175] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:19 2022] POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action => generated 0 bytes in 3508 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:39:23.307235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:23.307968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:23.324094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.326680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.336769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.337970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.338696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.341797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.573276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a9cc7cf-0292-47af-b39f-4c4cd0e673b3 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 371 microversion: 2.1 time: 0.362391 Aug 30 17:39:23.575375 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1665/3176] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:39:23 2022] GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:23.581718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:23.582617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:23.590172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.591012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.591786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.592715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.593475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.594118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.817358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:23.830962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7cc4941-4e0b-4482-9ce7-4bc88d2ff83d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.254253 Aug 30 17:39:23.831829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1666/3177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:23 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:23.843908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.5"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:23.854043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:23.884114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.887395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.889851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:23.891227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:23.898095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:23.898957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:24.028426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:39:24.033015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquired lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:39:24.382748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:24.392577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:24.405675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:24.407546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c729f40d-89a7-4ec6-9507-8c5245d1f585 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 1.104263 Aug 30 17:39:24.409154 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1512/3178] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:23 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:24.416602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d98db4160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:24.490450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:25.164399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.164888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.165329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:25.166057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.166510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.166940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:25.353110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5cdcdf20-e9f2-4972-9438-1d9f761da9a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 328 microversion: 2.1 time: 0.942701 Aug 30 17:39:25.354329 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1513/3179] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:24 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 328 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:25.381010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:25.382242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 8d508b8c-6307-40d5-a0af-46e016efd536] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:25.398913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/8d508b8c-6307-40d5-a0af-46e016efd536/action HTTP/1.1 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 14 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: {"shelve": {}} Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8d508b8c-6307-40d5-a0af-46e016efd536', 'body': {'shelve': {}}} Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:25.409733 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:25.413971 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:25.413971 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:25.413971 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. Aug 30 17:39:25.413971 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:25.417162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 8d508b8c-6307-40d5-a0af-46e016efd536 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:25.418895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1eb61748-27df-4927-ac75-b01c651e815b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/8d508b8c-6307-40d5-a0af-46e016efd536/action" status: 404 len: 111 microversion: 2.1 time: 0.063077 Aug 30 17:39:25.420225 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1514/3180] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:25 2022] POST /compute/v2.1/servers/8d508b8c-6307-40d5-a0af-46e016efd536/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:25.429113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:25.432233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:25.450654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.452147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.455895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:25.458990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.459787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.461671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:25.737776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:25.752915 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d45fdd58-25d5-45e2-b281-888903128524 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.328140 Aug 30 17:39:25.753691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1515/3181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:25 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:25.785743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:25.786362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:25.806638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.807127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.807597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:25.808311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:25.808817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:25.809251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:26.309534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:26.324344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:26.326295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:26.327749 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-265c56e4-7179-426c-90a7-972702900399 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.546124 Aug 30 17:39:26.339607 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1516/3182] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:25 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:26.339607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2061068877", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:26.479101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:39:26.921418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:39:26.921775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:39:26.922730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:39:26.923305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:39:26.923788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:39:26.960012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:26.962709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:26.963398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:26.975035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:26.975899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:26.976867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:27.024569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:39:27.039700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for user f9748b9d952140239f3d5c4463feadc0 and project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:39:27.075281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.utils [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] instances quota exceeded for a629c0d86ce04e0cb35284e044b9e72d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122123) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 17:39:27.077332 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Request method failure captured: Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 145 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDks-5UFyHtJJITHaEcLELujrP64bo99x6kdYBE6-lYZp1MBr3SfKNQ7U-gmNOXfPKZHTzrsDEnvYmebQV-uPuqfTX6Uopc6C5pgnn3zMxHw5igTXnQaxrLsvcqxVVHA8Ky_bW13zlx8mj96NSfh4E9u53aktoC3ojEkwfdl6Bloc5mc Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a629c0d86ce04e0cb35284e044b9e72d"}]}] Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f9748b9d952140239f3d5c4463feadc0 Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2061068877", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2061068877', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452'}}} Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:39:27.085973 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 17:39:27.090474 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:27.099699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:27.103984 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac394d13-c11b-4a64-b2cd-70306f60b124 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.772981 Aug 30 17:39:27.106750 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1517/3183] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:39:26 2022] POST /compute/v2.1/servers => generated 119 bytes in 777 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:27.112993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:27.120110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:27.139512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:27.140840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:27.141988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:27.144219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:27.146444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:27.147227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:27.218293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:27.486941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:27.505655 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7255a5b-426a-4d6e-9889-03b07a3ae064 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.396942 Aug 30 17:39:27.507336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1518/3184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:27 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:27.531864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d93b2f9d0>, body: {"quota_set": {"instances": 10}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:27.986011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:27.987101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:27.988734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:27.990286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:28.013609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:28.020006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:28.195870 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee9b5163-e8fe-4ee0-bf19-e799bb5d7c7b tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 329 microversion: 2.1 time: 0.683151 Aug 30 17:39:28.196791 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1519/3185] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:27 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 329 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:28.201966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:28.202604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:28.212695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:28.213183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:28.213825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:28.214630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:28.216839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:28.217303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:28.477779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.neutron [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] re-assign floating IP 172.25.4.5 from instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 Aug 30 17:39:28.644409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Building network info cache for instance {{(pid=122124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:28.665677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:28.696836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:28.700383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:28.702604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-423d1b76-279e-402b-b560-73252ac2d168 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.504531 Aug 30 17:39:28.704100 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1520/3186] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:28 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:28.746738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:28.747340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:28.772656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:28.773168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:28.773616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:28.774341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:28.774797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:28.775226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:28.841469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lazy-loading 'flavor' on Instance uuid 24856869-997c-4b8d-9194-7592e05f8256 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:39:29.761707 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-936e07e5-a076-4787-9127-085a2d1df84d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 1.042129 Aug 30 17:39:29.766972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1521/3187] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:28 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:39:29.785736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70f0cd12-8a3e-4aba-9cc7-359d472d6ff5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Calling method '.version_select at 0x7f2d9cb6f280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:30.064786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Updating instance_info_cache with network_info: [{"id": "93893f71-fe27-482c-a47c-32715890f79d", "address": "fa:16:3e:cd:5b:11", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93893f71-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:30.085050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Building network info cache for instance {{(pid=122124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:30.261428 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70f0cd12-8a3e-4aba-9cc7-359d472d6ff5 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 371 microversion: 2.1 time: 0.490583 Aug 30 17:39:30.264386 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1522/3188] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:39:29 2022] GET /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 371 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:30.276574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:30.303598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:30.304131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:30.304523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:30.335810 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] Creating event network-changed:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:39:30.354598 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-df41013c-523e-40e8-908b-2bb52eb3da24 req-429dcea1-b250-4c63-9453-0aeac1d67e59 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088473 Aug 30 17:39:30.355212 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1523/3189] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:30.369047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:30.374802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:30.414178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:30.414925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:30.416999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:30.425326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:30.426471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:30.428066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:31.632624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Updating instance_info_cache with network_info: [{"id": "3217ffd2-3830-4650-bd51-83a67cea3160", "address": "fa:16:3e:f2:f7:53", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3217ffd2-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:31.661436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Releasing lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:39:31.662810 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f258475-8317-4eb2-bfc8-161df7f34503 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3/action" status: 202 len: 0 microversion: 2.1 time: 7.829464 Aug 30 17:39:31.663781 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1667/3190] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:23 2022] POST /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3/action => generated 0 bytes in 7831 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:39:31.674676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:31.675521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:31.699372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:31.712133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:31.713096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:31.714501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:31.716103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:31.716954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:31.998378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:32.001315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:32.017926 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2eb46c42-0661-460c-9e26-797943d576b4 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.348135 Aug 30 17:39:32.018676 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1668/3191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:31 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:32.026489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d9cda88b0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:32.080714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:32.101655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:32.115066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:32.116913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a8b82b7-ca11-44dd-9866-3d3bff261bfe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 1.758467 Aug 30 17:39:32.124982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1524/3192] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:30 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:32.140153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.5"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:32.360223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:32.485020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:32.493937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:32.495313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:32.496042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:32.498052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:32.501272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:32.502696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:32.561719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:32.563373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:32.563858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:32.568142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:32.569663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:32.570276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:32.682550 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-832a27e0-e24a-4ebe-a589-781f333a4ffb tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 325 microversion: 2.1 time: 0.662159 Aug 30 17:39:32.694563 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1669/3193] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:32 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 325 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:32.694563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7a2b29-e2b9-4056-a5eb-f0ed44875db3", "tag": "3217ffd2-3830-4650-bd51-83a67cea3160"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:32.731367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:32.731874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:32.732304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:32.775058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] Creating event network-changed:3217ffd2-3830-4650-bd51-83a67cea3160 for instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 on n-h1-852771-11 Aug 30 17:39:32.796704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a0ee2ab6-7831-46c3-8f5b-0e40e479248f req-82ac2ed9-3152-45b9-b500-92d6a665c67a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108882 Aug 30 17:39:32.800371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1670/3194] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:32.948835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1688712084", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:33.373923 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] HTTP exception thrown: Floating IP 172.25.4.5 is not associated with instance 4738b013-7cc8-41bc-8288-4838cfffb9c0. Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Request method failure captured: Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action HTTP/1.1 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 47 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDksD6EsvkbYSwfantTmR00K8NyLzI-5DAFWSI9ymQgsgrJ8w0XXpMUWIPTpv4dxha8mHhzhdp73HQpJM_CZ2C95cSjuikq_5HvW7T-QDHfQ-MLsy5-yqK6LysPIvVJ2A9ywRNpeelyebnulmsq7vGHOlRJ77sH6ICNPvMqSul9LFUxA Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6ad7bc471e04326a2ca6044e4a294c7"}]}] Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 977cd713892540e59847f3934585e7dc Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: {"removeFloatingIp": {"address": "172.25.4.5"}} Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: exception: Floating IP 172.25.4.5 is not associated with instance 4738b013-7cc8-41bc-8288-4838cfffb9c0. Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4738b013-7cc8-41bc-8288-4838cfffb9c0', 'body': {'removeFloatingIp': {'address': '172.25.4.5'}}} Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.5 is not associated with instance 4738b013-7cc8-41bc-8288-4838cfffb9c0. Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.5 is not associated with instance 4738b013-7cc8-41bc-8288-4838cfffb9c0. Aug 30 17:39:33.376654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.382498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Returning 409 to user: Floating IP 172.25.4.5 is not associated with instance 4738b013-7cc8-41bc-8288-4838cfffb9c0. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:33.384572 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4941beee-b1e4-4ad0-b0e8-cf2e537a0084 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action" status: 409 len: 144 microversion: 2.1 time: 1.251557 Aug 30 17:39:33.385472 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1525/3195] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:32 2022] POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action => generated 144 bytes in 1260 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:39:33.390646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:33.399762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:33.406615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:33.409949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:33.412725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:33.413709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:33.416030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:33.416671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:33.502078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:39:33.872323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:39:33.874026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:39:33.875914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:39:33.876450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:39:33.877931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:39:33.889918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:33.890707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:33.891332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:33.892429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:33.893126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:33.893955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:33.917392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:39:33.926743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Getting quotas for user f9748b9d952140239f3d5c4463feadc0 and project a629c0d86ce04e0cb35284e044b9e72d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:39:33.934464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:33.943177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcd4fac1-d863-429a-b8c0-9da7782cbfb0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.556267 Aug 30 17:39:33.943810 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1526/3196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:33 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:33.948085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.utils [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] ram quota exceeded for a629c0d86ce04e0cb35284e044b9e72d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122124) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 17:39:33.949775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Request method failure captured: Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 145 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDks-5UFyHtJJITHaEcLELujrP64bo99x6kdYBE6-lYZp1MBr3SfKNQ7U-gmNOXfPKZHTzrsDEnvYmebQV-uPuqfTX6Uopc6C5pgnn3zMxHw5igTXnQaxrLsvcqxVVHA8Ky_bW13zlx8mj96NSfh4E9u53aktoC3ojEkwfdl6Bloc5mc Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a629c0d86ce04e0cb35284e044b9e72d"}]}] Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f9748b9d952140239f3d5c4463feadc0 Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1688712084", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1688712084', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452'}}} Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:39:33.952348 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 17:39:33.958812 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:39:33.967178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:33.969551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0fcd80c3-9613-4cc1-b614-d064efb89359 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.026494 Aug 30 17:39:33.970952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1671/3197] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:39:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 1030 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:33.981154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:33.981767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:33.982361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.5"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:33.997494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.000257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.000918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.002103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.008736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.009505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.224546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:34.234217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.237541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.238475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.244318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.245085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.245815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.330303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:34.347431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:34.348895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:34.350093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-441dab20-2499-46d6-8769-b3b4e7f1bac0 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.385031 Aug 30 17:39:34.350661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1527/3198] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:33 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:34.368516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Action: 'update', calling method: .version_select at 0x7f2d987b5700>, body: {"quota_set": {"ram": 51200}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:34.527329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.528552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.529169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.530082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:34.530697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:34.531281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:34.694136 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-524f7272-0543-4e3b-9ef2-efa81ab1a2a6 tempest-QuotasAdminNegativeTest-196135461 tempest-QuotasAdminNegativeTest-196135461-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 200 len: 329 microversion: 2.1 time: 0.339097 Aug 30 17:39:34.696623 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1528/3199] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:34 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 329 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:34.711590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff05fa92-8d43-4885-a17e-298c46fdaa12 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Action: 'update', calling method: .version_select at 0x7f2d9cc38160>, body: {"quota_set": {"ram": 0}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:34.722255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff05fa92-8d43-4885-a17e-298c46fdaa12 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f9748b9d952140239f3d5c4463feadc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a629c0d86ce04e0cb35284e044b9e72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:34.730206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:39:34.730602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquired lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff05fa92-8d43-4885-a17e-298c46fdaa12 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Request method failure captured: Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d HTTP/1.1 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 25 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDks-5UFyHtJJITHaEcLELujrP64bo99x6kdYBE6-lYZp1MBr3SfKNQ7U-gmNOXfPKZHTzrsDEnvYmebQV-uPuqfTX6Uopc6C5pgnn3zMxHw5igTXnQaxrLsvcqxVVHA8Ky_bW13zlx8mj96NSfh4E9u53aktoC3ojEkwfdl6Bloc5mc Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a629c0d86ce04e0cb35284e044b9e72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a629c0d86ce04e0cb35284e044b9e72d"}]}] Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a629c0d86ce04e0cb35284e044b9e72d Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1937777963 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f9748b9d952140239f3d5c4463feadc0 Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-QuotasAdminNegativeTest-1937777963-project Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: {"quota_set": {"ram": 0}} Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a629c0d86ce04e0cb35284e044b9e72d', 'body': {'quota_set': {'ram': 0}}} Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 17:39:34.734434 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 17:39:34.740010 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:34.744560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff05fa92-8d43-4885-a17e-298c46fdaa12 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:34.745938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff05fa92-8d43-4885-a17e-298c46fdaa12 tempest-QuotasAdminNegativeTest-1937777963 tempest-QuotasAdminNegativeTest-1937777963-project] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d" status: 403 len: 116 microversion: 2.1 time: 0.039764 Aug 30 17:39:34.746723 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1529/3200] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:39:34 2022] PUT /compute/v2.1/os-quota-sets/a629c0d86ce04e0cb35284e044b9e72d => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:39:34.979164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:34.985532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:35.009916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:35.011757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:35.012454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:35.016172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:35.018836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:35.020504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:35.333756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:35.347051 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f8371f0-2ff7-4ae1-847e-654c2ee82a40 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.383393 Aug 30 17:39:35.370543 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1530/3201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:34 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:35.388271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:35.389596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:35.419646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:35.420309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:35.420764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:35.421512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:35.421967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:35.422394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:36.272802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:36.298303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:36.304781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:36.306080 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76426f82-a4dc-4be8-bbd4-c8cb35c99809 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.922466 Aug 30 17:39:36.306664 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1531/3202] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:35 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:36.389837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:36.390511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:36.404962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:36.405462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:36.411464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:36.414484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:36.415997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:36.419248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:36.749529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Building network info cache for instance {{(pid=122124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:36.926947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:36.936992 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-395f020a-4b8f-4fe6-a5b8-94c2e820e93c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.551583 Aug 30 17:39:36.954358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1532/3203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:36 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:36.977977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7a2b29-e2b9-4056-a5eb-f0ed44875db3", "tag": "3217ffd2-3830-4650-bd51-83a67cea3160"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:37.015861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:37.019408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:37.020126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:37.057188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] Creating event network-changed:3217ffd2-3830-4650-bd51-83a67cea3160 for instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 on n-h1-852771-11 Aug 30 17:39:37.082922 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-02fd7623-0720-4807-9cbb-8e77ec3f1ec9 req-df9622a9-d68d-44df-8c66-53317bc5d6a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119791 Aug 30 17:39:37.083642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1533/3204] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:37.342449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:37.344183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:37.348494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:37.356013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:37.357151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:37.357799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:37.358710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:37.359369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:37.360373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.072738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Updating instance_info_cache with network_info: [{"id": "3217ffd2-3830-4650-bd51-83a67cea3160", "address": "fa:16:3e:f2:f7:53", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3217ffd2-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:38.109798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Releasing lock "refresh_cache-2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" {{(pid=122124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:39:38.112155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd19b684-a387-44bb-917a-f918ddf53780 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3/action" status: 202 len: 0 microversion: 2.1 time: 4.138922 Aug 30 17:39:38.116172 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1672/3205] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:33 2022] POST /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3/action => generated 0 bytes in 4144 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:39:38.130288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:38.134114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:38.150965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.151668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.153004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.155070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.159324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.160759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.258011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:38.281232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:38.290187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:38.295406 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-927ebac9-c80e-498b-ad68-359afc4c2c17 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.961355 Aug 30 17:39:38.319396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1534/3206] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:37 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:39:38.331426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:38.332834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:38.353441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.355682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.357318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.358243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.360126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.360832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.417832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:38.426593 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08be14de-6ffd-40c9-a36c-d468043b1e52 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.308365 Aug 30 17:39:38.441613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1673/3207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:38 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:38.449973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:38.450725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:38.472504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.473873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.475158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.476331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.477096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.477696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.513496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:39:38.653135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f66ba381-3cf4-4939-b5fb-19863883b3e2 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 204 len: 0 microversion: 2.1 time: 0.208003 Aug 30 17:39:38.653916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1674/3208] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:39:38 2022] DELETE /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:39:38.665054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1905254753"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:38.668239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:38.677947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.678984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.679855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.681198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.681903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.682481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.894047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:38.918391 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcbc11e2-e2a4-472e-8ec4-42bcdcb37dcc tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.595737 Aug 30 17:39:38.919033 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1535/3209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:38 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:38.931084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.5"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:38.943787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:38.974134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.976056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.977665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.980874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.981734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.984636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:39.066160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d6ad2fd5-1f3d-45e2-a7ea-fb2da0f8b7eb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.408439 Aug 30 17:39:39.070377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1675/3210] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:38 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 17:39:39.076308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:39:39.076925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquired lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:39:39.093641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:39.094934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:39.105923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:39.107188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:39.107858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:39.108756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:39.109577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:39.110186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:39.473448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:39.484596 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd71fde7-8e91-4f73-9f8e-0f9083e93cc6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.412570 Aug 30 17:39:39.485413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1676/3211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:39 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:39.504953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:39.505945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:39.522966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:39.523472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:39.523897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:39.524632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:39.532365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:39.534823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:39.926205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:39.943578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:39.945043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:39.946243 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11d397c0-6646-4faa-9c4f-69e06406afeb tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.454114 Aug 30 17:39:39.970978 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1677/3212] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:39 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:39.984062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:39.984983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:39.999200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:39.999727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:40.000201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:40.000933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:40.001966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:40.002395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:40.574163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:40.593949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6b8866f-ab48-41cb-a02e-956d6ee12d02 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.614061 Aug 30 17:39:40.594866 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1678/3213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:39 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:40.606878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:40.607934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:40.627281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:40.628295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:40.629261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:40.630224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:40.630894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:40.631556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:41.395266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:41.408563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc88a237-e550-443d-947d-1fd1dd170bf7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1686 microversion: 2.1 time: 0.811601 Aug 30 17:39:41.409942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1679/3214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:40 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1686 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:41.416323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:41.418049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:41.450790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:41.451189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:41.457587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:41.458349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:41.464556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:41.465040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:41.897260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:41.911014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:41.915593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:41.918906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c21a8693-f89b-4cee-9654-2dd9bba0b6d5 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.506609 Aug 30 17:39:41.921398 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1680/3215] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:41 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:41.930172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:41.931091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:41.945386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:41.945884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:41.952471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:41.953293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:41.953711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:41.954173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.192574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:43.208045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b654935-5ad2-420d-8a96-df9b743c41b5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 1.285279 Aug 30 17:39:43.209313 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1681/3216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:41 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:43.215948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7a2b29-e2b9-4056-a5eb-f0ed44875db3", "name": "network-vif-deleted", "tag": "3217ffd2-3830-4650-bd51-83a67cea3160"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:43.229601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:43.230587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:43.231653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.247223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] Creating event network-vif-deleted:3217ffd2-3830-4650-bd51-83a67cea3160 for instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 on n-h1-852771-11 Aug 30 17:39:43.253805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-059470e2-07ec-48a8-938e-9c7598e17648 req-02bd9dd9-f99d-4d50-a500-7b32a034075a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041833 Aug 30 17:39:43.255848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1682/3217] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:43.284097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:43.285278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:43.306024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:43.308465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:43.309509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:43.310448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.311472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:43.312244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:43.314652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.603224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:43.613129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ed0503d-a19c-43b2-a415-15ffad0ead57 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.353683 Aug 30 17:39:43.615737 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1683/3218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:43 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:43.620752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:43.623124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:43.638580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:43.639090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:43.639608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.640262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:43.640715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:43.641147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:43.646600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:43.902930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:43.939551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=38 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:44.160745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:44.172856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:44.176467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:44.179537 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-96ceb415-0a1e-4d44-9942-be389bc7ddb6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.562605 Aug 30 17:39:44.201233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1684/3219] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:43 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:44.221661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Building network info cache for instance {{(pid=122123) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:44.236023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:44.237790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:44.255726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:44.260642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:44.262849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:44.271213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:44.272103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:44.272950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:44.542473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:44.679598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=32 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:44.751215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:44.763864 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23342c98-cf3a-4c7a-b5f2-78da2da13495 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.533314 Aug 30 17:39:44.778974 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1685/3220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:44 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:39:44.785085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:44.787470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:44.800876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:44.803263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:44.804838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:44.806755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:44.808876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:44.809767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:45.613968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:45.624441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-761f19b3-b4be-49f8-92ce-b17c1d3c13f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.855791 Aug 30 17:39:45.637818 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1686/3221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:44 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:45.648494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "1efd1cbc-14b8-4af8-af6a-74336c6365e6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:45.661337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:45.662087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:45.662592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:45.676654 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] Creating event network-vif-plugged:1efd1cbc-14b8-4af8-af6a-74336c6365e6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:45.683141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-efd84f9b-a607-4344-be35-87ed91a81f31 req-fe9b13a4-8ed1-456e-9c5b-7200b7986cc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Aug 30 17:39:45.687323 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1687/3222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:45.694948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:45.696065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:45.705633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:45.706475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:45.707307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:45.708342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:45.709093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:45.709730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.303364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:46.326422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:46.332109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:46.337715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e384051b-29e8-4b59-9744-c55aa7223a11 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.646618 Aug 30 17:39:46.339420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1688/3223] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:45 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:46.351067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:46.354762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:46.370911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:46.371824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.372491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.374265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:46.380400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.381228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.809898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:46.840035 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f5379e2-b097-45b0-8c87-6f89195ad3d2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1533 microversion: 2.1 time: 0.498982 Aug 30 17:39:46.863886 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1689/3224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:46 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1533 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:46.870870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:46.895278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:46.896074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.897378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.916724 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] Creating event network-changed:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:39:46.922449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5449e16d-36e7-4803-a533-39cd0c395b91 req-425c18ee-35dc-4186-a2cc-c8c307f9b296 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056895 Aug 30 17:39:46.924294 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1690/3225] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:46.929988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:46.930908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:46.939546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:46.940321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.941054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.941953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:46.942728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.943315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:47.394673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:47.403910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Updating instance_info_cache with network_info: [{"id": "93893f71-fe27-482c-a47c-32715890f79d", "address": "fa:16:3e:cd:5b:11", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93893f71-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:47.411081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1ed0ffd-da20-4f90-bae9-f4c54e059fc5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.485318 Aug 30 17:39:47.416131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1691/3226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:46 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:47.437772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Releasing lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:39:47.439778 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49d92ac2-ff75-428f-ab65-5a87b494bec7 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action" status: 202 len: 0 microversion: 2.1 time: 8.518281 Aug 30 17:39:47.440799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:47.444248 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1536/3227] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:38 2022] POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action => generated 0 bytes in 8524 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:39:47.445211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:47.477753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29d2fb27-360a-412e-bd33-08fcb0de3aa8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '.version_select at 0x7f2d93a6f430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:47.479828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:47.487309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:47.487807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:47.488788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:47.489260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:47.489685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.633622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29d2fb27-360a-412e-bd33-08fcb0de3aa8 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/061d3208-8a5c-4375-bcd7-6e5d1d8621b1" status: 200 len: 182 microversion: 2.1 time: 1.181406 Aug 30 17:39:48.635526 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1537/3228] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:39:47 2022] GET /compute/v2.1/os-floating-ips/061d3208-8a5c-4375-bcd7-6e5d1d8621b1 => generated 182 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:48.642708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:48.643580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:48.653634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:48.679945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.680977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:48.682947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.687201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.688311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:48.690307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.692240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.692881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.697511 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4918bf46-c04b-40bd-88cd-843581ffbc5a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 1.275859 Aug 30 17:39:48.720571 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1692/3229] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:47 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:48.729420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:48.742079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:48.744641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:48.771314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.774235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.776652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.779127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.781095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.785466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:49.913316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:49.931755 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f93ca2e9-e07f-4d8f-8e0a-80d89ee7b64a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 1.292299 Aug 30 17:39:49.935840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1538/3230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:48 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:49.944081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.5"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:50.320746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:50.327356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.328248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.328797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.330191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.339634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.341747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.388971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:50.404748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-26b3e669-6542-46f8-a599-bb2d71287713 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 1.680741 Aug 30 17:39:50.406703 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1693/3231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:48 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:50.413396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "e09b0ace-5e6d-4599-8184-2fba845cccf9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:50.427582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.428593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.429262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.467854 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] Creating event network-vif-plugged:e09b0ace-5e6d-4599-8184-2fba845cccf9 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:50.482977 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8b9c4cba-3f2d-4db4-ba32-a6b331a9a67d req-35ee3a9d-779d-4ac2-9d7e-5ed03a9a02db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072913 Aug 30 17:39:50.485410 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1694/3232] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:50.504474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:50.507036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:50.524638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.525673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.529589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.532739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.535450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.536485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.978825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 17:39:50.979300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquired lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 17:39:51.464075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:51.474723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:51.503044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:51.504629 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-474a50de-20dd-4545-b730-ae1b461de35d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 1.014061 Aug 30 17:39:51.540070 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1695/3233] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:50 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:51.549536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:51.572510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:51.585819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:51.586674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:51.587363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:51.603668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:51.608150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:51.609435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:52.905556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:52.916462 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e121ac6b-79f5-43b3-be37-201838a13fba tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 1.374954 Aug 30 17:39:52.933578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1696/3234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:51 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:52.961146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:52.968120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:52.993039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:52.993919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:52.994648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:52.995604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:53.001659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:53.002664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:53.175755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Building network info cache for instance {{(pid=122123) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 17:39:53.725174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:53.741093 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0d948ed-153a-44cc-8693-dbd933b59f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.802481 Aug 30 17:39:53.743448 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1697/3235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:52 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:53.755426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:53.760648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:53.771608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:53.774157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:53.779375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:53.780762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:53.781516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:53.782981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:54.319593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:54.335395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:54.350612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:54.352009 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9972738b-06ad-4370-bf77-f22d9dc4473b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.607254 Aug 30 17:39:54.353240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1698/3236] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:53 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:54.358728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "cea117f2-8389-4c69-b47b-df839fe977be"}, {"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "8cfef511-9507-4a90-acfe-8095b6186336"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:54.411332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:54.415230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:54.428403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:54.464394 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Creating event network-vif-plugged:cea117f2-8389-4c69-b47b-df839fe977be for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:54.465538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] Creating event network-vif-plugged:8cfef511-9507-4a90-acfe-8095b6186336 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:54.474662 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-93ccbd43-f115-4bf5-9897-9916cc26d36b req-1c5fb5bd-1586-4789-886c-ecdfedfa7ebb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119210 Aug 30 17:39:54.479101 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1699/3237] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:54.493838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:54.525778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:54.526357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:54.527290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:54.544939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] Creating event network-changed:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:39:54.553979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3c00f410-84b1-4ff0-a0a6-92690b9dc558 req-67043ed0-3031-4060-bbdd-4818c65a5b1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070167 Aug 30 17:39:54.555075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1700/3238] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:54.564118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Action: 'create', calling method: .version_select at 0x7f2d93e71b80>, body: {"keypair": {"name": "tempest-keypair-1343930443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFv9B4e+qqcd2zyjuMJwVisW1caHTbZw3POMbYyFvccIuKS1Wg5NRrFCPxKagEmGRJpOV0/votyKGsUjYg2bYYBJO/iJE6BY7vq+stndeQlLGoauPq/AH6WjjPxpBpsQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:54.590334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Getting quotas for project dc892859f18341db86c3a9e931d683a8. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:39:54.597003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Getting quotas for user 59f53cefb4b9447aa5665fc9b9ef5e1a and project dc892859f18341db86c3a9e931d683a8. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:39:54.618079 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:39:55.634438 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46544. Aug 30 17:39:55.686314 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b591c03d-6468-4b54-970b-96d7e101b4c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 1.128749 Aug 30 17:39:55.696470 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1701/3239] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:39:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:39:55.714488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:55.718076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:55.776010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:55.778463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:55.778933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:55.785306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:55.790902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:55.791521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.168986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Updating instance_info_cache with network_info: [{"id": "93893f71-fe27-482c-a47c-32715890f79d", "address": "fa:16:3e:cd:5b:11", "network": {"id": "410e9fc4-5dde-4843-b748-ff4d5066e9b2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-310054020-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6ad7bc471e04326a2ca6044e4a294c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93893f71-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:39:56.191763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Releasing lock "refresh_cache-4738b013-7cc8-41bc-8288-4838cfffb9c0" {{(pid=122123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 17:39:56.192763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61487750-b4b5-4849-bcdc-30ab8996d494 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action" status: 202 len: 0 microversion: 2.1 time: 6.255535 Aug 30 17:39:56.193757 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1539/3240] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:49 2022] POST /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0/action => generated 0 bytes in 6257 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 17:39:56.203859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:56.205699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:56.218407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.229947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.231310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.232290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.233632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.234260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.810873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:56.834835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:56.838131 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a38dbb0b-8ad0-47c0-a9a3-d0b6643ed55e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 1.139769 Aug 30 17:39:56.842984 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c3292c0-ee7f-4708-92c2-23980e1a0cef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.647972 Aug 30 17:39:56.846986 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1540/3241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:56 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:56.855990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:56.856357 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1702/3242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:55 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:56.875508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:56.892963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.893449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.893879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.894583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.895027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.895440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.580205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-779759507", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:57.623104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:57.634453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:57.637406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:57.638895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e356994-1f6b-4c6c-9384-46364682d3ff tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.790912 Aug 30 17:39:57.640168 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1541/3243] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:39:56 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:39:57.646548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:57.647378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:57.654178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.655451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.656160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.657607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.660115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.660824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.709055 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] HTTP exception thrown: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Request method failure captured: Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 HTTP/1.1 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDksD6EsvkbYSwfantTmR00K8NyLzI-5DAFWSI9ymQgsgrJ8w0XXpMUWIPTpv4dxha8mHhzhdp73HQpJM_CZ2C95cSjuikq_5HvW7T-QDHfQ-MLsy5-yqK6LysPIvVJ2A9ywRNpeelyebnulmsq7vGHOlRJ77sH6ICNPvMqSul9LFUxA Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6ad7bc471e04326a2ca6044e4a294c7"}]}] Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 977cd713892540e59847f3934585e7dc Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2b7a2b29-e2b9-4056-a5eb-f0ed44875db3'} Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:57.714816 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.719088 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.724740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Returning 404 to user: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:57.727702 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-abf1da06-30e9-476f-b7cf-f1c32f95a345 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 404 len: 111 microversion: 2.1 time: 0.086227 Aug 30 17:39:57.733579 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1542/3244] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:39:57 2022] DELETE /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:57.752348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "9e866e5a-f52d-4312-8c67-fb8506e0b7a6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:57.809009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.818590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.819807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.868054 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] Creating event network-vif-plugged:9e866e5a-f52d-4312-8c67-fb8506e0b7a6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:39:57.889592 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b5bb4855-188f-4012-a9c7-d2c6f21916cf req-61aa7d1c-b5df-4aa5-a5d1-7bcaf0eacef4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154217 Aug 30 17:39:57.893334 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1543/3245] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:57.904863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:57.916574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:57.935018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.936013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.940024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.941153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.943456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.944868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.991120 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] HTTP exception thrown: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Request method failure captured: Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 HTTP/1.1 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDksD6EsvkbYSwfantTmR00K8NyLzI-5DAFWSI9ymQgsgrJ8w0XXpMUWIPTpv4dxha8mHhzhdp73HQpJM_CZ2C95cSjuikq_5HvW7T-QDHfQ-MLsy5-yqK6LysPIvVJ2A9ywRNpeelyebnulmsq7vGHOlRJ77sH6ICNPvMqSul9LFUxA Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6ad7bc471e04326a2ca6044e4a294c7"}]}] Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 977cd713892540e59847f3934585e7dc Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2b7a2b29-e2b9-4056-a5eb-f0ed44875db3'} Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:57.997413 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. Aug 30 17:39:58.002764 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:39:58.008440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Returning 404 to user: Instance 2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:39:58.015417 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9f08e75e-4802-4920-8233-72b9aa489dc0 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3" status: 404 len: 111 microversion: 2.1 time: 0.117051 Aug 30 17:39:58.020254 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1544/3246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:57 2022] GET /compute/v2.1/servers/2b7a2b29-e2b9-4056-a5eb-f0ed44875db3 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:39:58.036701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:58.038114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:58.059200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.070524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.071089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.072029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.073869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.074388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.547063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:58.562393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab81756b-1379-4bd9-a5ed-93ccc23bdde9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 0.535463 Aug 30 17:39:58.564635 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1545/3247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:58 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:58.582241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:58.585621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:58.605323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.609259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.611533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.612571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.618985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.619458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:59.499349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:59.508966 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12ac8744-bd57-43ba-b260-bc9e3d7fe604 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.942981 Aug 30 17:39:59.513346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1546/3248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:58 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:59.528109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b896739-6d65-40e2-b1bf-46013bb40fdf tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '.version_select at 0x7f2d93a00c10>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:01.939295 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b896739-6d65-40e2-b1bf-46013bb40fdf tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/061d3208-8a5c-4375-bcd7-6e5d1d8621b1" status: 202 len: 0 microversion: 2.1 time: 2.423935 Aug 30 17:40:01.940361 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1547/3249] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:39:59 2022] DELETE /compute/v2.1/os-floating-ips/061d3208-8a5c-4375-bcd7-6e5d1d8621b1 => generated 0 bytes in 2426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:01.945137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:01.948766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:01.989945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:01.990552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:01.991009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:01.992816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:01.993458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:01.994155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.490507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:02.501840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:02.503370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:02.504785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b89e3c8-d89a-44ac-a017-a9f847c1a591 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1875 microversion: 2.32 time: 0.563489 Aug 30 17:40:02.515915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1548/3250] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:01 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1875 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:02.773997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Calling method '.version_select at 0x7f2d93a75160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:02.776085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.776727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.777355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.813885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.814803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.819112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.844206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.844863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.845540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.864806 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-52744d56-6722-470d-b771-6dac62952419 tempest-PortsAdminExtendedAttrsTestJSON-1257110517 tempest-PortsAdminExtendedAttrsTestJSON-1257110517-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.347421 Aug 30 17:40:02.866150 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1549/3251] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:40:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:02.877395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:02.878311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:02.889876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.892104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.897138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.898304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.898992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.899939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.371779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:03.381021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0dd5891-ce48-4fe9-a5a7-45e1081db392 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 0.513564 Aug 30 17:40:03.381611 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1550/3252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:02 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:03.393794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "name": "network-vif-plugged", "status": "completed", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}, {"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "bba0f423-cf95-45e7-abed-c65ef8c0787e"}, {"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-plugged", "status": "completed", "tag": "2e46b3c6-fd82-4521-b768-ee324e18d75b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:03.418823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.420310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.420925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.452079 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Creating event network-vif-plugged:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h1-852771-11 Aug 30 17:40:03.452904 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Creating event network-vif-plugged:bba0f423-cf95-45e7-abed-c65ef8c0787e for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:40:03.453588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] Creating event network-vif-plugged:2e46b3c6-fd82-4521-b768-ee324e18d75b for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:40:03.478820 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4974f201-2481-48b5-9d49-5e3a4a12662b req-e21c7893-2020-4cb9-8c19-8c43e6cd1097 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.089540 Aug 30 17:40:03.480518 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1551/3253] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:03.491005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:03.492134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:03.505965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.506498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.506953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.510208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.510685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.511116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.857665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:03.870410 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2b91482-d1a9-4908-87c9-088fe1f11a07 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1681 microversion: 2.1 time: 0.388345 Aug 30 17:40:03.871207 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1552/3254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:03 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1681 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:03.893388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:03.897209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:03.911010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.912226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.915577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.917049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.917739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.918362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.963613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:40:04.096760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e33521c-dc8d-4b2e-b3a4-bf8d195db708 tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 204 len: 0 microversion: 2.1 time: 0.207118 Aug 30 17:40:04.098756 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1553/3255] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:40:03 2022] DELETE /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:40:04.114174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1038124816", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "708439cc-c422-4f0f-b5bc-cc0654627826"}, {"port": "498accfa-05e4-4c53-8a2c-2796cff2f079", "tag": "port-1"}, {"port": "a8022e89-bb3f-4f42-9508-4d473fb05117", "tag": "port-2"}, {"uuid": "486487e7-3caa-4013-a551-9f7296483782", "tag": "net-1"}, {"uuid": "486487e7-3caa-4013-a551-9f7296483782"}, {"uuid": "bd7b5682-4cba-41f9-a7de-f43c76007e1c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bd7b5682-4cba-41f9-a7de-f43c76007e1c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "60ecfe20-af8b-4650-84ae-48d78bec1696", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6027a629-ae1d-4e66-ad41-d5324a043e14", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d681b3b1-1e6f-4751-aef7-9ca867f05b11", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1049564571"}], "key_name": "tempest-keypair-1343930443", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:04.609909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:06.823922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=86 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:07.615305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:07.713663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:40:07.714241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:40:07.714926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:40:07.715341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:40:07.715916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:40:07.762369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.763318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.765561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:07.767338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.770590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.771274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:07.792104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Getting quotas for project 8d8f2138f78c41b9ae11b2480aa2faae. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:40:07.801642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Getting quotas for user 91ed6efd64014052b5160efa371775e8 and project 8d8f2138f78c41b9ae11b2480aa2faae. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:40:07.817922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:40:07.822074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:40:07.878765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-230ae4ac-9d4a-4c45-a46b-f628e01ed83a tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 11.020975 Aug 30 17:40:07.889396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1703/3256] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 11032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:40:07.896717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:07.897593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:07.905203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.906327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.908002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:07.908977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.910532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.911460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:08.014543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] validate_networks() for [('708439cc-c422-4f0f-b5bc-cc0654627826', None, None, None, None, None), (None, None, '498accfa-05e4-4c53-8a2c-2796cff2f079', None, None, None), (None, None, 'a8022e89-bb3f-4f42-9508-4d473fb05117', None, None, None), ('486487e7-3caa-4013-a551-9f7296483782', None, None, None, None, None), ('486487e7-3caa-4013-a551-9f7296483782', None, None, None, None, None), ('bd7b5682-4cba-41f9-a7de-f43c76007e1c', '10.2.2.100', None, None, None, None), ('bd7b5682-4cba-41f9-a7de-f43c76007e1c', '10.2.2.200', None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:40:08.737394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:08.946773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:08.970648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:08.972628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:08.975127 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-272d16cd-f46c-4950-8cd1-7857fdf5c541 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2825 microversion: 2.32 time: 1.083304 Aug 30 17:40:08.976181 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1704/3257] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:07 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2825 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:08.985660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:08.986720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] [instance: 4738b013-7cc8-41bc-8288-4838cfffb9c0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:09.001675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.002534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.003864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.004988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.017809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.018318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.052775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] HTTP exception thrown: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Request method failure captured: Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 HTTP/1.1 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDksD6EsvkbYSwfantTmR00K8NyLzI-5DAFWSI9ymQgsgrJ8w0XXpMUWIPTpv4dxha8mHhzhdp73HQpJM_CZ2C95cSjuikq_5HvW7T-QDHfQ-MLsy5-yqK6LysPIvVJ2A9ywRNpeelyebnulmsq7vGHOlRJ77sH6ICNPvMqSul9LFUxA Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6ad7bc471e04326a2ca6044e4a294c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6ad7bc471e04326a2ca6044e4a294c7"}]}] Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f6ad7bc471e04326a2ca6044e4a294c7 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805499895 Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 977cd713892540e59847f3934585e7dc Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805499895-project Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4738b013-7cc8-41bc-8288-4838cfffb9c0'} Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:09.057404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] Returning 404 to user: Instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:09.066313 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f77ffb2-2773-48b4-b8ed-c1d95dfdadfe tempest-FloatingIPsAssociationTestJSON-805499895 tempest-FloatingIPsAssociationTestJSON-805499895-project] 10.222.0.50 "GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0" status: 404 len: 111 microversion: 2.1 time: 0.085468 Aug 30 17:40:09.067598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1705/3258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:08 2022] GET /compute/v2.1/servers/4738b013-7cc8-41bc-8288-4838cfffb9c0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:40:09.075804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:09.076427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:09.102142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.103740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.104481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.106577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.107928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.110046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.342076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:09.361809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8cbb9f8d-12cc-42b0-a48f-07717ddf064a tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1528 microversion: 2.1 time: 0.286033 Aug 30 17:40:09.362809 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1706/3259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:09 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1528 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:09.374287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:09.374929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:09.384905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.385784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.386552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.387436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.388120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.388719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.678111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:09.690350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1eb9ece-022b-4cdd-81d0-239ade284988 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.326376 Aug 30 17:40:09.691533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1707/3260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:09 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:09.698409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-plugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:09.736009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.736650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.737586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.756544 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] Creating event network-vif-plugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:40:09.763738 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-527e3ff3-5b71-4b8d-b353-1cab47b7c82d req-5ff3f0e7-9f6d-4fae-9bf8-c1ba86c51881 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070251 Aug 30 17:40:09.764534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1708/3261] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:09.775168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4738b013-7cc8-41bc-8288-4838cfffb9c0", "name": "network-vif-deleted", "tag": "93893f71-fe27-482c-a47c-32715890f79d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:09.785577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.786333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.786930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.799564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] Creating event network-vif-deleted:93893f71-fe27-482c-a47c-32715890f79d for instance 4738b013-7cc8-41bc-8288-4838cfffb9c0 on n-h1-852771-11 Aug 30 17:40:09.804955 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-295e7f79-472d-4f86-bc31-fa9b769d60c9 req-1dc9559b-f598-4f9c-86a2-3032ec1f461c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038912 Aug 30 17:40:09.806131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1709/3262] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:09.811448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:09.815362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:09.822204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.822980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.823650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.824860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:09.825516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:09.826172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:09.978691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:09.990603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:09.992482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:10.002739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-33ade048-6193-4689-8f6a-74ed607d1699 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "PUT /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1410 microversion: 2.75 time: 0.194968 Aug 30 17:40:10.004153 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1710/3263] 10.222.0.50 () {62 vars in 1297 bytes} [Tue Aug 30 17:40:09 2022] PUT /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1410 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:10.012378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:10.013082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:10.019694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.023117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.023773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.028390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.029409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.030088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.198844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59f8f883-75c7-42be-a5f1-dc76e130e39f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.192237 Aug 30 17:40:10.199581 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1711/3264] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:40:10 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56/os-interface => generated 1831 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:10.215287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:10.216607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:10.227299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.228207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.229090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.230875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.231404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.232439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.525169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:10.535105 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8221261e-508c-4457-98b1-6bcbbf571920 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.333819 Aug 30 17:40:10.548424 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1712/3265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:10 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:10.557091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:10.558746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:10.566768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.567524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.569968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.570878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.573352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.573980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.680760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:10.692405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:10.695945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:10.704900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a28daf5-4256-4f15-a38d-81c2270e1245 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1416 microversion: 2.75 time: 0.153859 Aug 30 17:40:10.725156 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1713/3266] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:10 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:10.733529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:10.734552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:10.746462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.747376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.747912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.749325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.749988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.751735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:11.077829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:11.092545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0fa6ec1-6810-49a5-913a-9df97377e01f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1510 microversion: 2.1 time: 0.363767 Aug 30 17:40:11.093378 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1714/3267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:10 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:11.606352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "tag": "9e866e5a-f52d-4312-8c67-fb8506e0b7a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:11.636391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:11.637897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:11.638358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:11.659247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] Creating event network-changed:9e866e5a-f52d-4312-8c67-fb8506e0b7a6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:40:11.668510 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d8f011a2-f49a-43b5-b282-24e1a2725b91 req-b7e96bcd-2ec8-44d4-afae-b7dc34e2801a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065148 Aug 30 17:40:11.669533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1715/3268] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:11.734645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:11.736281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:11.746251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:11.750142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:11.751673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:11.754396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:11.755143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:11.756653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:11.951601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:11.968023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:11.972734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:11.981922 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4283e4d5-1215-49fe-ac61-fc9d975f7577 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1416 microversion: 2.75 time: 0.252591 Aug 30 17:40:11.982562 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1716/3269] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:11 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1416 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:12.000790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:12.004197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:12.024811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.025650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.026301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.027307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.028801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.029536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.353929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:12.367612 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60f122f6-989e-4422-8268-e165605aaca7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.377286 Aug 30 17:40:12.387196 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1717/3270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:11 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:12.397159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:12.397885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:12.404346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.404745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.405433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.406802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.407434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.408144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.681068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:12.693965 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e31ac39-7d43-4433-83f4-f61899653526 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1510 microversion: 2.1 time: 0.305547 Aug 30 17:40:12.708787 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1718/3271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:12 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:12.715547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:12.716165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:12.722805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.723297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.723796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.724846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:12.725443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:12.726012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:12.960760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:12.969903 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0e5af8c-5fb4-49c0-9d48-d12768e635d2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.259252 Aug 30 17:40:12.970545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1719/3272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:12 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:12.990945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:12.991592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.012088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.017470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.018153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.019069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.021924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.022352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.243158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.273857 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-55a871fe-401e-4a83-89d1-c7af35f72d25 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.286726 Aug 30 17:40:13.275024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1720/3273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:12 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:13.285890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:13.288445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.296185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.296773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.297907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.298580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.299144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.299603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.410825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.420112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.421648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.428160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1365c24-7d9e-4821-887b-e34b7a1ccc45 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1437 microversion: 2.75 time: 0.151200 Aug 30 17:40:13.428773 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1721/3274] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:13 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:13.434634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:13.438889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.448234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.448949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.450049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.450969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.451507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.452021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.504793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:13.553812 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e23aca09-ed52-4749-9546-2a7f0c56c224 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.123339 Aug 30 17:40:13.554807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1722/3275] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:13 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:13.562420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:13.567325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.574655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.575448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.576690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.577647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.579392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.580312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.698406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:40:13.698924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:40:13.699625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:40:13.700201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:40:13.700842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:40:13.782797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.792273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.793199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.793842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.795413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.796286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.796986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.928393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.943865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.947467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:13.960303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-96a7cfb6-bb49-4a40-a2ce-c6f3f9155cbf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "POST /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef/action" status: 202 len: 1494 microversion: 2.75 time: 0.403747 Aug 30 17:40:13.965216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1723/3276] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:40:13 2022] POST /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef/action => generated 1494 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 17:40:13.975146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:13.976142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:13.996867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:13.997672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:13.998379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:13.999331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.000058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.001313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.050332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:14.298449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:14.312065 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-70149382-5700-4118-b0a2-721ce1662f9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1670 microversion: 2.1 time: 0.343957 Aug 30 17:40:14.328768 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1724/3277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:13 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1670 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:14.335456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:14.345539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:14.355167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.355883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.356545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.357890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.359398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.360655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.626817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:14.642644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6139c948-e842-4b53-bf8a-86bfb5fa15ea tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1510 microversion: 2.1 time: 0.308862 Aug 30 17:40:14.643619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1725/3278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:14 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:14.656552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-unplugged", "status": "completed", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:14.684512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.685025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.685463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.736078 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] Creating event network-vif-unplugged:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:40:14.752717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-65abfa01-c811-4cd4-8522-5707164e6bc6 req-afbbb0f8-d65c-4764-913e-002180f5d56a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107837 Aug 30 17:40:14.753341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1726/3279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:14.773920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:14.778203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:14.792646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.796789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.797979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.803850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:14.805786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:14.806442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:14.991136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:15.007801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:15.009306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:15.035231 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-638bfc05-bf49-4f46-960c-3d5075764b73 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.275905 Aug 30 17:40:15.062540 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1727/3280] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:14 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:15.273371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:40:15.273793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:40:15.274248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:40:15.279706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:40:15.280515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:40:15.297299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.300447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.300916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.301666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.302123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.302548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.325762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Getting quotas for project dc892859f18341db86c3a9e931d683a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:40:15.333417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Getting quotas for user 59f53cefb4b9447aa5665fc9b9ef5e1a and project dc892859f18341db86c3a9e931d683a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:40:15.336885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:15.337524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:15.351133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.353583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.354148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.356995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.357097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.359517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.610202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:40:15.618597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='60ecfe20-af8b-4650-84ae-48d78bec1696',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6027a629-ae1d-4e66-ad41-d5324a043e14',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d681b3b1-1e6f-4751-aef7-9ca867f05b11',volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:40:15.623220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:15.645663 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-25f48b57-11e6-4853-bdb3-d09e2f31b9d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1675 microversion: 2.1 time: 0.313241 Aug 30 17:40:15.647871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1728/3281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:15 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:15.665833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:15.666457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:15.680722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.681168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.681706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.682419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.682867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.683298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.879378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:15.892235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d84b7253-fd70-4686-b0b9-07295fa59b1d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1453 microversion: 2.1 time: 0.230442 Aug 30 17:40:15.893401 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1729/3282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:15 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1453 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:15.917250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:15.918411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:15.926744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.927228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.927718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:15.928680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:15.929137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:15.929762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.150798 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a51eb06-e1b1-4324-b2f1-281b8c4fc7f5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 12.049464 Aug 30 17:40:16.157864 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1554/3283] 10.222.0.50 () {62 vars in 1189 bytes} [Tue Aug 30 17:40:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 12058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:40:16.163867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:16.164554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:16.171331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.172083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.174423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.176119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.176745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.177486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.179087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.194124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0777989e-230c-48a3-aff7-00a3fb33c226 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1453 microversion: 2.1 time: 0.283003 Aug 30 17:40:16.194728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1730/3284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:15 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:16.210925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:16.211631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:16.322250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.332194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.333752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.335042 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be700a6a-3ed3-452e-84b8-334f23dfcb2a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1286 microversion: 2.42 time: 0.139290 Aug 30 17:40:16.352105 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1731/3285] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:16 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:16.357806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:16.358351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:16.365346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.365801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.366374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.367091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.367575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.368007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.400479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lazy-loading 'flavor' on Instance uuid 24856869-997c-4b8d-9194-7592e05f8256 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:16.416798 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'shelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state shelved_offloaded Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 14 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: {"shelve": {}} Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'shelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state shelved_offloaded Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'shelve': {}}} Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:40:16.419018 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state shelved_offloaded Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state shelved_offloaded Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'shelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state shelved_offloaded {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:16.424821 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-38839d17-6a26-43d7-aad2-6f10dfa1aa6f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 155 microversion: 2.1 time: 0.067368 Aug 30 17:40:16.425967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1732/3286] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:16 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 155 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:16.431530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:16.432199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:16.439640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.440706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.441157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.442117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.443103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.443103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.530570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.541236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.543044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:16.553185 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d4219193-677d-4d92-a032-3833f6400c41 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.394063 Aug 30 17:40:16.553998 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1555/3287] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:16 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:16.672112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:16.672920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:16.682077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.682607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.683163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.684205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.684962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.685559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.785128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122124) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 17:40:16.909084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4417b829-d31a-4434-9de7-a74c691dca72 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 0.482193 Aug 30 17:40:16.909708 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1733/3288] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:16 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:16.926604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "name": "network-vif-unplugged", "status": "completed", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:16.953691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:16.955038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:16.956769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:16.989242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] Unable to find a host for instance 24856869-997c-4b8d-9194-7592e05f8256. Dropping event network-vif-unplugged {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:40:16.992223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b9ea4935-c4cd-4f48-967d-4264d713bdf4 req-3962ccaf-4232-43f4-9478-a79a72406b09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079326 Aug 30 17:40:16.993036 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1734/3289] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:40:17.008515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:17.010173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.017682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:17.034104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.034999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.035921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.036978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.037661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.039026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.095959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.116487 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae469965-24ed-4a03-b195-778654105e0c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.447766 Aug 30 17:40:17.119359 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1556/3290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:16 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:17.143567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:17.147059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.155786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.156638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.158235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.159422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.160140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.160845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.248089 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02d7c6f1-7189-40e7-b731-1b7f75c40ad2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 200 len: 322 microversion: 2.1 time: 0.109780 Aug 30 17:40:17.252102 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1557/3291] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:17 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 322 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:17.260901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:17.264100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.284185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.285581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.286394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.287743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.290988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.291660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.470887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.483905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68be98d3-062e-4a29-b1ee-ad509e5214aa tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1461 microversion: 2.1 time: 0.489219 Aug 30 17:40:17.488278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1735/3292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:16 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1461 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:17.493862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:17.494460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.590617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.604186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.606194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.608006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1eab20f5-a93d-43db-9fb4-8f6a17a88fed tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1286 microversion: 2.42 time: 0.118139 Aug 30 17:40:17.609027 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1736/3293] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:17 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:17.616878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:17.617669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.624194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.624688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.625307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.633852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.634955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.635831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.784298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.786709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:17.797697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.800838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.811274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e03ea9bc-2c7e-496c-ad36-844edaf22796 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.198428 Aug 30 17:40:17.827520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1737/3294] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:17 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:17.866672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:17.884910 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74988cbf-aa8e-41e9-becc-dc00ade3fc4b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.628253 Aug 30 17:40:17.904839 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1558/3295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:17 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:17.932111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:17.933808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:17.961954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.963813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.965661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:17.970370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:17.971617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:17.974814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.200002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:18.203860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:18.213380 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47d83544-9180-480b-b05d-9f6ef891516d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.285267 Aug 30 17:40:18.215291 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1738/3296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:17 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:18.246672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:18.247889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:18.268763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.269502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.270134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.271955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.273274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.294744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.509233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:18.509954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:18.524549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.525026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.526096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.526249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.526633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.527217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.841800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:18.851649 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6681213c-c7f6-4a9c-8189-1594329777ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.618709 Aug 30 17:40:18.855961 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1559/3297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:18 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:18.860890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:18.875147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:18.882561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.883257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.883875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:18.884753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:18.885890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:18.896230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:19.078380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.093862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ee38003-344f-4918-a016-0dd302f9df26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1461 microversion: 2.1 time: 0.586562 Aug 30 17:40:19.095182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1739/3298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:18 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1461 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:19.129405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:19.130920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:19.139074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:19.140038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:19.140721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:19.141804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:19.142870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:19.143567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:19.246081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.276718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.285673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.288267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d6bfedb-162c-4548-a888-243511e57425 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1594 microversion: 2.42 time: 0.431132 Aug 30 17:40:19.289722 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1560/3299] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:18 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1594 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:19.305246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:19.307391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:19.309153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.320981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.323186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.327336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:19.330220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:19.331116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:19.332355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:19.333695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:19.335354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b758564d-31a5-4297-9e4c-f91aec025f2f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.238805 Aug 30 17:40:19.336151 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1740/3300] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:19 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:19.346974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:19.792537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:19.804620 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e317d7e6-8879-4a2f-b191-050569a5e21d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.513473 Aug 30 17:40:19.805469 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1561/3301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:19 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:20.055256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1518980716", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "59938744-e1cd-4152-9402-9a2134605439"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:20.116349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:20.116958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:20.127143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.127813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.128244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.132002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.132931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.133528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.149736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] validate_networks() for [('59938744-e1cd-4152-9402-9a2134605439', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:40:20.444919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.457855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27bae2a1-0c6a-458b-8809-626e929bda26 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.345355 Aug 30 17:40:20.459516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1562/3302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:20 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:20.466858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:20.467968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:20.477718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.478446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.479541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.480507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.481614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.482253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.588944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.602990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.607225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.611948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8aaedcd0-1058-4b95-a058-94dcbdb41428 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1594 microversion: 2.42 time: 0.150301 Aug 30 17:40:20.612805 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1563/3303] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:20 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:20.621130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:20.622096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:20.642928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.643795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.644529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.646728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:20.647363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:20.649789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:20.803572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.823401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.828372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:20.837040 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72224fa2-064d-49b5-a397-b0ca936222f4 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.220043 Aug 30 17:40:20.838048 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1564/3304] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:20 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:21.486492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:21.487213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:21.503270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:21.503686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:21.504128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:21.504836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:21.505286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:21.505709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:21.778195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:21.791638 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-999ef588-c1e4-4b38-aa45-fc917a57858d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.310177 Aug 30 17:40:21.792556 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1565/3305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:21 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:21.797832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:21.798697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:21.805686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:21.806999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:21.807683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:21.808845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:21.809593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:21.810323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:21.993442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:40:21.997037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:40:21.999675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:40:22.001673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:40:22.002414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:40:22.027984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.030011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.032669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.035106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.042225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.044836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.085810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:40:22.129469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:40:22.167051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:40:22.171255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:40:22.337178 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05c07180-aec6-40ec-9f9d-1f35e88fecce tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290284 Aug 30 17:40:22.338480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1741/3306] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:40:22.345335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:22.346351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:22.354120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.354960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.355754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.356892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.357509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.358095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.387115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.407951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.409880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.414681 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55b212c9-40a2-4455-b025-4cf1e86feb40 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1662 microversion: 2.42 time: 0.619873 Aug 30 17:40:22.419447 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1566/3307] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:21 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1662 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:22.428117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:22.457229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.458538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.459646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.506158 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] Creating event network-changed:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h2-852771-11 Aug 30 17:40:22.519501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c4a76fb3-735b-495e-a3a4-37ebed82ecb9 req-654b8e2a-b472-4c51-bf68-fb505313840b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097829 Aug 30 17:40:22.521968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1567/3308] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:22.536182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ddc21fe7-fa43-4916-8286-9d98489c999d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:22.538198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ddc21fe7-fa43-4916-8286-9d98489c999d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:22.630688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.643370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.645084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.648576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ddc21fe7-fa43-4916-8286-9d98489c999d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:22.657098 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ddc21fe7-fa43-4916-8286-9d98489c999d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1215 microversion: 2.1 time: 0.131444 Aug 30 17:40:22.661876 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1568/3309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:22 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:22.672856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66ab2a9f-447a-402d-829f-1ef0c5c11d43 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.332540 Aug 30 17:40:22.677083 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1742/3310] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:22 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:22.817933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:22.819047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:22.842994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.843665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.844239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:22.845913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:22.846480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:22.847353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.124938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:23.145773 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d457fa3-1213-4d27-ae57-1c4cd9ea8fd2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.333307 Aug 30 17:40:23.148148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1569/3311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:22 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:23.445090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:23.446666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:23.476317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.478643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.481171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.487886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.490447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.491290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.686540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:23.688670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:23.715900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.718423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.721100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.725173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.727448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.729923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.884813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:23.906162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f6e49a3-0564-4698-b400-678acb1f3b47 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1267 microversion: 2.1 time: 0.223546 Aug 30 17:40:23.910587 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1570/3312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:23 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:23.926199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:23.929426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:23.972975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.974721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.975862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:23.980472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:23.981685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:23.983211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:24.035193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.052723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.054900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.057058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17251c4d-7324-403a-a1cf-423c11b4f879 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1709 microversion: 2.42 time: 0.616492 Aug 30 17:40:24.058912 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1743/3313] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:23 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1709 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:24.165160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.170778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:24.171443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:24.182538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:24.183037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:24.183470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:24.188538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:24.189332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:24.189975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:24.196217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.205537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:24.217568 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7d01e27-b787-4b05-813c-31a446f67c8f tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.305200 Aug 30 17:40:24.219911 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1571/3314] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:23 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:24.939076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:24.942061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:24.967658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:24.972642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:24.973372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:24.977497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:24.978541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:24.980468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:25.175365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:25.189062 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36d864b0-b56d-4c5d-a262-a31148d1d6c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 1.022535 Aug 30 17:40:25.208976 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1744/3315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:24 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:25.214019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:25.219733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:25.230806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:25.231667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:25.232327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:25.240120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:25.242572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:25.243291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:25.317701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:26.009270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.030701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-28f71785-0b02-4126-be1a-82d5b24cca85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1273 microversion: 2.1 time: 1.098730 Aug 30 17:40:26.034891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1572/3316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:24 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1273 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:26.051912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:26.060656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:26.085151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:26.087087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:26.088346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:26.090284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:26.094167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:26.098727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:26.161346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:26.542695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.552959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.571805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.583086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dde2cc36-86da-485f-9717-0d12b6438491 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.546310 Aug 30 17:40:26.590508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1573/3317] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:26 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:26.606472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:26.607370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:26.640038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:26.640529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:26.641521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:26.656006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:26.658574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:26.700634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:26.737109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.786576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.801158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:26.806365 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9617213-4191-4356-8cc9-f70b3390b00f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1756 microversion: 2.42 time: 1.594223 Aug 30 17:40:26.806967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1745/3318] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:25 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1756 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:27.057792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:27.058505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:27.071690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.097220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:27.100661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:27.106540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.107365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:27.112381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:27.366724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:27.396150 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f47146c-ef6e-42aa-8cb6-2a49d018fd33 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1273 microversion: 2.1 time: 0.343437 Aug 30 17:40:27.396815 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1746/3319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:27 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:27.619494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:27.620600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:27.643760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.650262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:27.651254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:27.654729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.655459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:27.657188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:27.864276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:27.879092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:27.904518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:27.928494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b8dcddc-d4bc-4f40-ad64-0303f1acd338 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.313414 Aug 30 17:40:27.930707 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1747/3320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:27 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:27.942589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:27.955088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:27.986628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.990005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:27.990549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:27.991303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:27.996541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:28.002593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:28.276168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:28.290952 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-28a078ce-b9d3-483a-ac50-6f0cd51d2f4f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 1.695696 Aug 30 17:40:28.293252 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1574/3321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:26 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:28.366797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:28.384015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:28.385905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:28.388150 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fdabd20-70a0-4bd5-bbb1-e456d6dff00b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1756 microversion: 2.42 time: 0.455600 Aug 30 17:40:28.404386 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1748/3322] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:27 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1756 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:28.418310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:28.418930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:28.432689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:28.433349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:28.434870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:28.436884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:28.439039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:28.439861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:28.811002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:28.825756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-42da5510-7358-40ce-a6c8-7c795d6a07ab tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1273 microversion: 2.1 time: 0.411196 Aug 30 17:40:28.839502 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1575/3323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:28 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:28.964077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:28.964709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:28.988151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.002663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.004120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.007999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.012553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.020528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.213083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.232556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.234019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.247256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4213c80-f27d-435b-9103-3c9ff8ca2b70 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.288441 Aug 30 17:40:29.247984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1749/3324] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:28 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:29.316034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:29.316911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:29.330940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.334473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.335140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.338394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.339067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.342252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.418946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:29.420292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:29.432663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.436558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.441788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.446686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.449764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.450246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.791342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.804370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.815007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.816428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-51ea3d53-87fb-4940-8d47-8245cae87d1c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1756 microversion: 2.42 time: 0.403508 Aug 30 17:40:29.817125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1750/3325] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:29 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1756 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:29.852937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:29.854275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:29.863224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.864146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.864686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.865613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:29.866172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:29.866699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:29.953644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:29.965057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68d70360-96fd-414d-bc69-f9251be98a1f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1273 microversion: 2.1 time: 0.115776 Aug 30 17:40:29.975407 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1751/3326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:29 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:30.281554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:30.282542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:30.301082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:30.301741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:30.303447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:30.305096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:30.308320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:30.309339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:30.320027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:30.340927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-240a62b7-5653-4ca0-9638-61dea785bc48 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 1.030242 Aug 30 17:40:30.354642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1576/3327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:29 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:30.435539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:30.446989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:30.449746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:30.456153 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7567aab2-2ab3-4157-8134-3055af6a8d10 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.180962 Aug 30 17:40:30.472234 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1752/3328] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:30 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:30.846600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:30.847410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:30.864202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:30.865734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:30.866201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:30.867731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:30.868205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:30.869047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:30.992013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:30.992844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:31.015431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.015431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.020319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:31.023362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.026203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.027320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:31.197667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:31.214824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-75c76e52-9a98-44e8-8bf7-0e7b3568cdb7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1273 microversion: 2.1 time: 0.228520 Aug 30 17:40:31.216738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1753/3329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:30 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:31.366259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:31.368349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:31.397223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.398957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.400505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:31.404642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.405463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.408464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:31.735386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:31.752283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:31.756621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:31.760539 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a849f093-efdd-4ff9-ba6a-b194db64a702 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1803 microversion: 2.42 time: 0.918198 Aug 30 17:40:31.763244 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1577/3330] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:30 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1803 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:31.770632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:31.779369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:31.779937 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a619f14f-590c-4e06-8ea2-ecd7c7d4de43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.420975 Aug 30 17:40:31.781188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1754/3331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:31 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:31.784189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:31.803722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.805890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.807513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:31.811624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:31.813221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:31.814601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.181513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:32.199039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:32.203638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:32.226497 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78bfd628-8f55-469c-a630-c198865cad69 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.460658 Aug 30 17:40:32.252274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:32.257371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:32.263067 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1578/3332] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:31 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:32.274394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:32.277382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:32.282690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.284494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.285564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.287199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.290230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.290859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.634813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:32.647461 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efc92f63-73b4-4d74-b71c-9adda283995a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.405197 Aug 30 17:40:32.664177 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1755/3333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:32 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:32.796517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:32.800944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:32.825618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:32.826823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:32.836174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:32.846177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.846845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.847875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.849461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.850369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.851053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.852011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.852356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:32.853797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.854517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.855807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:32.856390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:32.868932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:33.141448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:33.162155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80b0bf16-ee03-418f-9bf5-bf56c4a1edc7 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.349015 Aug 30 17:40:33.163514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1756/3334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:32 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:33.260433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:33.261414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:33.282670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:33.284269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:33.284718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:33.288596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:33.289077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:33.304576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:33.483897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:33.497575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:33.499194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:33.506289 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6b79b44-e5f9-4894-a493-61f168e392cc tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.252291 Aug 30 17:40:33.523512 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1757/3335] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:33 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:33.681957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:33.682738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:33.700178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:33.700742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:33.701245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:33.702020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:33.702543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:33.703504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:33.958404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:33.984572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9dd4ba34-da06-4980-8c7b-6e76daa94993 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.308235 Aug 30 17:40:33.987779 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1758/3336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:33 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:34.194915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:34.195292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:34.206779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:34.210400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:34.212944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:34.213716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:34.214176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:34.214606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:34.233230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.246531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.252349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.253559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d07f709c-bf9b-4800-9f52-d3b90a501936 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1803 microversion: 2.42 time: 1.467515 Aug 30 17:40:34.287512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1579/3337] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:32 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1803 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:34.441312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.462340 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-38d9e7d5-dfc3-4343-92cc-b23b5c94aaeb tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.273149 Aug 30 17:40:34.469814 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1759/3338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:34 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:34.533735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:34.534639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:34.542962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:34.543732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:34.544356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:34.545220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:34.545824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:34.546400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:34.753094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.787021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.788534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:34.807884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7306ff7d-3eac-4d2b-ae19-1f3a0effe38b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.278382 Aug 30 17:40:34.809742 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1580/3339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:34 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:35.010866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:35.011761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:35.025866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.028138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.028806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.034825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.035734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.036359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.283782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:35.285077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:35.301774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.302353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.302858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.303645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.304106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.304540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.604519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:35.616728 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c55efd3-7ddd-4fb1-8964-c320eda740cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.609956 Aug 30 17:40:35.617887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1760/3340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:35 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:35.623803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:35.625140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:35.641399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.644581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.646432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.648369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.651050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.651792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.861843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:35.877643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4fc9e397-2c53-49c2-8686-27a0f9e1837f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.258610 Aug 30 17:40:35.878472 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1761/3341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:35 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:35.896720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:35.897737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:35.904731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.905702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.906895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.907846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:35.908500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:35.909114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:35.990939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.002578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.004377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.010627 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-951d97b1-b50c-4def-ada6-fca592c3dae6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.117897 Aug 30 17:40:36.024059 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1762/3342] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:35 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:36.442159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.461042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.463047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.464663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dcc66039-d63d-4a32-8956-7b55a5578b33 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1803 microversion: 2.42 time: 1.185516 Aug 30 17:40:36.466755 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1581/3343] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:35 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1803 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:36.643171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:36.643829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:36.655818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:36.659978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:36.660713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:36.661761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:36.672462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:36.673223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:36.878805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:36.892782 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f94ba8a3-1f6c-4ebd-9ce4-dd6d37199fc4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.254141 Aug 30 17:40:36.899068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:36.900134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:36.926662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:36.927626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1763/3344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:36 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:36.928430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:36.930838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:36.931812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:36.941329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:36.941658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:37.038741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:37.039856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:37.056244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:37.056930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:37.059650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:37.061853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:37.065417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:37.065913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:37.212543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.229991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.241273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.249188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-76f352bf-06f8-461f-8542-8aa1c4f36dc6 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.216562 Aug 30 17:40:37.250963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1764/3345] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:37 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:37.499951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:37.501077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:37.512617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:37.513488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:37.514210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:37.515151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:37.517127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:37.517835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:37.819988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.834840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.839591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:37.845584 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1f151a27-0a58-4bcd-8733-5d7493ec2b9b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1850 microversion: 2.42 time: 0.354955 Aug 30 17:40:37.846778 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1765/3346] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:37 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1850 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:37.940236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:37.946719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:38.002569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.003071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.003542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.016416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.020264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.020909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.407278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:38.421120 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82ff603b-7997-4d79-af35-cad2ae761039 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.490574 Aug 30 17:40:38.435321 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1766/3347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:37 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:38.443189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc7f966-c683-4425-ac13-32cfcbd4389f", "tag": "f78f2d97-3c84-49e7-9c60-58b34bfacfdd"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:38.455450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:38.466975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.467856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.469065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.482095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] Creating event network-changed:f78f2d97-3c84-49e7-9c60-58b34bfacfdd for instance 6bc7f966-c683-4425-ac13-32cfcbd4389f on n-h2-852771-11 Aug 30 17:40:38.484614 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-927410af-0d9f-472b-976c-cb4dff5b7fca tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 1.590035 Aug 30 17:40:38.488442 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6ffbb954-4fdc-4f6a-aeec-8c1a7bf12442 req-46c59c82-333e-4e12-8f53-0d7de99bb952 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050996 Aug 30 17:40:38.489876 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1767/3348] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:38.490005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1582/3349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:36 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:38.506083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:38.506689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:38.525206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.526603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.527281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.530420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.531893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.533601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.779995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:38.794044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:38.799176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:38.809158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:38.810965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11984624-2aaa-40e2-8141-b1b875f784d2 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.318470 Aug 30 17:40:38.811821 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1583/3350] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:38 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:38.877092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:38.877960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:38.884039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:38.912730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.913946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.916439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:38.917425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:38.918025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:38.918529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:39.458267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:39.458891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:39.482740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:39.483234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:39.483710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:39.492256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:39.493289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:39.493965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:39.606328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:39.623875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:39.625426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:39.626858 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7fb53a6b-a8ca-4eb9-86e8-3ebc981ef57b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1850 microversion: 2.42 time: 0.756789 Aug 30 17:40:39.635814 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1768/3351] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:38 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1850 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:39.644098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:39.644733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:39.662130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:39.664306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:39.664940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:39.666808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:39.669645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:39.673801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.087714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:40.124112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4108dd2-00bb-4c75-b454-c06ee3f82721 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.669778 Aug 30 17:40:40.128033 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1584/3352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:39 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:40.163036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:40.164077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:40.179949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.180851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.181559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.182505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.184313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.186104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.221661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:40.245149 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e200dee-b9df-4992-8734-c7b07da97684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.607792 Aug 30 17:40:40.259940 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1769/3353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:39 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:40.526781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "name": "network-vif-plugged", "status": "completed", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:40.540455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.540931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.541360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.557725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:40.569932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:40.578793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:40.592274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] Creating event network-vif-plugged:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h2-852771-11 Aug 30 17:40:40.593163 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e46f5cf2-8b39-49f7-811b-dc250151fb97 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1446 microversion: 2.75 time: 0.461521 Aug 30 17:40:40.599710 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1585/3354] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:40 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1446 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:40.607321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c165b3ae-7dc6-45c6-9d65-542412ec8b8c req-0f9b7ddf-9303-44b1-bdd5-735e2573db7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084058 Aug 30 17:40:40.619288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1770/3355] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:40:40.652226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:40.653159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:40.672752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.674845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.675297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.678541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.684087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.684775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.882782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "a41be049-3f81-4729-a403-3c5995e16c6f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:40.901944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:40.906676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:40.908807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:40.930966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] Creating event network-changed:a41be049-3f81-4729-a403-3c5995e16c6f for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:40.944405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-fb482db8-0322-4d7f-8ba2-ba608095e0cc req-822465bd-4c35-4f0e-bb54-7c18d6b71001 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064996 Aug 30 17:40:40.945584 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1771/3356] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:41.153794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:41.154892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:41.189303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:41.193217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:41.197462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:41.198511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:41.199154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:41.199781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:41.204295 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:40:41.204513 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 17:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 (ip 10.222.0.50) !!! Aug 30 17:40:41.900790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:41.911300 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d2b9907-e4cd-4a79-9dcf-647acfceef10 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.766259 Aug 30 17:40:41.912603 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1772/3357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:41 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:41.918831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:41.919869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:41.929140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:41.930125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:41.930835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:41.931837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:41.932478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:41.933120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:42.139955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.179524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.185283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.187315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de78a986-2ec6-4519-b149-60f7763f6d55 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1850 microversion: 2.42 time: 1.540823 Aug 30 17:40:42.195930 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1586/3358] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:40 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1850 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:42.208825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:42.209803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:42.232871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:42.237675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:42.239602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:42.241512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:42.255950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:42.260505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:42.527538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.544978 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7c033ef-7986-488a-9580-002d63793a34 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1519 microversion: 2.1 time: 0.625600 Aug 30 17:40:42.561562 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1773/3359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:41 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1519 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:42.860816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.878821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.883094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:42.897279 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-337667a9-86f6-487b-a8a9-df7bf3027e21 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1452 microversion: 2.75 time: 0.699412 Aug 30 17:40:42.910351 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1587/3360] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:42 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1452 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:42.935079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:42.935994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:42.948165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:42.956869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:42.959539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:42.960935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:42.967648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:42.969862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:43.222020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:43.222850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:43.240105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:43.240648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:43.241107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:43.242756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:43.244747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:43.245669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:44.852233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:44.865226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:44.875514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8b8d226-0847-4528-ba9c-6dff31aa186b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 1.945239 Aug 30 17:40:44.890932 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1774/3361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:42 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:44.902301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:44.903342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:44.913844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:44.914804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:44.915780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:44.916722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:44.918486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:44.919367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:45.022436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.049450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.058554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.064720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf3feb54-ef80-4c8f-9213-efdcb9edfbfd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1850 microversion: 2.42 time: 1.847231 Aug 30 17:40:45.066171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1588/3362] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:43 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1850 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:45.089419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:45.094669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:45.130944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:45.135082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:45.136961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:45.140070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:45.145515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:45.149432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:45.419987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.426028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:45.435431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.438716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:45.445980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-271c65ad-8999-4e97-b1b2-ce737e4245bf tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1437 microversion: 2.75 time: 0.378687 Aug 30 17:40:45.457989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1589/3363] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:45 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1437 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:45.477367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc7f966-c683-4425-ac13-32cfcbd4389f", "name": "network-vif-plugged", "status": "completed", "tag": "f78f2d97-3c84-49e7-9c60-58b34bfacfdd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:45.495221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:45.495966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:45.496774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:45.512179 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] Creating event network-vif-plugged:f78f2d97-3c84-49e7-9c60-58b34bfacfdd for instance 6bc7f966-c683-4425-ac13-32cfcbd4389f on n-h2-852771-11 Aug 30 17:40:45.520551 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8387bcbf-6adf-4612-8d0c-30b440f6e8f6 req-a57db37e-d428-4422-a29c-d6371228e02e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056271 Aug 30 17:40:45.521467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1590/3364] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:45.775105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:45.780878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:45.802245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:45.804223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:45.805742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:45.806709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:45.809485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:45.810479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.033930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:40:46.035210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:40:46.035210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:40:46.035711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:40:46.036200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:40:46.160979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:46.183470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.184159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.186620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.190053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.192345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.193846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.452629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:46.476639 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ea7985f-0647-4d6a-bb45-8c57250945ac tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 1.581316 Aug 30 17:40:46.477255 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1775/3365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:44 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:46.501136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:46.501780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:46.522951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.523296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.532221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.535520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.536232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.536859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.621531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:46.669868 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-886af044-a2b3-40cc-905c-f209225a0cf4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef/action" status: 202 len: 1942 microversion: 2.75 time: 1.145036 Aug 30 17:40:46.673729 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1591/3366] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:40:45 2022] POST /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef/action => generated 1942 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 17:40:46.700153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "498accfa-05e4-4c53-8a2c-2796cff2f079"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:46.715175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.715675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.717019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.732078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] Creating event network-changed:498accfa-05e4-4c53-8a2c-2796cff2f079 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:46.744872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6e9b6680-8567-4146-9bb2-e4111b6ad2fb req-f970fdba-3b83-441b-b57f-4cfdcc0e5b3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069849 Aug 30 17:40:46.747618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1592/3367] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:46.763070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:46.764266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:46.778365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.778859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.779297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:46.780035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:46.780486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:46.786013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.407493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:47.417387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0aaa738-29fa-401c-b69d-799082cdecbc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1315 microversion: 2.1 time: 0.934800 Aug 30 17:40:47.427888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1776/3368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:46 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:47.444851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:47.445487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:47.463187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.464357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.466405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.467303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.468151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.469315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.613250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:47.625858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:47.627301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:47.635566 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30aa1dcb-aab5-42ee-a58e-7b9b9349cd73 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1871 microversion: 2.42 time: 0.879625 Aug 30 17:40:47.638001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1593/3369] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:46 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1871 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:47.646848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:47.647616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:47.663513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.664000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.664428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.665121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.665570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.665999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.698464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:47.708332 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ffe71a84-3bd3-4826-8ada-28db00f19d43 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.279286 Aug 30 17:40:47.711779 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1777/3370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:47 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:47.811854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ff68839-8264-4785-b377-5e43d727f8d3 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Calling method '.version_select at 0x7f2d93726af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:47.922742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ff68839-8264-4785-b377-5e43d727f8d3 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.208235 Aug 30 17:40:47.924008 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1778/3371] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:40:47 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:40:47.935922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:47.936612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:47.946085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.947145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.947996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:47.949187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:47.949980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:47.950727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.008264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:48.056297 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c2c1f1f-984d-451d-a7b9-0407850d232f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.417104 Aug 30 17:40:48.057459 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1594/3372] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:47 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:48.063050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7187ef44-4d75-4f34-9836-0e47aa84fa86 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Action: 'create', calling method: .version_select at 0x7f2d9cc38040>, body: {"pool": "non_exist_pool"} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:48.257971 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7187ef44-4d75-4f34-9836-0e47aa84fa86 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] HTTP exception thrown: Floating IP pool not found. Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7187ef44-4d75-4f34-9836-0e47aa84fa86 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Request method failure captured: Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 26 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkufIpA1BYH_EUdpWc2H919flSBVc8OckHlhigEMd7uIrnMp1fkZvlOULdTI6fXSukf7d9yCHF128VYoXO1YqQMJFmv3_aezK6MkFgGFkBfcOb8oa8vgFMHieFQZ3OFt8EFnDOKDyZ4P2_zfbwmnFoXuwo2vrT3PunrkiwqvERlZezU Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 808cf3fa01f44d9db49ec46d5f031e43 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_808cf3fa01f44d9db49ec46d5f031e43"}]}] Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 808cf3fa01f44d9db49ec46d5f031e43 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsNegativeTestJSON-1617186999-project Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: c8bb1f23e3d74b3384cd3657230657f0 Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1617186999-project Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: {"pool": "non_exist_pool"} Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: exception: Floating IP pool not found. Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:48.261919 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:48.267860 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 30 17:40:48.267860 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.269270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:48.272036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7187ef44-4d75-4f34-9836-0e47aa84fa86 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Returning 404 to user: Floating IP pool not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:48.273160 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7187ef44-4d75-4f34-9836-0e47aa84fa86 tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.214540 Aug 30 17:40:48.280336 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d09dc3a1-a67f-46f5-957d-cb4dda40ffe2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.354754 Aug 30 17:40:48.281706 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1595/3373] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:40:48 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:48.290934 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1779/3374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:47 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:48.295870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Calling method '.version_select at 0x7f2d93726dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:48.302833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2563f532-5e18-47cb-af8e-e5819f97cd86 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:48.309439 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2563f532-5e18-47cb-af8e-e5819f97cd86 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2563f532-5e18-47cb-af8e-e5819f97cd86 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/99cd3963-f5b2-46f1-99c1-655c9c3361ed/action HTTP/1.1 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: {"os-stop": {}} Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '99cd3963-f5b2-46f1-99c1-655c9c3361ed', 'body': {'os-stop': {}}} Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:40:48.314832 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.319949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2563f532-5e18-47cb-af8e-e5819f97cd86 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 99cd3963-f5b2-46f1-99c1-655c9c3361ed has no mapping to a cell. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:48.321742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2563f532-5e18-47cb-af8e-e5819f97cd86 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/99cd3963-f5b2-46f1-99c1-655c9c3361ed/action" status: 404 len: 117 microversion: 2.1 time: 0.023368 Aug 30 17:40:48.326083 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1596/3375] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:48 2022] POST /compute/v2.1/servers/99cd3963-f5b2-46f1-99c1-655c9c3361ed/action => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:40:48.331080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:48.331578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:48.338083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.338571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.339001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.339722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.340166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.340580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.364490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9d23c499-4234-4452-b355-edf0033791b0 could not be found", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:40:48.365164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] HTTP exception thrown: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Request method failure captured: Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-floating-ips/9d23c499-4234-4452-b355-edf0033791b0 HTTP/1.1 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkufIpA1BYH_EUdpWc2H919flSBVc8OckHlhigEMd7uIrnMp1fkZvlOULdTI6fXSukf7d9yCHF128VYoXO1YqQMJFmv3_aezK6MkFgGFkBfcOb8oa8vgFMHieFQZ3OFt8EFnDOKDyZ4P2_zfbwmnFoXuwo2vrT3PunrkiwqvERlZezU Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 808cf3fa01f44d9db49ec46d5f031e43 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/808cf3fa01f44d9db49ec46d5f031e43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_808cf3fa01f44d9db49ec46d5f031e43"}]}] Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 808cf3fa01f44d9db49ec46d5f031e43 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1617186999 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsNegativeTestJSON-1617186999-project Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c8bb1f23e3d74b3384cd3657230657f0 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1617186999-project Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: exception: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9d23c499-4234-4452-b355-edf0033791b0'} Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9d23c499-4234-4452-b355-edf0033791b0 could not be found Aug 30 17:40:48.367746 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d70f492-9b84-4c52-bc62-d625bc2e3adb'] Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0. Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0 Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0 Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:48.372759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] Returning 404 to user: Floating IP not found for ID 9d23c499-4234-4452-b355-edf0033791b0 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:48.376354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5e94604-7238-4c39-b9b7-cd38c3e4411e tempest-FloatingIPsNegativeTestJSON-1617186999 tempest-FloatingIPsNegativeTestJSON-1617186999-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/9d23c499-4234-4452-b355-edf0033791b0" status: 404 len: 111 microversion: 2.1 time: 0.086396 Aug 30 17:40:48.378783 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1780/3376] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:40:48 2022] DELETE /compute/v2.1/os-floating-ips/9d23c499-4234-4452-b355-edf0033791b0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:40:48.446523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:48.447296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:48.457359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.458284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.459078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.460346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.461012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.461713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.711439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:48.724861 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d55dd79c-7417-470b-8b4e-fae1a87793ba tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1502 microversion: 2.1 time: 0.284661 Aug 30 17:40:48.726318 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1781/3377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:48 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:48.733069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:48.734805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:48.748457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.749526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.750718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:48.752228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:48.754630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:48.758086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.050476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:49.079685 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0697caf2-91ac-44cf-8804-80a5806b615d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.752141 Aug 30 17:40:49.092858 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1597/3378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:48 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:49.118622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:49.143798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.145869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.148642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.198858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:40:49.303596 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3bf1404a-da3e-4175-bb31-03d2f9ad7950 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f/action" status: 202 len: 0 microversion: 2.1 time: 0.199462 Aug 30 17:40:49.306166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:49.322495 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1598/3379] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:49 2022] POST /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:49.335651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:49.337455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:49.342760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:49.348294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.349378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.350168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.351398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.352155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.357076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:49.357555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.358950 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2349954f-4ee7-4217-818f-4a05dffa9ff2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.631013 Aug 30 17:40:49.371853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1782/3380] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:48 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:49.386929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:49.387626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:49.411971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.412470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.412908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.413623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.414082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.414511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.764434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:49.778703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-719a0b13-1e93-4ede-ba30-c21717e74626 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.410695 Aug 30 17:40:49.796611 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1783/3381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:49 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:49.803561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "a8022e89-bb3f-4f42-9508-4d473fb05117"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:49.819958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.820860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.821546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.839616 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] Creating event network-changed:a8022e89-bb3f-4f42-9508-4d473fb05117 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:49.842629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:49.847818 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b479eaf1-f587-4401-b5c0-285915219bec req-4134d09b-25eb-46eb-93e1-89baf86a1762 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048572 Aug 30 17:40:49.849221 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1784/3382] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:49.871924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:49.874878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:49.895852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.898099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.898798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.898933 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4af8b4d7-5c7c-45a6-97fe-8a5648d83bd6 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.573903 Aug 30 17:40:49.899845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1599/3383] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:49 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:49.900788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.902129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.903843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.912410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:49.912962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:49.925217 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/9a84e65d-1e56-4b21-9fa3-52ff3eff89d7/action HTTP/1.1 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: {"suspend": {}} Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9a84e65d-1e56-4b21-9fa3-52ff3eff89d7', 'body': {'suspend': {}}} Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:49.927247 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:49.934353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:49.934353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:49.934353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. Aug 30 17:40:49.934353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:49.938213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 9a84e65d-1e56-4b21-9fa3-52ff3eff89d7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:49.939597 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf4a69d9-b981-4e97-9505-66ad19f7e7d1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/9a84e65d-1e56-4b21-9fa3-52ff3eff89d7/action" status: 404 len: 111 microversion: 2.1 time: 0.038766 Aug 30 17:40:49.940742 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1600/3384] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:49 2022] POST /compute/v2.1/servers/9a84e65d-1e56-4b21-9fa3-52ff3eff89d7/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:40:49.953064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:49.954077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:49.962982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.963870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.964539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:49.966794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:49.967840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:49.968974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:50.207225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:50.222659 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13c0140f-b495-42aa-b34b-1e77b280a36c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.371722 Aug 30 17:40:50.228588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1785/3385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:49 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:50.386303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:50.386996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:50.396131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:50.397107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:50.398145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:50.399661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:50.400397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:50.401000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:50.676987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:50.697938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e349596-69b9-492b-b76b-c841cd962c7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.752198 Aug 30 17:40:50.720528 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1601/3386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:49 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:50.739691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:50.740658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:50.748800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:50.749702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:50.751307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:50.752317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:50.753012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:50.754887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.010090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:51.029927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:51.033210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:51.037670 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb09fecb-866c-427f-a754-f0dca92545c5 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.655774 Aug 30 17:40:51.038138 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1786/3387] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:50 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:51.043965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:51.044585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:51.055791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.056377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.056981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.067774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.067774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.072567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.242804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:51.253349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b116f3de-f901-4d03-9df9-8fe05641b58c tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.531259 Aug 30 17:40:51.266062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1602/3388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:50 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:51.288214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:51.289116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:51.305420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.305805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.307174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.313805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.314302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.314751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.338547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:51.369146 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad8414f8-4e17-40e2-9b10-8458991dac14 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.328664 Aug 30 17:40:51.380984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1787/3389] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:51 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:51.397471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:51.405428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:51.415330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.416224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.416901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.417847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.418516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.419153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.454937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lazy-loading 'flavor' on Instance uuid 24856869-997c-4b8d-9194-7592e05f8256 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:51.546756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f385afb2-7f89-410e-ab1e-b802c718714f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 0.163525 Aug 30 17:40:51.551888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1788/3390] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:51 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:51.561046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:51.563579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:51.572335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.572913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.573359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.574078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:51.574539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:51.575144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:51.877077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:51.896190 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a72869c-256c-403e-a4df-730a48448a5c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.628366 Aug 30 17:40:51.899606 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1603/3391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:51 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:52.065166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:52.066044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:52.073712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.074842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.076008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.078874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.079992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.080979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.220970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:52.243189 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bbbf4ddd-a8a6-4fce-bf23-51c06cbbf1c5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1514 microversion: 2.1 time: 0.689676 Aug 30 17:40:52.257420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1789/3392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:51 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1514 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:52.258694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "213461bb-32e1-4964-83aa-30286c3e0786"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:52.274422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.275069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.275659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.292133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] Creating event network-changed:213461bb-32e1-4964-83aa-30286c3e0786 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:52.300612 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4a852bff-a0fb-4afa-80d9-deea304942ad req-9e4e7869-11e6-41d1-b189-9368c19e2149 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054903 Aug 30 17:40:52.302211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1790/3393] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:52.400432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:52.402107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:52.414161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.416749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.418040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.419874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.420573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.423266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.547158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:52.573175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b760bb49-34c6-49cf-b54c-a53d32b7b5a4 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.176297 Aug 30 17:40:52.588219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1791/3394] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:52 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:52.924578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:52.928743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:52.939374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.940260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.940861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.942301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:52.942973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:52.944045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:52.975135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:53.313275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:53.328407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85ca8792-4dce-42cb-b28e-e2204962670a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.408950 Aug 30 17:40:53.347300 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1792/3395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:52 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:53.356699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:53.359973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:53.370950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.371449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.371916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.372640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.373254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.373517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.447830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:53.462966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:53.465115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:53.477312 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21a87fe8-56da-4b88-8760-1f08bf0b9b46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 1.415993 Aug 30 17:40:53.477887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1604/3396] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:52 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:53.604368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:53.611640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:53.640874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.645887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.649313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.651278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.652149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.652648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.699723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:53.712487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec5cff23-c380-42e7-8d63-0d08108de48f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1497 microversion: 2.1 time: 0.363879 Aug 30 17:40:53.713230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1793/3397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:53 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1497 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:53.735628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:53.736532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:53.744638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.745381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.746015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.746894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.747529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.748121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.787417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lazy-loading 'flavor' on Instance uuid 24856869-997c-4b8d-9194-7592e05f8256 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:53.804673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'suspend' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state suspended Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 15 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: {"suspend": {}} Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'suspend' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state suspended Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'suspend': {}}} Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 30 17:40:53.809363 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state suspended Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state suspended Aug 30 17:40:53.815380 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:53.820339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'suspend' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state suspended {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:53.821684 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0cee5308-f480-4c50-a087-b587ef74ad7f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 148 microversion: 2.1 time: 0.091681 Aug 30 17:40:53.822821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1794/3398] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:53 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:53.831311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:53.831871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:53.838279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.838757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.839394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.840283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.840892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.841478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.879744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:53.921256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1af44bae-1779-4368-8ed0-6564cc9e1f39 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.324523 Aug 30 17:40:53.921942 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1605/3399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:53 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:40:53.931527 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f306de1-06fc-4b91-ab45-fca86bb3ba41 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 202 len: 0 microversion: 2.1 time: 0.104310 Aug 30 17:40:53.943145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:53.944110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:53.944977 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1795/3400] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:53 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:40:53.952202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.953736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.954378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.957773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:53.959903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:53.961419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:53.966644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:54.353341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:54.354245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:54.362728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.363357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.364289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:54.365273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.365799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.366296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:54.503044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:54.514263 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37d052c2-ff61-4d72-bbd7-41783f2168e5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1503 microversion: 2.1 time: 0.576781 Aug 30 17:40:54.517359 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1606/3401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:53 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:54.524037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:54.525188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:54.536893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.537743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.538831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:54.539849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.540298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.540717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:54.738219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:54.746883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-674ebee6-4b48-4530-98d6-a38018b189b9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.399241 Aug 30 17:40:54.761633 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1796/3402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:54 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:54.951506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:54.954420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:54.962981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.963866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.964471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:54.976962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:54.979020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:54.980847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:55.009967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:55.032272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:55.038235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:55.043992 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b98fdf72-cae3-45a1-89e0-41db6d420dc8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.521825 Aug 30 17:40:55.045895 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1607/3403] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:54 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:55.308651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "0d3c28d9-98b6-4954-9c09-7d4c35a4cb98"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:55.320192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:55.320673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:55.321108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:55.334161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] Creating event network-changed:0d3c28d9-98b6-4954-9c09-7d4c35a4cb98 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:55.340687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a69dcb9c-9f84-4a60-9704-1aff03bbc038 req-4f7cb72b-5ec8-4070-acf3-21091c366c14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036160 Aug 30 17:40:55.341785 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1608/3404] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:55.384840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:55.406511 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e23f4938-1438-4eaa-9807-0fb1ce641525 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.460192 Aug 30 17:40:55.407667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1797/3405] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:54 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:55.542570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:55.543977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:55.555811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:55.556649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:55.557377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:55.558733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:55.559680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:55.560604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:55.773482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:55.774455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:55.788258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:55.788811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:55.789315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:55.790967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:55.791930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:55.792603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.395760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.408467 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae367cc4-6c2b-45de-b540-0d965fbc36db tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.641227 Aug 30 17:40:56.409453 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1798/3406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:55 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:56.415685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:56.416387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:56.423180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.424003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.424619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.425511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.426122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.426898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.514468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.526375 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ba6cb64-9f10-4d4c-8b3f-d0a7145e4ee5 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1503 microversion: 2.1 time: 0.989245 Aug 30 17:40:56.528670 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1609/3407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:55 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1503 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:56.543820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:56.546626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:56.560085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.563650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.564390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.566519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.567463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.568443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.875605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.886346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.888158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.890051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f91b45d-4def-454d-bd0e-badcf275fb8e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2944 microversion: 2.32 time: 0.478582 Aug 30 17:40:56.891203 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1799/3408] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:56 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2944 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:56.911443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:56.912412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:56.914883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.919949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.920446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.920883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.922308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.922770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.923201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.927396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.928870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:56.936039 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a9568172-c49f-4871-a7b7-ff8a11dedbcb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.401026 Aug 30 17:40:56.940129 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1610/3409] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:56 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:56.951898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:56.952429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:56.962529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.963028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.963472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:56.964243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:56.977910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:56.982232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.104964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:57.127982 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e1384c2e-04ae-41c3-b3dd-f7bdd8eaddbc tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.235214 Aug 30 17:40:57.129184 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1800/3410] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:56 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:57.212692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ace51121-3948-4b21-9687-0739ee5163bd tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.271401 Aug 30 17:40:57.220596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1611/3411] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:40:56 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56/os-interface => generated 1831 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:57.287619 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c940bcf1-fd65-4734-892c-08ddd21b9592 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.141732 Aug 30 17:40:57.289508 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1801/3412] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 30 17:40:57.299517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c251cb5-bfff-41e2-979d-3a3db5b773b3 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Calling method '.version_select at 0x7f2d9395bb80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.334394 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0c251cb5-bfff-41e2-979d-3a3db5b773b3 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] HTTP exception thrown: Image not found. Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c251cb5-bfff-41e2-979d-3a3db5b773b3 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Request method failure captured: Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkupL_MXOjKJbmSen5N_AYKKOI-vjJSUp_CbJJmzJ4z8Tp_Qibuwg3KpX6wQpEJvqNmDXNXiKHER8H5iiyDEdKjoz_9DjQkMrxCPsc3sKb8wpo8_hQae55xGnrjVQ5K_5DBHrGYj7UqKvJchc1Xo2U2PyqYL16KlmAzHFAjLg04Eu5M Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6dc45288baee43508932d074c73d7825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6dc45288baee43508932d074c73d7825"}]}] Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a565a6f22bd941e4be06e6824dbf8daf Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '-1'} Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.337215 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c251cb5-bfff-41e2-979d-3a3db5b773b3 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c251cb5-bfff-41e2-979d-3a3db5b773b3 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.043441 Aug 30 17:40:57.342269 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1612/3413] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:57.351270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a66582a1-77eb-4f0b-aff1-a371771150ef tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Calling method '.version_select at 0x7f2d93719820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.377233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a66582a1-77eb-4f0b-aff1-a371771150ef tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] HTTP exception thrown: Image not found. Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a66582a1-77eb-4f0b-aff1-a371771150ef tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Request method failure captured: Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj HTTP/1.1 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkupL_MXOjKJbmSen5N_AYKKOI-vjJSUp_CbJJmzJ4z8Tp_Qibuwg3KpX6wQpEJvqNmDXNXiKHER8H5iiyDEdKjoz_9DjQkMrxCPsc3sKb8wpo8_hQae55xGnrjVQ5K_5DBHrGYj7UqKvJchc1Xo2U2PyqYL16KlmAzHFAjLg04Eu5M Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6dc45288baee43508932d074c73d7825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6dc45288baee43508932d074c73d7825"}]}] Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a565a6f22bd941e4be06e6824dbf8daf Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj'} Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj to delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj could not be found. Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.379146 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a66582a1-77eb-4f0b-aff1-a371771150ef tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:57.383774 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a66582a1-77eb-4f0b-aff1-a371771150ef tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj" status: 404 len: 62 microversion: 2.1 time: 0.034082 Aug 30 17:40:57.385630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1802/3414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/36ae0d6a-b256-4297-a5e4-a8d01a5ca0bj => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:57.391335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d877967-3480-4864-90eb-8756481abb52 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Calling method '.version_select at 0x7f2d938f61f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.408900 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-3d877967-3480-4864-90eb-8756481abb52 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] HTTP exception thrown: Image not found. Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d877967-3480-4864-90eb-8756481abb52 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Request method failure captured: Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/images/d76daf32-5e1b-42c8-a9b0-fa58db95909d1 HTTP/1.1 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkupL_MXOjKJbmSen5N_AYKKOI-vjJSUp_CbJJmzJ4z8Tp_Qibuwg3KpX6wQpEJvqNmDXNXiKHER8H5iiyDEdKjoz_9DjQkMrxCPsc3sKb8wpo8_hQae55xGnrjVQ5K_5DBHrGYj7UqKvJchc1Xo2U2PyqYL16KlmAzHFAjLg04Eu5M Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6dc45288baee43508932d074c73d7825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6dc45288baee43508932d074c73d7825"}]}] Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: a565a6f22bd941e4be06e6824dbf8daf Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: exception: Image not found. Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd76daf32-5e1b-42c8-a9b0-fa58db95909d1'} Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d76daf32-5e1b-42c8-a9b0-fa58db95909d1 to delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d76daf32-5e1b-42c8-a9b0-fa58db95909d1 could not be found. Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.410661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d877967-3480-4864-90eb-8756481abb52 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Returning 404 to user: Image not found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d877967-3480-4864-90eb-8756481abb52 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/d76daf32-5e1b-42c8-a9b0-fa58db95909d1" status: 404 len: 62 microversion: 2.1 time: 0.025299 Aug 30 17:40:57.416569 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1613/3415] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/d76daf32-5e1b-42c8-a9b0-fa58db95909d1 => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:40:57.423523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b661a94e-463b-46e0-ae91-e5ed5c241f44 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Calling method '.version_select at 0x7f2d93719670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.437684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.438603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:57.446096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.446844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b661a94e-463b-46e0-ae91-e5ed5c241f44 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] HTTP exception thrown: Image not found. Aug 30 17:40:57.447350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.448064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.448925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b661a94e-463b-46e0-ae91-e5ed5c241f44 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Request method failure captured: Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/tempest-invalid-560882159 HTTP/1.1 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkupL_MXOjKJbmSen5N_AYKKOI-vjJSUp_CbJJmzJ4z8Tp_Qibuwg3KpX6wQpEJvqNmDXNXiKHER8H5iiyDEdKjoz_9DjQkMrxCPsc3sKb8wpo8_hQae55xGnrjVQ5K_5DBHrGYj7UqKvJchc1Xo2U2PyqYL16KlmAzHFAjLg04Eu5M Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6dc45288baee43508932d074c73d7825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6dc45288baee43508932d074c73d7825"}]}] Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a565a6f22bd941e4be06e6824dbf8daf Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'tempest-invalid-560882159'} Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-560882159 to delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-560882159 could not be found. Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.449101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b661a94e-463b-46e0-ae91-e5ed5c241f44 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:57.455118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b661a94e-463b-46e0-ae91-e5ed5c241f44 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-560882159" status: 404 len: 62 microversion: 2.1 time: 0.032274 Aug 30 17:40:57.458095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.458368 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1803/3416] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/tempest-invalid-560882159 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:57.462008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9627539d-0caa-4e2f-bdc5-be3961547919 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Calling method '.version_select at 0x7f2d93865dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.462535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.484643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9627539d-0caa-4e2f-bdc5-be3961547919 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] HTTP exception thrown: Image not found. Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9627539d-0caa-4e2f-bdc5-be3961547919 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Request method failure captured: Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/images/8c90183f-1cef-4f5e-9a84-bc2e76268a0d HTTP/1.1 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkupL_MXOjKJbmSen5N_AYKKOI-vjJSUp_CbJJmzJ4z8Tp_Qibuwg3KpX6wQpEJvqNmDXNXiKHER8H5iiyDEdKjoz_9DjQkMrxCPsc3sKb8wpo8_hQae55xGnrjVQ5K_5DBHrGYj7UqKvJchc1Xo2U2PyqYL16KlmAzHFAjLg04Eu5M Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6dc45288baee43508932d074c73d7825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6dc45288baee43508932d074c73d7825"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6dc45288baee43508932d074c73d7825"}]}] Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6dc45288baee43508932d074c73d7825 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420 Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: a565a6f22bd941e4be06e6824dbf8daf Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1550668420-project Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: exception: Image not found. Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8c90183f-1cef-4f5e-9a84-bc2e76268a0d'} Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c90183f-1cef-4f5e-9a84-bc2e76268a0d to delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c90183f-1cef-4f5e-9a84-bc2e76268a0d could not be found. Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.486588 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9627539d-0caa-4e2f-bdc5-be3961547919 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] Returning 404 to user: Image not found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9627539d-0caa-4e2f-bdc5-be3961547919 tempest-ImagesDeleteNegativeTestJSON-1550668420 tempest-ImagesDeleteNegativeTestJSON-1550668420-project] 10.222.0.50 "DELETE /compute/v2.1/images/8c90183f-1cef-4f5e-9a84-bc2e76268a0d" status: 404 len: 62 microversion: 2.1 time: 0.030736 Aug 30 17:40:57.494561 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1804/3417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:57 2022] DELETE /compute/v2.1/images/8c90183f-1cef-4f5e-9a84-bc2e76268a0d => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:57.502951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:57.511819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.512298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.512754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.527618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] Creating event network-changed:ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:57.534784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-632273e7-448c-41b1-aeda-c329b8f957a6 req-371085e0-3786-4417-a93f-03de55954919 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038474 Aug 30 17:40:57.538186 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1805/3418] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:57.551677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.552301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:57.563648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.564158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.564603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.565379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.565839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.566837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.934438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:57.955596 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48680dfe-8a6f-44cd-9e07-d46dad9855e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.520078 Aug 30 17:40:57.956472 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1614/3419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:57 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:57.965685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:57.966622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:57.970185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:57.980929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.982236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.982766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f338cab0-484f-4742-af59-aaec34f14698 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.435297 Aug 30 17:40:57.984713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:57.985963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:57.986131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1806/3420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:57 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:57.986967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:57.987795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.023117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:58.024192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:58.048456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.049195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.050338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.053043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.053709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.055367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.466310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:58.474323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a1a0a8c-6217-42c4-9a60-2d3291915d53 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.456971 Aug 30 17:40:58.475627 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1807/3421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:58 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:58.480657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:58.481500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:58.488402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.489335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.489963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.490926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.491590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.492172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.594864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:58.606028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:58.607849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:58.609579 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1611176c-7df3-4150-af32-ae34d866461a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.651167 Aug 30 17:40:58.610678 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1615/3422] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:57 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:58.616041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:58.616909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 75f7b01c-66d3-4753-b799-55c55d48617e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:58.628740 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/75f7b01c-66d3-4753-b799-55c55d48617e/action HTTP/1.1 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: {"unpause": {}} Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '75f7b01c-66d3-4753-b799-55c55d48617e', 'body': {'unpause': {}}} Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:58.630320 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:58.635766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:58.635766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:58.635766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. Aug 30 17:40:58.635766 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:58.636967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 75f7b01c-66d3-4753-b799-55c55d48617e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:58.638137 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-821e9cc4-606a-4c35-98af-641dcaeef341 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/75f7b01c-66d3-4753-b799-55c55d48617e/action" status: 404 len: 111 microversion: 2.1 time: 0.026282 Aug 30 17:40:58.638915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1616/3423] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:58 2022] POST /compute/v2.1/servers/75f7b01c-66d3-4753-b799-55c55d48617e/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:40:58.648612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:58.649430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:58.658641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:40:58.660083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.661341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.662243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.663201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.664316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.664975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.697662 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42028379-b907-4eef-a448-d51a57672bf5 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.220587 Aug 30 17:40:58.699517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1808/3424] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:58 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:40:58.978516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:58.979504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:58.988136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.989141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.989796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:58.990993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:58.992020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:58.992790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.060426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:59.078832 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6eb41fea-402b-4abe-89b0-57e5a03446a2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.429551 Aug 30 17:40:59.081662 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1617/3425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:58 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:59.101926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:59.102830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:59.109881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.110627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.111232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.112153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.112774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.113364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.444185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:59.461043 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1b097514-7502-4709-9a4c-9deb282b06e2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.362535 Aug 30 17:40:59.463799 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1618/3426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:59 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:59.483024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:59.483659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:59.492428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.493830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.495654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.496626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.498530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.500182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.567782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'unpause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: {"unpause": {}} Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'unpause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'unpause': {}}} Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state active. Cannot unpause while the instance is in this state. Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:40:59.569479 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'unpause' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc30f95a-7807-4753-9141-b8cf032b2db1 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 145 microversion: 2.1 time: 0.092144 Aug 30 17:40:59.575092 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1619/3427] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:40:59 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:40:59.580979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:59.581602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:59.587441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:59.601264 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-877662f3-98b4-4436-9440-30df09372469 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.627544 Aug 30 17:40:59.603461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.604360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.604764 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1809/3428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:58 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:59.605244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.605957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.606453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.607249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.619272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "41b7d26f-8346-4351-9c9f-f18ac5466fab"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:59.649364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.649873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.650312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.676511 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] Creating event network-changed:41b7d26f-8346-4351-9c9f-f18ac5466fab for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:40:59.686936 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6dee617e-66fa-4ad5-9b64-db053b95cc42 req-a21c802f-116c-430d-a5c1-33d07d7a5673 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080374 Aug 30 17:40:59.688981 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1810/3429] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:59.701999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:59.703686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:59.710299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.711012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.711707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.712807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:59.713427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:59.714044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:59.997811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.008097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.009984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.011347 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5cef302-d98a-4b30-8454-8aa99bc75480 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.314759 Aug 30 17:41:00.012450 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1811/3430] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:40:59 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:00.018793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.029588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.033937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d7fab77-d6bc-4bf5-bb22-5095843c9934 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.457954 Aug 30 17:41:00.036959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.038874 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1620/3431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:59 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:00.046487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.047805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.048688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.050268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.054474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.054930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.056739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.057458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.072390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.074599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.079459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.080644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.081318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.082039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.097860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:00.217349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:00.263573 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a617401c-99bb-423b-a154-021a292ac10f tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.249482 Aug 30 17:41:00.264487 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1812/3432] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:00.444263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.466662 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85b2a456-3abf-4724-a5a2-082d2b148cff tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.414093 Aug 30 17:41:00.484744 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1621/3433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:00.488892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Calling method '.version_select at 0x7f2d9386b280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.498048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:00.502103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.508541 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. Aug 30 17:41:00.509696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6/action HTTP/1.1 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 18 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: {"unshelve": null} Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6', 'body': {'unshelve': None}} Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:00.510274 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e724f48c-0124-4e9e-b1f4-6fd9937e3ba2 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6/action" status: 404 len: 111 microversion: 2.1 time: 0.021710 Aug 30 17:41:00.517918 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1622/3434] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:00 2022] POST /compute/v2.1/servers/68aac3c0-ccdb-4ba2-bfe0-859a96a5c8b6/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:41:00.520145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.520145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.520698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.521460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.521749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.522192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.524642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.529262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.529907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.530418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.532315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.532786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.533221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.572826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b8bd9fd-6673-4856-b3fc-7f89dac219aa tempest-AbsoluteLimitsTestJSON-2073879048 tempest-AbsoluteLimitsTestJSON-2073879048-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.250798 Aug 30 17:41:00.573430 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1813/3435] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:41:00.643045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.643901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.656744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.658632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.659983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.662180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.664170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.666794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.844044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.854398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f60c7845-b1c9-4213-bf33-015234320af0 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.336678 Aug 30 17:41:00.855753 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1623/3436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:00.879242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:00.880068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:00.890941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.891623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.892328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.893877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:00.894893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:00.895864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:00.967106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:00.993472 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db0e1072-65a3-4a30-9f79-d1a663b4ce03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.357396 Aug 30 17:41:01.010246 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1814/3437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:01.036872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:01.037917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:01.049972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.056054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.056516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.057271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.060088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.060856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.488048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:01.498764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:01.500561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:01.502324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1cbab13-b7e5-49af-8e66-9d33a4d3cf4c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.469828 Aug 30 17:41:01.503133 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1815/3438] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:01 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:01.507890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:01.508721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:01.511037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:01.517951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.518657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.519356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.520404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.521269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.522077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.533180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:01.541617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a345a45-0adc-45ba-9545-25eb3f39d458 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.667543 Aug 30 17:41:01.542509 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1624/3439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:00 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:01.563125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:01.564176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:01.570733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.571562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.572260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.573241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.573987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.574641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.618907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Cannot 'unshelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action HTTP/1.1 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 18 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: {"unshelve": null} Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'unshelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'unshelve': None}} Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24856869-997c-4b8d-9194-7592e05f8256 in vm_state active. Cannot unshelve while the instance is in this state. Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:41:01.620753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 409 to user: Cannot 'unshelve' instance 24856869-997c-4b8d-9194-7592e05f8256 while it is in vm_state active {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43915287-ff50-4937-beea-53baf617d96f tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action" status: 409 len: 146 microversion: 2.1 time: 0.063567 Aug 30 17:41:01.626419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1625/3440] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:01 2022] POST /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256/action => generated 146 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:41:01.630701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:01.631315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:01.637645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.638136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.638563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.639664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.641788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.642455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.645227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:01.679436 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2f1c5f2-5491-4601-b39e-cc1e89280473 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.174413 Aug 30 17:41:01.683728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1816/3441] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:01 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:01.926424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:01.941230 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f51aa2f7-c90c-4052-b5f3-8b92878e1a6e tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.313848 Aug 30 17:41:01.957176 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1626/3442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:01 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:01.965859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:01.966906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:01.974219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.975058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.975707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:01.977012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:01.978010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:01.978821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.016738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:02.017899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.025212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:02.030950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.031576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.032026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.032744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.049460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.051634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.282786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:02.292747 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7df634b-7c33-48fc-9d4b-0073ea551f68 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.330908 Aug 30 17:41:02.300514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1817/3443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:01 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:02.315193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865283446_updated"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:02.318018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 48d0a3d6-57fa-40ef-8b50-6301702fcdac] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.324171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/servers/48d0a3d6-57fa-40ef-8b50-6301702fcdac HTTP/1.1 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 81 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865283446_updated"}} Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '48d0a3d6-57fa-40ef-8b50-6301702fcdac', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1865283446_updated'}}} Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 17:41:02.326347 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. Aug 30 17:41:02.331986 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:02.334399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 48d0a3d6-57fa-40ef-8b50-6301702fcdac could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:02.336115 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4467ead6-e41c-4b5c-82bb-8405cf376d3d tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "PUT /compute/v2.1/servers/48d0a3d6-57fa-40ef-8b50-6301702fcdac" status: 404 len: 111 microversion: 2.1 time: 0.025201 Aug 30 17:41:02.341105 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1818/3444] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:41:02 2022] PUT /compute/v2.1/servers/48d0a3d6-57fa-40ef-8b50-6301702fcdac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:41:02.349153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:02.350011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.360044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.361331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.362353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.364160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.364820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.365453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.408135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:02.429595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7716934-734d-4313-a04b-3d90abf7b477 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.417182 Aug 30 17:41:02.431558 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1627/3445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:02 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:02.526593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:02.527347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.536347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.536968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.537253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.537958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.538405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.538824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.573480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:02.656836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:02.666472 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c6f7156-7f11-4766-bce7-1007cf2e9eda tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.324012 Aug 30 17:41:02.667075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1819/3446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:02 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:02.692592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:02.696327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.711578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.714161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.716424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.717382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.723519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.724196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.924984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:02.936070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c01238f3-933a-4d06-88e4-4cbbf7c6bc08 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.250224 Aug 30 17:41:02.955688 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1820/3447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:02 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:02.961552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:02.962362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:02.969769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.970753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.971552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:02.972537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:02.973225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:02.973882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.071618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:03.095786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf12f24e-c033-473a-aa6e-7d82def20129 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.138429 Aug 30 17:41:03.096838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1821/3448] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:02 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:03.102498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b98a9551-a03d-48bf-9fbd-8f6e1adeef12 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b98a9551-a03d-48bf-9fbd-8f6e1adeef12 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 HTTP/1.1 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 280 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.106736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 17:41:03.112126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.116490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b98a9551-a03d-48bf-9fbd-8f6e1adeef12 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:03.117563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b98a9551-a03d-48bf-9fbd-8f6e1adeef12 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 400 len: 619 microversion: 2.1 time: 0.019466 Aug 30 17:41:03.118713 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1822/3449] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Aug 30 17:41:03 2022] PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:41:03.128031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:03.129012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:03.138312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.139181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.140705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.142413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.143123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.143871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.207049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.228928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.235543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.238123 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-539dd99b-efad-4569-b452-902550b2fdfc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.715502 Aug 30 17:41:03.241036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1628/3450] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:02 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:03.360152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.373529 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3619e9a-131f-4ef7-8528-01567fa63241 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.250445 Aug 30 17:41:03.375043 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1823/3451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:03 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:03.398387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:03.399473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:03.407179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.407882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.408501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.409544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.410158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.410741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.451228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:03.453260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:03.462656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.463336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.463823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.464518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.465350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.466009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.668144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.678780 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c572951a-f2f7-4418-9997-9c47698bc47a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.231509 Aug 30 17:41:03.694207 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1824/3452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:03 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:03.835506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:03.846190 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d056ea48-0842-484e-a1a6-7c499925d9ee tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.451714 Aug 30 17:41:03.847906 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1629/3453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:03 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:03.873021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4f3be21-3cfb-4822-a349-dcc31b80e041 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4f3be21-3cfb-4822-a349-dcc31b80e041 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: request: PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 HTTP/1.1 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 24 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": ""}} Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256', 'body': {'server': {'name': ''}}} Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi '' Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:41:03.879229 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 17:41:03.884772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:03.885757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b4f3be21-3cfb-4822-a349-dcc31b80e041 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:03.888029 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b4f3be21-3cfb-4822-a349-dcc31b80e041 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 400 len: 108 microversion: 2.1 time: 0.020028 Aug 30 17:41:03.888650 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1825/3454] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:41:03 2022] PUT /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:41:03.902938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:03.903594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:03.914801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.915311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.915755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:03.916458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:03.917047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:03.917346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.134297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:04.135092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:04.149115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.151603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.154127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.168623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.172864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.175615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.290432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:04.310809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48db8f93-2b4a-4d13-bc96-91a1c09d63b0 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.180366 Aug 30 17:41:04.312053 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1826/3455] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:04 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:04.329038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:04.331099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:04.339236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.340052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.340808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.341687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.343577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.344350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.437931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:04.447138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa14d241-b86b-475a-a6c1-d10aa59f1684 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1506 microversion: 2.1 time: 0.549940 Aug 30 17:41:04.448375 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1630/3456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:03 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:04.701272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:04.702037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:04.713616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.714126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.715289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.716041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:04.719768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:04.720234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:04.815087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:04.826661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:04.828859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:04.832166 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a211c4c-a331-4f98-a462-f98627d6fcc4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.516922 Aug 30 17:41:04.833006 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1827/3457] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:04 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:05.338774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:05.340576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:05.347920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:05.348829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:05.349752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:05.351173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:05.353121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:05.354236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:05.511837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:05.567206 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d146ae50-3d0e-4474-a9c4-9baaa6a7cd00 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.228180 Aug 30 17:41:05.568389 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1828/3458] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:05 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:05.880889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:05.890120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:05.925685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:05.926192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:05.926640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:05.933974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:05.941589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:05.942317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:05.973800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:05.987008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e170fb9-043e-4858-a517-7b004d5b5081 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 1.289396 Aug 30 17:41:05.990197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1631/3459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:04 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:06.388911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:06.404734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:06.407325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:06.415320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aafd6a16-5045-4365-8a0f-8186614b67f7 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.559140 Aug 30 17:41:06.416917 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1829/3460] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:05 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:06.594715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:06.595428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:06.617335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:06.617931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:06.618447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:06.619236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:06.619791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:06.620288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:06.761877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:06.804523 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bdee0871-8232-43eb-963e-925e7847af81 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.214338 Aug 30 17:41:06.805142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1632/3461] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:06 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:07.020436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:07.022495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:07.029734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:07.030754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:07.031638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:07.032840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:07.033761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:07.034548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:07.439873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:07.440865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:07.454617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:07.455274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:07.455856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:07.457840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:07.459989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:07.460570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:08.149761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:08.177982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:08.186668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:08.188500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7044cbab-e70a-4904-b020-cd34e4513e5f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.752949 Aug 30 17:41:08.192602 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1633/3462] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:07 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:08.209509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:08.212690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:08.236298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:08.241608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:08.242068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:08.242819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:08.250623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:08.252665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:08.907557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:08.926273 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e6bd9e6-fd57-49c2-a641-f8dab792096b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 1.908611 Aug 30 17:41:08.928529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1830/3463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:07 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:08.947678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:09.045209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f70b7d1-cf00-40db-b070-d1ad82140ab7 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.846909 Aug 30 17:41:09.049146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1634/3464] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:08 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:09.218582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:09.221127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:09.244888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:09.245527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:09.245990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:09.251874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:09.252378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:09.255782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:09.276215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:09.949561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:09.950673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:09.962988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:09.965640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:09.968467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:09.971138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:09.971690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:09.972144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:10.506729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:10.553168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:10.666319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:10.692781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:10.697940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:10.699212 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0f7bdfa-02e8-48ce-9bce-e17724429056 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 1.485313 Aug 30 17:41:10.699822 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1831/3465] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:09 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:10.709427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:10.716773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:10.729900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:10.736488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:10.739229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:10.739727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:10.740475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:10.740942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:10.741376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:10.742927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-743d707c-aea9-4fa3-8d83-305d68bb2171 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.797488 Aug 30 17:41:10.746743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1635/3466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:09 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:11.132033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:11.166714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88efbf36-d40e-47cd-b749-22d6a1e469b8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.460974 Aug 30 17:41:11.173131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1832/3467] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:10 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:11.724153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:11.729232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:11.751551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:11.752857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:11.768248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:11.768951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:11.775752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:11.778213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:11.778942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:11.781999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:11.799101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:11.809877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:11.810483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:11.812927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:11.813666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:11.821247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.447921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:12.474148 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cda3b05-202b-4e2b-90b4-2d70b091502c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.710908 Aug 30 17:41:12.479172 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1833/3468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:11 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:12.486112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:12.486942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:12.494805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.495550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.496422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.497341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.497952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.498623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.636721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:12.649524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:12.663715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:12.665270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb2b8130-f5f1-4028-a01d-752c18a40b5c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.946218 Aug 30 17:41:12.672143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:12.676101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1636/3469] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:11 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:12.699551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:12.701550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:12.709829 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fa9e55b-0f5f-4016-9e6b-490a4f2dbe3a tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1929 microversion: 2.75 time: 0.229148 Aug 30 17:41:12.723644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1834/3470] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:12 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.723899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.756302 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc HTTP/1.1 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5a3e733e-7964-40cc-9510-c771e03e23cc'} Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:12.763562 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.768609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:12.771378 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f77d7b8c-d1bc-4283-ab0e-9dbae3ed07c9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 404 len: 111 microversion: 2.1 time: 0.076327 Aug 30 17:41:12.772303 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1637/3471] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:41:12 2022] DELETE /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:41:12.780873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:12.781600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 5a3e733e-7964-40cc-9510-c771e03e23cc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:12.800055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.801117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.801900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.803221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.804045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.804461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.839668 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc HTTP/1.1 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5a3e733e-7964-40cc-9510-c771e03e23cc'} Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:12.841384 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. Aug 30 17:41:12.850443 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:12.852263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 5a3e733e-7964-40cc-9510-c771e03e23cc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:12.853410 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37f649c2-092e-4684-a2b2-51e9fc02f55b tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc" status: 404 len: 111 microversion: 2.1 time: 0.077051 Aug 30 17:41:12.854551 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1835/3472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:12 2022] GET /compute/v2.1/servers/5a3e733e-7964-40cc-9510-c771e03e23cc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:41:12.862532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:12.863605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:12.881524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.882251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.883045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.884661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:12.885352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:12.886005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:12.921661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:41:13.104811 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e5bacaf-bf70-43bb-9b55-8a38239ea7a9 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "DELETE /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 204 len: 0 microversion: 2.1 time: 0.245028 Aug 30 17:41:13.116662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:13.117496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:13.120669 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1638/3473] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:41:12 2022] DELETE /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:41:13.136955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:13.137913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:13.139155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:13.142962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:13.143845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:13.144676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:13.504894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:13.505822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:13.521239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:13.521900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:13.525655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:13.526602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:13.527198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:13.527809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:14.008976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:14.023753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:14.028672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a12a4442-1572-4440-a8d4-d95025e08d89 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.528364 Aug 30 17:41:14.034196 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-171dd9fa-72a3-4b2e-8ade-1f9e40fb0c81 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 0.922461 Aug 30 17:41:14.035192 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1639/3474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:13 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:14.048435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1836/3475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:13 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:14.064587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:14.067016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:14.067938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:14.068636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:14.082066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:14.084277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:14.084818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:14.085526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:14.086234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:14.087188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:14.087879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:14.089196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:14.090370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:14.091026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:14.092387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:14.097484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:14.301557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:14.351012 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02af2d5b-9228-49cd-988b-9698e1048658 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1935 microversion: 2.75 time: 0.300959 Aug 30 17:41:14.352361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1837/3476] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:14 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1935 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:14.399046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:14.411712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:14.428450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:14.440233 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5efb643a-b1f8-4e90-9eea-9b620ba66d8c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.403469 Aug 30 17:41:14.441770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1640/3477] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:14 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:15.059203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:15.060743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:15.062201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:15.063362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:15.072500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.076179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.077103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.080435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.081134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.081762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.089575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.091502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.106495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.115676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.116597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.118210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.601511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:15.617357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86f0e6b2-e701-463c-9dc6-b01f010d1f7d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.565169 Aug 30 17:41:15.633840 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1838/3478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:15 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:15.644945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:15.645887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:15.659897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.662780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.663553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.664530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.665156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.665745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.857013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:15.906513 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-628a3bc7-d788-4a03-9282-f6bca9ec663e tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1935 microversion: 2.75 time: 0.270955 Aug 30 17:41:15.907164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1839/3479] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:15 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1935 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:15.917610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:15.918520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:15.942198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.943068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.943739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:15.944663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:15.945809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:15.946427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:16.165584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:16.188887 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe6a20ac-3d36-4bcf-81c0-a5f66fabfb78 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1512 microversion: 2.1 time: 1.130544 Aug 30 17:41:16.194410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1641/3480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:15 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1512 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:16.459003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:16.477312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:16.480962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:16.487400 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-32c007e8-2641-424d-bc25-725a1763ce18 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.573529 Aug 30 17:41:16.505627 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1840/3481] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:15 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:16.651901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:16.652803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:16.661675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:16.662462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:16.663187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:16.671702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:16.672472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:16.673707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:16.807736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24856869-997c-4b8d-9194-7592e05f8256", "name": "network-vif-deleted", "tag": "1b1a797e-0e71-4ccd-ab8c-b776305e9643"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:16.829137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:16.843916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:16.844485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:16.880404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] Creating event network-vif-deleted:1b1a797e-0e71-4ccd-ab8c-b776305e9643 for instance 24856869-997c-4b8d-9194-7592e05f8256 on n-h2-852771-11 Aug 30 17:41:16.885755 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-424bba5e-e84a-4116-a455-59618bd2ede1 req-4e4cabc5-1005-444a-b9cb-d4c1df02ed59 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369430 Aug 30 17:41:16.886803 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1642/3482] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:16.937387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:16.946194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:16.960043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:16.963919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:16.964404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:16.965148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:16.965618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:16.966047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.231281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] Lazy-loading 'services' on Instance uuid 07b23670-2b97-4c07-b1df-f5adc4f192ef {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:17.267710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:17.289764 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04033f5a-edbb-4c89-8b87-1bae198b84d8 tempest-ServersAdmin275Test-1392862210 tempest-ServersAdmin275Test-1392862210-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1920 microversion: 2.75 time: 0.357244 Aug 30 17:41:17.290675 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1643/3483] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:16 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1920 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:17.307565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:17.308174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:17.340882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.341372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.341811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.342562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.343006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.343435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.354778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:17.370788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92908dd7-735e-45eb-b352-e21d851728b4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.733708 Aug 30 17:41:17.372425 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1841/3484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:16 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:17.380472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:17.381563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:17.393300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.393797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.394237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.394956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.395412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.395854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.440551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.441049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.441489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.441942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lazy-loading 'fault' on Instance uuid 24856869-997c-4b8d-9194-7592e05f8256 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:41:17.475066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:41:17.558893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d4aec674684b42a0267356b8bfea00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a449867d5cce467aa908bc70916ac4ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:17.571151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d38025c-fe76-4032-9288-ab48833d4859 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 200 len: 1307 microversion: 2.1 time: 0.279157 Aug 30 17:41:17.585754 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1644/3485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:17 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:17.591640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:17.592505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:17.600783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.601663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.602314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.603994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.604767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.605532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.614977 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6bfee934-db55-4817-8f35-f38a8aec637b tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 204 len: 0 microversion: 2.75 time: 0.240412 Aug 30 17:41:17.618086 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1842/3486] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:41:17 2022] DELETE /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:41:17.630532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:17.632019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:17.644014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.644926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.645756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.646678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:17.647313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:17.647932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:17.985037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.003657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.008186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.017983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.019445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.022239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.023910 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63b33b47-207e-4c45-8c5d-53761e2859f9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.436615 Aug 30 17:41:18.032065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1645/3487] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:17 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:18.049023 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2545476b-2b04-4f50-91d1-463db7322dfe tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1443 microversion: 2.75 time: 0.426410 Aug 30 17:41:18.050744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1843/3488] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:17 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1443 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:18.154007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1875016514", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:18.222520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:41:18.394562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:18.395187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:18.409987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.410871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.411569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.412540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.413536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.414036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.714628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:41:18.715155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:41:18.715549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:41:18.715966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:41:18.716379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:41:18.726719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.727521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.728774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.729679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.730479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.732067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.752628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:41:18.758464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:41:18.772863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:41:18.775193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:41:18.806807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.820441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8c9a2bc-e46c-49dd-a863-c2e600abfc8e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1512 microversion: 2.1 time: 0.429269 Aug 30 17:41:18.821541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1844/3489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:18 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:18.829344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:18.830189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] [instance: 24856869-997c-4b8d-9194-7592e05f8256] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:18.838818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.839578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.840197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.841062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:18.841675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:18.842259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:18.851313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ff6e5ce-276f-48a8-abfa-a982cf05858d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818050 Aug 30 17:41:18.853639 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1646/3490] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:41:18.865912 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] HTTP exception thrown: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. Aug 30 17:41:18.867585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe6a26be-3ecf-4b12-aa44-3f7b9e6f325e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Request method failure captured: Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 HTTP/1.1 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrCHN39wGhEJkHFzPDWJdL9bIozne3RE7BHss6xQrnk6GriWqYGucEQI2cXCFLVWG5PopGDtVBhXolmEKNp-7NaINdoqJZDm1lqry8-nZ3xKXoqWS4NCago7VaWxzGWY85Od_Frcss6fdE7jP18EPS-52stzKUo_iRuxTLOs8dM2vg Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a449867d5cce467aa908bc70916ac4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a449867d5cce467aa908bc70916ac4ad"}]}] Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a449867d5cce467aa908bc70916ac4ad Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369573155 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f4d4aec674684b42a0267356b8bfea00 Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-369573155-project Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '24856869-997c-4b8d-9194-7592e05f8256'} Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:18.867736 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] Returning 404 to user: Instance 24856869-997c-4b8d-9194-7592e05f8256 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:18.872918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13e16a59-9197-40c3-b41f-01d18658f840 tempest-ServersNegativeTestJSON-369573155 tempest-ServersNegativeTestJSON-369573155-project] 10.222.0.50 "GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256" status: 404 len: 111 microversion: 2.1 time: 0.046451 Aug 30 17:41:18.878478 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1845/3491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:18 2022] GET /compute/v2.1/servers/24856869-997c-4b8d-9194-7592e05f8256 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:41:18.878709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe6a26be-3ecf-4b12-aa44-3f7b9e6f325e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:18.968703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe6a26be-3ecf-4b12-aa44-3f7b9e6f325e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:18.976457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe6a26be-3ecf-4b12-aa44-3f7b9e6f325e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1215 microversion: 2.1 time: 0.114985 Aug 30 17:41:18.991493 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1647/3492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:18 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:19.057581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:19.058563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:19.073997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:19.074617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:19.086873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.088630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.089423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.090134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:19.090877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.091859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.092558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:19.093843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.094525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.095715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.095983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:19.101070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:19.151509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:19.248019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.286487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.288827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91ed6efd64014052b5160efa371775e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f2138f78c41b9ae11b2480aa2faae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.308233 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d530af5-86f7-412b-809e-c12b4d96f038 tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 200 len: 1443 microversion: 2.75 time: 0.237958 Aug 30 17:41:19.309173 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1648/3493] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:19 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 1443 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:19.655608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.671002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.675931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:19.677523 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e070377-a845-4cdf-9532-2f82d20f7203 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.626003 Aug 30 17:41:19.692499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1846/3494] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:19 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:19.845842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:19.846337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:19.857407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.858532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.859809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:19.860801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:19.861645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:19.862335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.000311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:20.001688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:20.015260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.016212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.017828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.020360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.022720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.025534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.219325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:20.227495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b0cc4d2-dfa7-46e3-9ec8-850fc3f3fc6a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1211 microversion: 2.1 time: 0.232707 Aug 30 17:41:20.231843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1847/3495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:19 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:20.251264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:20.260941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c6df9e8-c0a8-4340-b80f-7267e49dbe30 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1489 microversion: 2.1 time: 0.421792 Aug 30 17:41:20.268699 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1649/3496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:19 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1489 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:20.290334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:20.293637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:20.315631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.316724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.317461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.318571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.319045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.319512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.335362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:20.336045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] [instance: 07b23670-2b97-4c07-b1df-f5adc4f192ef] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:20.347205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.347878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.351178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.352779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.353636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.354240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.388614 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] HTTP exception thrown: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Request method failure captured: Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef HTTP/1.1 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDktqMik4x0OhkSKI9aPwfBzqCXoHbmy-zTlphFnxfMxJc9GYz68FCLdO4m8y1TEd1q4knEhIz4L1wVSajbOWrgmnvrpyCmbg_lzL8to0Nd7GQmVtcoD_-cwQFiE8SUAm4H4CGmTmMHGdFI7Bwuvxeql8aXPUT9cakNaY3OKELptIKyE Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.75 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8d8f2138f78c41b9ae11b2480aa2faae Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdmin275Test-1655211606 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8d8f2138f78c41b9ae11b2480aa2faae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8d8f2138f78c41b9ae11b2480aa2faae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8d8f2138f78c41b9ae11b2480aa2faae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8d8f2138f78c41b9ae11b2480aa2faae"}]}] Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdmin275Test-1655211606 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8d8f2138f78c41b9ae11b2480aa2faae Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdmin275Test-1655211606 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdmin275Test-1655211606-project Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91ed6efd64014052b5160efa371775e8 Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdmin275Test-1655211606-project Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '07b23670-2b97-4c07-b1df-f5adc4f192ef'} Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:20.392205 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. Aug 30 17:41:20.399040 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:20.402906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] Returning 404 to user: Instance 07b23670-2b97-4c07-b1df-f5adc4f192ef could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:20.405256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64157fd3-2bb5-489e-ac7f-2b40f23f194e tempest-ServersAdmin275Test-1655211606 tempest-ServersAdmin275Test-1655211606-project] 10.222.0.50 "GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef" status: 404 len: 111 microversion: 2.75 time: 0.072743 Aug 30 17:41:20.406785 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1650/3497] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:20 2022] GET /compute/v2.1/servers/07b23670-2b97-4c07-b1df-f5adc4f192ef => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:41:20.433871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f2a956c-4590-463e-9011-142ba7fbfa0f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 200 len: 177 microversion: 2.1 time: 0.148169 Aug 30 17:41:20.434533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1848/3498] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:20 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 177 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:20.445241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:20.446533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:20.454921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.455362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.463891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.464994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.465648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.466257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.703602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:20.704326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:20.734350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.735086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.741454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:20.742572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:20.743231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:20.752219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.189221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.207134 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0c24f34-dc71-4249-a825-cf20cc26570b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.765721 Aug 30 17:41:21.208589 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1651/3499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:20 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:21.246306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:21.247184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:21.253953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.254728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.255312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.256463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.257087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.257663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.689691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.708855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.710625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.712144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-838e6485-5cf6-46a3-ab4c-15e784fdbfba tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 1.013624 Aug 30 17:41:21.728129 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1849/3500] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:20 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:21.735187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:21.735849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:21.742538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.743375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.744104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.745048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.745737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.746395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.771400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.789504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3ac0f60e-acb0-4066-80b1-94ad109bfa76 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.547414 Aug 30 17:41:21.790866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1652/3501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:21 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:21.812693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:21.813734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:21.820898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.821588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.822372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.823459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:21.824203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:21.824626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:21.920764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:21.928974 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc5e1205-6ef5-4f4f-a601-664427fe514d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1273 microversion: 2.1 time: 0.199610 Aug 30 17:41:21.930288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1850/3502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:21 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:22.205455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:22.224349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f54310bf-9be8-45be-900e-c0ff5bd7285f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.416631 Aug 30 17:41:22.224941 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1653/3503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:21 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:22.250059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:22.250715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:22.261300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:22.263335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:22.275998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:22.277129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:22.277783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:22.278383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:22.740177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:22.741112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:22.748380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:22.750815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:22.751434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:22.752505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:22.753064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:22.753549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:23.080635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:23.133101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:23.135620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:23.137169 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b90dacea-c934-46b7-b44f-32a8d8aad333 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.403295 Aug 30 17:41:23.152766 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1654/3504] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:22 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:23.162932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:23.164025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:23.174926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:23.175920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:23.176814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:23.178031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:23.178714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:23.179377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:23.251244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:23.263774 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35ab442f-7c26-4338-b252-19bf537eba99 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 1.018373 Aug 30 17:41:23.267869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1851/3505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:22 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:23.435261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-653872669", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "59938744-e1cd-4152-9402-9a2134605439"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:23.507881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:23.518437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8d019ec-1312-435c-af66-7d6ca4ec0853 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.364124 Aug 30 17:41:23.527001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1655/3506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:23 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:23.580004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] validate_networks() for [('59938744-e1cd-4152-9402-9a2134605439', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:41:24.168012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:24.168620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:24.177088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.177657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.178092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.179085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.179893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.180536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.728705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:24.740575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:24.742002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:24.743201 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-215894ee-4262-408b-a98b-1c116aeb4add tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.580881 Aug 30 17:41:24.743809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1656/3507] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:24 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:24.764452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:24.765422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:24.766416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:41:24.766903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:41:24.767318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:41:24.767793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:41:24.769866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:41:24.778188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.785542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.786172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.787112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.787787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.788378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.804183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.805279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.806188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.807251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.807975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.808406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.840428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:41:24.849364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:41:24.854510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:24.871704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:41:24.875089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:41:24.947052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-896540a6-6fa2-4506-bf61-4e3729896563 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516857 Aug 30 17:41:24.948715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1852/3508] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:41:24.954975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb", "tag": "166bbabe-6aba-457e-a5cf-dfa92e41cd2c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:24.969493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:24.970060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:24.970799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:24.991204 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] Creating event network-changed:166bbabe-6aba-457e-a5cf-dfa92e41cd2c for instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb on n-h2-852771-11 Aug 30 17:41:24.998710 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-68809ef7-1cb1-4bc9-8daa-0d1fde46b203 req-d7126d12-cd01-4da0-bd53-958ded990500 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048389 Aug 30 17:41:25.000686 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1853/3509] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:25.027214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b98dc04b-1a49-499c-9bf7-ac39c972aeda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:25.034010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b98dc04b-1a49-499c-9bf7-ac39c972aeda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:25.193479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b98dc04b-1a49-499c-9bf7-ac39c972aeda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:25.208470 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b98dc04b-1a49-499c-9bf7-ac39c972aeda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1214 microversion: 2.1 time: 0.204234 Aug 30 17:41:25.211845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1854/3510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:25 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:25.223628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:25.234136 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5b259146-48d6-4844-a651-5975c81906e7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.479317 Aug 30 17:41:25.245190 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1657/3511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:24 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:25.778751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:25.781441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:25.794185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:25.795275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:25.796973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:25.798282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:25.799859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:25.804738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:26.234990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:26.236941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:26.269491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:26.270446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:26.271061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:26.272017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:26.272931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:26.273548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:26.384225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:26.398187 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6891851-6287-49b5-bb99-be9f842de2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1266 microversion: 2.1 time: 0.170105 Aug 30 17:41:26.399398 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1658/3512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:26 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:26.407472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:26.408776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:26.418765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:26.419691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:26.421076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:26.422050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:26.422968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:26.423698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:26.430347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:26.451820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:26.453295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:26.454506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02e1e1e3-2a45-46de-9046-71be7a394bbc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.685110 Aug 30 17:41:26.455358 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1855/3513] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:25 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:27.085009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:27.089783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b536f8a7-9b3e-48dc-a579-71d04d0c36b6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.688805 Aug 30 17:41:27.090366 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1659/3514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:26 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:27.384067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-8386006", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:27.429730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:27.431508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:27.457511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:27.461683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:27.463838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:27.464618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:27.465860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:27.475904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:27.500169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:41:27.632792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:27.641977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c1c9362-4f60-4a5e-b249-d357e48df13a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1272 microversion: 2.1 time: 0.222920 Aug 30 17:41:27.642815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1660/3515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:27 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:27.648083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:27.648862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:27.654217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:27.656787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:27.657703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:27.658294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:27.659180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:27.659827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:27.660577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:28.065851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:41:28.066273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:41:28.067019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:41:28.067967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:41:28.068636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:41:28.083769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:28.089623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:28.090418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:28.091509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:28.092757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:28.093446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:28.136763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Getting quotas for project 9296888eb37e46e3b37337339125816a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:41:28.144253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Getting quotas for user 8ef6081d349e4fd6949f035095ac8d87 and project 9296888eb37e46e3b37337339125816a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:41:28.160525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:41:28.163217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:41:28.286677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e6a3c335-bb6e-4565-a462-acc7b164546f tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086915 Aug 30 17:41:28.293947 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1856/3516] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:41:28.300867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:28.302390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:28.313953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:28.315183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:28.315850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:28.317622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:28.318267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:28.319100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:28.741225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:28.976904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:29.194498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.210558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.213015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.215781 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11b1f513-f252-4f7c-b01a-0ca4c0fc5cb0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 1.571800 Aug 30 17:41:29.218154 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1661/3517] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:27 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:29.224591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:29.225430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:29.233585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:29.234749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:29.235703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:29.236731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:29.237877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:29.240610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:29.273418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:29.401373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.413669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd9af60d-ea8a-4217-b5c0-24a6493ec076 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 1.118454 Aug 30 17:41:29.414530 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1857/3518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:28 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:29.420339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:29.421322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:29.429586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:29.430318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:29.430816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:29.431597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:29.432062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:29.432491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:29.457912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.471056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf86c005-8e9b-4ae4-b5d9-395c11a31fdf tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1207 microversion: 2.1 time: 0.251598 Aug 30 17:41:29.487681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1662/3519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:29 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1207 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:29.625241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:29.645086 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d970f649-f399-4c47-bef0-b26fcec3296c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1272 microversion: 2.1 time: 0.228176 Aug 30 17:41:29.678791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1858/3520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:29 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:30.245230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:30.245982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:30.256242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.256814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.257324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.269081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.269965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.270505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.435675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:30.439056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:30.457348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.458076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.458727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.459891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.460587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.461393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.729354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:30.763628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:30.765774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:30.767086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5944730-6b54-41fe-8517-40c1a44979de tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.527609 Aug 30 17:41:30.772080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1663/3521] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:30 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:30.780926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:30.790885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:30.802862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.803794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.804425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.805385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.806173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.806462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.910870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:30.925514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9450982-ed16-4688-a764-375df6b823c7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1269 microversion: 2.1 time: 0.152083 Aug 30 17:41:30.939947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:30.943891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1664/3522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:30 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:30.948276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b760f721-df95-461b-ba33-eaafee7be6a2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.517807 Aug 30 17:41:30.948552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:30.949172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:30.960292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1859/3523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:30 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:30.961495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.962289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.964149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:30.967089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:30.968745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:30.969543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:31.321051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:31.329486 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ff246ec-821b-4c00-9f60-f5abf458b47b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.384606 Aug 30 17:41:31.330078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1665/3524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:30 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:31.673373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36adba95-8c84-42d8-a8a2-20a91aa97a7b", "tag": "51762020-2c1c-411b-90be-07851a7dba6b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:31.708830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:31.710946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:31.718530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:31.744743 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] Creating event network-changed:51762020-2c1c-411b-90be-07851a7dba6b for instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b on n-h1-852771-11 Aug 30 17:41:31.757084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2a59271c-c25d-408c-a7c6-5fbdef7b9596 req-8117065a-a460-4f3e-b71f-b67d0c29d29c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090364 Aug 30 17:41:31.759702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1860/3525] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:31.796234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:31.797081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:31.805624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:31.806240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:31.806804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:31.808409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:31.808887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:31.809657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:31.952036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:31.953097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:31.963542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:31.965370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:31.969125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:31.969941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:31.970528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:31.971038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:32.507505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:32.518706 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eab8e3f2-28df-441c-b836-c26ef6a82750 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.571111 Aug 30 17:41:32.519312 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1861/3526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:31 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:32.542481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:32.543132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:32.550349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:32.550979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:32.552611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:32.553801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:32.554275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:32.554822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:32.621803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:32.637083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:32.639472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:32.641670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e624a0e3-cb8f-4ab4-91bc-32443bff8f3b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.851146 Aug 30 17:41:32.642559 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1666/3527] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:31 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:32.649531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:32.650456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:32.660836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:32.661601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:32.663337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:32.665342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:32.665822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:32.666255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:32.862142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:32.883085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-40f9b286-a1c1-4ee3-9968-615ebd9bb005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.359936 Aug 30 17:41:32.884582 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1862/3528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:32 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:33.242531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:33.268115 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d44dae43-9893-4188-baa1-0176192252f4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.622734 Aug 30 17:41:33.270213 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1667/3529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:32 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:33.282067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb", "name": "network-vif-plugged", "status": "completed", "tag": "166bbabe-6aba-457e-a5cf-dfa92e41cd2c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:33.300316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:33.301400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:33.302065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:33.316541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] Creating event network-vif-plugged:166bbabe-6aba-457e-a5cf-dfa92e41cd2c for instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb on n-h2-852771-11 Aug 30 17:41:33.322328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e7dbc1b6-67aa-465b-b881-b43bf0575acf req-1ab5683f-a7d0-434e-b029-8b0d2bd55192 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372002 Aug 30 17:41:33.323694 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1863/3530] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:33.540948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:33.541963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:33.549816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:33.550680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:33.551509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:33.552589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:33.553282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:33.553937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:33.669211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:33.670510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:33.683710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:33.684504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:33.685137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:33.686924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:33.692407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:33.693057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:34.114044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.127566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.141531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.143207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c4814942-8429-404e-9161-4ae30e2eb207 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.478492 Aug 30 17:41:34.144065 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1864/3531] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:33 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:34.149271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:34.157603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:34.164469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:34.176323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:34.177181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:34.178210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:34.178917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:34.179633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:34.364888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.376188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83748702-2329-451e-a1cf-e907b1b5f9d7 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.839224 Aug 30 17:41:34.389689 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1668/3532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:33 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:34.394959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:34.395851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:34.402123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:34.402844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:34.403454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:34.404447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:34.405911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:34.406547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:34.610930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.624152 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e928a05a-cc8d-4447-baf7-5d5c511e734d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1315 microversion: 2.1 time: 0.474334 Aug 30 17:41:34.625043 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1865/3533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:34 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:34.838741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:34.856223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7128dbf-5fc6-4e48-b817-73d7a2d5e14d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.465022 Aug 30 17:41:34.857033 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1669/3534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:34 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:35.004637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5970a615-dfa1-401a-9aa8-4968342a8b07", "tag": "ab6d3797-99da-4061-bade-f4763cdb11f6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:35.062724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.063725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.065590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.122718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] Creating event network-changed:ab6d3797-99da-4061-bade-f4763cdb11f6 for instance 5970a615-dfa1-401a-9aa8-4968342a8b07 on n-h1-852771-11 Aug 30 17:41:35.130491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d3df6d51-c6ce-4493-8b66-e597a1a1d8d6 req-642e818c-5088-44e8-a54b-3a637ee08af9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134387 Aug 30 17:41:35.131547 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1866/3535] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:35.182049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:35.183736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:35.195504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.196489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.197410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.200831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.202915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.206261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.397545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "a8022e89-bb3f-4f42-9508-4d473fb05117"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "a41be049-3f81-4729-a403-3c5995e16c6f"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "498accfa-05e4-4c53-8a2c-2796cff2f079"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "213461bb-32e1-4964-83aa-30286c3e0786"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:35.411632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.412615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.413292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.436482 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Creating event network-vif-plugged:a8022e89-bb3f-4f42-9508-4d473fb05117 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:35.437364 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Creating event network-vif-plugged:a41be049-3f81-4729-a403-3c5995e16c6f for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:35.439170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Creating event network-vif-plugged:498accfa-05e4-4c53-8a2c-2796cff2f079 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:35.440733 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] Creating event network-vif-plugged:213461bb-32e1-4964-83aa-30286c3e0786 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:35.448585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e53ac572-034b-4455-b485-8ec19650334f req-78d3def9-3e1f-4c01-8231-8f7ec319e6d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.056246 Aug 30 17:41:35.451042 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1867/3536] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:41:35.459919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:35.465739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:35.491857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.492634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.493648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.495303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.496151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.497221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.703184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:35.719730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:35.724606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:35.732140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fd537cf4-75d9-4798-9287-d8d76dee32ee tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.561770 Aug 30 17:41:35.734232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1670/3537] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:35 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:35.743016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:35.744417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:35.754796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.755468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.756021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:35.756819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:35.757370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:35.757916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.025095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:36.034559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:36.038245 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4d5bfe9c-9130-4761-833e-72eda3400dfd tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.585278 Aug 30 17:41:36.052738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1868/3538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:35 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:36.063184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:36.064008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:36.073053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.074187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.074901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.077194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.078061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.078817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.081466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:36.090432 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea334949-76dc-48ae-88ae-2de859ffd6dd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1501 microversion: 2.1 time: 0.354731 Aug 30 17:41:36.110657 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1671/3539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:35 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1501 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:36.122021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:36.122519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:36.134560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.135795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.136499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.137884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.139595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.140291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.174037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:41:36.272911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd6068ae-2ba2-4a61-9182-858270805781 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 204 len: 0 microversion: 2.1 time: 0.156960 Aug 30 17:41:36.276697 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1672/3540] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:41:36 2022] DELETE /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:41:36.289915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:36.292486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:36.300222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.300913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.301409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.302712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.303238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.303773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.461145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:36.471468 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc82eb13-9b3b-44e1-b4a5-8249ea1a227d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1507 microversion: 2.1 time: 0.188591 Aug 30 17:41:36.472463 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1673/3541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:36 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:36.759501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:36.760657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:36.767762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.768366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.768902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:36.769702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:36.770255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:36.770801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.013308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:37.048829 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9975112-a77a-42e7-81c6-be3b9198e6f5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.994859 Aug 30 17:41:37.050207 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1869/3542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:36 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:37.079800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:37.082954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:37.117665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:37.118369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:37.118988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.120403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:37.121034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:37.121781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.273185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:37.287289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:37.290462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:37.291991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d5685d6-a1cd-4621-b6b1-11cc65ad0813 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.536406 Aug 30 17:41:37.315301 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1674/3543] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:36 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:37.490841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "41b7d26f-8346-4351-9c9f-f18ac5466fab"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "0d3c28d9-98b6-4954-9c09-7d4c35a4cb98"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:37.515540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:37.517294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:37.518407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.544251 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Creating event network-vif-plugged:41b7d26f-8346-4351-9c9f-f18ac5466fab for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:37.545708 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] Creating event network-vif-plugged:0d3c28d9-98b6-4954-9c09-7d4c35a4cb98 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:37.552377 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-389abf12-8cbd-467f-bc92-52ea0d878d31 req-88a8f1d8-9049-440c-9dc9-dabc3e45882f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069706 Aug 30 17:41:37.553263 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1675/3544] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:37.559779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:37.561639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:37.601220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:37.601722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:37.602164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.607150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:37.608329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:37.608771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:37.860716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:37.895372 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cc87829-7351-4d96-ac1b-598e5c02895c tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.826051 Aug 30 17:41:37.913465 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1870/3545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:37 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:38.078902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:38.080393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:38.084292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:38.098710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.100995 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40c2a89f-c6bc-4406-b23d-4f7591521628 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1507 microversion: 2.1 time: 0.546689 Aug 30 17:41:38.101582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.102047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:38.102797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.103261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.103720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:38.108402 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1676/3546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:37 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:38.141955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:38.189965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:38.324683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:38.325304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:38.333735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.336846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.337542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:38.338467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.339123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.339755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:38.667708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:38.715764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1649b54-4f23-4caf-9afc-f97ce7a74c28 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.646688 Aug 30 17:41:38.730227 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1871/3547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:38 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:38.924628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:38.925170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:38.943179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.944142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.944788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:38.945826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:38.950033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:38.950963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.418890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:39.434406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aae5fc3c-22ef-41eb-a814-5d441394bb65 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.515669 Aug 30 17:41:39.435708 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1872/3548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:38 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:39.452001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:39.452956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:39.460856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.461554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.462171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.463237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.463890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.464713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.579871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:39.588297 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-243a2a4d-5782-4383-a7c6-c2178101750e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 200 len: 1465 microversion: 2.1 time: 0.151308 Aug 30 17:41:39.596823 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1873/3549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:39 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:39.615927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-plugged", "status": "completed", "tag": "ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:39.634194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.634945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.635594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.663814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] Creating event network-vif-plugged:ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:39.673738 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0b0b906d-4206-460c-9ff8-29332afd9a9d req-2bc6111c-8bc9-44a1-a3cb-6c40888fdc2f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061755 Aug 30 17:41:39.678595 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1874/3550] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:41:39.742601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:39.743348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:39.770920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.774332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.774332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.778184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:39.780150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.780956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.782748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.808674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:39.814896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:39.817281 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f56362e-3770-4d40-87d6-73ec59d47e9f tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 1.496367 Aug 30 17:41:39.818847 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1677/3551] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:38 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:39.842712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb", "name": "network-vif-deleted", "tag": "166bbabe-6aba-457e-a5cf-dfa92e41cd2c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:39.874665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:39.875422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:39.877286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:39.891331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:39.915741 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] Creating event network-vif-deleted:166bbabe-6aba-457e-a5cf-dfa92e41cd2c for instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb on n-h2-852771-11 Aug 30 17:41:39.926092 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0b1b09b8-b9a4-49cb-bd88-4189a28f5569 req-94e626d7-0f95-4bd0-8d61-93afa41f4905 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101371 Aug 30 17:41:39.927596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1678/3552] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:40.458396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:40.459105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:40.476748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.477245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.480230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.481006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.481471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.486618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.661535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:40.676251 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b0e031e-f1f6-4d00-bf69-5a6643f97f01 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.933303 Aug 30 17:41:40.677072 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1875/3553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:39 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:40.695399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:40.696211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:40.713633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.714238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.724197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.726192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.726774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.727311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.752723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb HTTP/1.1 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb'} Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:40.754696 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:41:40.759331 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:41:40.761370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:40.762452 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b667a4a-4b0e-487d-837e-69be1f885e56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 404 len: 111 microversion: 2.1 time: 0.084254 Aug 30 17:41:40.801641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1876/3554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:40 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:41:40.837385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:40.846777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:40.850275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:40.862612 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d1300bf-5fb7-4b06-8dd5-837054e66be9 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.411512 Aug 30 17:41:40.863247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.864980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.865908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.866713 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1679/3555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:40 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:40.872985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:40.873670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:40.874455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:40.923711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1721528741", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:41.027014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:41:41.317657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:41.339796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:41.341543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:41.352924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df01ea7a-4167-4233-9fa6-ec10ffa004ce tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1880 microversion: 2.42 time: 0.511083 Aug 30 17:41:41.353764 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1877/3556] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:40 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1880 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:41:41.697952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:41.699540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:41.719904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:41.720679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:41.721308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:41.722205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:41.723042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:41.723753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:41.973401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:41:41.973961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:41:41.974270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:41:41.974685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:41:41.975086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:41:41.994802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:41.995650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:41.996378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:41.997366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:41.998560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.000168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:42.052295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:41:42.066819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:41:42.081374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:41:42.084120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:41:42.162137 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64eb161e-12d7-4766-b26e-947987c47502 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242855 Aug 30 17:41:42.169568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:42.171405 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1680/3557] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:41:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:41:42.176455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:42.177063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:42.180517 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c2122af-edc6-4e35-8c0b-b1ab55350e6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.486464 Aug 30 17:41:42.186785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:42.187231 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1878/3558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:41 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:42.188760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.189588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:42.190928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:42.191989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.192664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:42.205362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5970a615-dfa1-401a-9aa8-4968342a8b07", "name": "network-vif-plugged", "status": "completed", "tag": "ab6d3797-99da-4061-bade-f4763cdb11f6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:42.237369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:42.239160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.243501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:42.282915 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] Creating event network-vif-plugged:ab6d3797-99da-4061-bade-f4763cdb11f6 for instance 5970a615-dfa1-401a-9aa8-4968342a8b07 on n-h1-852771-11 Aug 30 17:41:42.299144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bfffff2f-b5ed-41ac-b05f-3498b4c6d985 req-6751da47-2370-47a0-a49c-89d69e8ec0e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106659 Aug 30 17:41:42.299821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1879/3559] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:42.316759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4bd6aaeb-3fcc-448e-846f-3f58bbdfa4bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:42.318999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4bd6aaeb-3fcc-448e-846f-3f58bbdfa4bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:42.545237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4bd6aaeb-3fcc-448e-846f-3f58bbdfa4bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:42.566185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4bd6aaeb-3fcc-448e-846f-3f58bbdfa4bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1215 microversion: 2.1 time: 0.263473 Aug 30 17:41:42.573772 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1880/3560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:42 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:42.579718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:42.581557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:42.582327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:42.596555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:42.596916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79b8b907-dd08-4730-b843-b1c4c08b65fb tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.419652 Aug 30 17:41:42.598294 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1681/3561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:42 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:42.604580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.605038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:42.606317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:42.606542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:42.607159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.214439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:43.215760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:43.223991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.224805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.225453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.226486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.227144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.227817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.398965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:43.429397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:43.432792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:43.434794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bfd89d3f-cc80-43c5-8aa4-40f317355acf tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2837 microversion: 2.42 time: 0.859928 Aug 30 17:41:43.436993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1881/3562] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:41:42 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2837 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:43.474997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:43.479332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:43.486799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.487887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.489008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.489917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.490581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.491200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.672258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:43.681345 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c50ff881-e165-4fa7-a4b1-d786a9911a9e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.471561 Aug 30 17:41:43.695301 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1682/3563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:43 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:43.700775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:43.701971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:43.712972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.713787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.714453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.715369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.716055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.717811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.790492 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-590b0cdf-efaf-4936-99f4-38bb46045c43 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.328605 Aug 30 17:41:43.803681 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1882/3564] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:41:43 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884/os-interface => generated 1830 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:41:43.809775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:43.811239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:43.829872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.835395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.836244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.837129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:43.837896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:43.838349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:43.995750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:44.011978 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62b72fc5-c7b0-4adf-8b2c-5271cb9bda23 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1267 microversion: 2.1 time: 0.313613 Aug 30 17:41:44.012755 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1683/3565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:43 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:44.448525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:44.470995 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb2cef67-98c5-4671-bbe9-ccd827438c98 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1311 microversion: 2.1 time: 0.663922 Aug 30 17:41:44.489641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1883/3566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:43 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1311 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:44.491880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adba95-8c84-42d8-a8a2-20a91aa97a7b", "name": "network-vif-plugged", "status": "completed", "tag": "51762020-2c1c-411b-90be-07851a7dba6b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:44.515179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:44.515712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:44.516145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:44.532970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] Creating event network-vif-plugged:51762020-2c1c-411b-90be-07851a7dba6b for instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b on n-h1-852771-11 Aug 30 17:41:44.547151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4ddfb276-d3c4-424c-8e59-329d136dab3e req-e497f20f-9817-4163-8e3f-682220c487e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064661 Aug 30 17:41:44.548091 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1684/3567] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:41:44.704163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:44.705362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:44.714745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:44.715689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:44.718760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:44.719768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:44.720514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:44.721111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:45.041697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:45.042655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:45.063221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:45.064056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:45.064658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:45.065614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:45.066231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:45.066816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:45.189449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:45.208936 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a873feb4-2837-4604-9cd4-85564fc71451 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.510443 Aug 30 17:41:45.209545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1884/3568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:44 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:45.296469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:45.304500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1933dbe4-0755-4e4b-92db-f2c3be76b66b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1273 microversion: 2.1 time: 0.269797 Aug 30 17:41:45.305078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1685/3569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:45 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:45.494760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:45.495406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:45.505387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:45.505387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:45.505387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:45.505387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:45.505387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:45.505853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:45.951353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:45.962883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-77740fba-3194-4069-83d6-225137b8697d tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1461 microversion: 2.1 time: 0.472163 Aug 30 17:41:45.964021 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1885/3570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:45 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1461 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:46.114475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Calling method '.version_select at 0x7f2d93804280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.127459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.127972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.128407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.145659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.146136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.146766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.166972 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4341b7a7-933d-4422-b624-58760c365dbc tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/9296888eb37e46e3b37337339125816a?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363" status: 200 len: 643 microversion: 2.1 time: 0.185100 Aug 30 17:41:46.178003 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1686/3571] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 30 17:41:45 2022] GET /compute/v2.1/os-simple-tenant-usage/9296888eb37e46e3b37337339125816a?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363 => generated 643 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:46.184075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '.version_select at 0x7f2d9386b700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.195076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.196126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.196865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.223104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.230819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.231958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:46.235689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.239326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.245720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.246492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.247172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.252056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.267883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.271582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.318077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed118d6a-9ab2-447a-acff-f10a8574b0ec tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/9296888eb37e46e3b37337339125816a?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363" status: 200 len: 692 microversion: 2.1 time: 0.137669 Aug 30 17:41:46.318942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1886/3572] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 30 17:41:46 2022] GET /compute/v2.1/os-simple-tenant-usage/9296888eb37e46e3b37337339125816a?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363 => generated 692 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:46.341483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.343287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:46.364387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.366543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.369087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.370738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.375600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.376403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.520527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:46.537198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16c802aa-6d6d-43b9-9c4a-a1eb71e66005 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1273 microversion: 2.1 time: 0.206871 Aug 30 17:41:46.538363 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1887/3573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:46 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:46.543119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Calling method '.version_select at 0x7f2d9398daf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.553276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.554173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.554774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.575325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.583034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.583625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.725727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:46.736917 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e5adf6b8-4aa4-4cf6-b51a-3d02159461b6 tempest-TenantUsagesTestJSON-1234373529 tempest-TenantUsagesTestJSON-1234373529-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363&detailed=1" status: 200 len: 41972 microversion: 2.1 time: 0.197108 Aug 30 17:41:46.738529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1888/3574] 10.222.0.50 () {58 vars in 1335 bytes} [Tue Aug 30 17:41:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T17%3A41%3A45.977363&end=2022-08-31T17%3A41%3A45.977363&detailed=1 => generated 41972 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:41:46.741892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de615053-178a-4fdb-a435-a72a4edb46e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1314 microversion: 2.1 time: 0.515094 Aug 30 17:41:46.743089 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1687/3575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:46 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:46.803024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.804673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:46.813487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.813821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.814542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.815458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:46.816118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:46.816722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:46.849111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:41:46.896868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:46.948085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:46.989784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad170dcc-b796-4f52-b669-c2d71ed95b55 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 204 len: 0 microversion: 2.1 time: 0.189811 Aug 30 17:41:46.991529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1889/3576] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:41:46 2022] DELETE /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:41:46.998914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:46.999705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:47.008947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:47.009440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:47.009901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:47.010632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:47.011043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:47.011461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:47.558651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:47.559378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:47.574862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:47.575347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:47.575936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:47.577447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:47.577909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:47.578337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:48.437411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:48.439790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:48.456151 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5232feea-b9c8-452d-90ee-7eb330f1506e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.901980 Aug 30 17:41:48.456750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1890/3577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:47 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:48.460767 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-250f0dab-574c-4a78-bf77-93b3ddcff31a tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1467 microversion: 2.1 time: 1.464233 Aug 30 17:41:48.461436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:48.462046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:48.465563 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1688/3578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:46 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1467 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:48.472352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:48.472842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:48.473278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:48.473977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:48.474466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:48.474942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:48.866319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:48.876144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc508b74-dd8a-4c44-a622-9b21222472ea tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1501 microversion: 2.1 time: 0.418154 Aug 30 17:41:48.876988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1891/3579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:48 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:48.904773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:48.907219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:48.914947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:48.915802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:48.916397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:48.917363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:48.918131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:48.918824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:48.992243 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5430461-2dc7-4ebb-aae8-19054111cf14 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.088971 Aug 30 17:41:48.993930 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1689/3580] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:48 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:49.481636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:49.483266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:49.492601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:49.493290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:49.508393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:49.513457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:49.514128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:49.514686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:49.515736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:49.518909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:49.519627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:49.522537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:49.523175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:49.523314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:49.525364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:49.526052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:49.893374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:49.911337 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c9ba682-be28-4d8f-99ac-07d2d48e4116 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.433562 Aug 30 17:41:49.924227 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1892/3581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:49 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:50.004954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:50.007291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:50.021547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:50.023573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:50.025024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:50.027187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:50.029568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:50.031108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:50.125279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc3db201-0d44-438b-82ef-941c252cc426 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.124213 Aug 30 17:41:50.134869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1893/3582] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:49 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:50.160195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "tag": "a41be049-3f81-4729-a403-3c5995e16c6f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:50.191159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:50.191931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:50.193782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:50.209932 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] Creating event network-changed:a41be049-3f81-4729-a403-3c5995e16c6f for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:41:50.217408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a491bab9-de03-4470-9077-fe57b8d783e8 req-00474f71-da58-4aa7-ba32-3373bbe5f5fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077967 Aug 30 17:41:50.219299 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1894/3583] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:50.426864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:50.438064 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-565615cd-580a-4baf-878f-7ea1ed2768af tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1467 microversion: 2.1 time: 0.949745 Aug 30 17:41:50.442828 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1690/3584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:49 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1467 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:41:50.939727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:50.940652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:50.958120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:50.958633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:50.959277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:50.960926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:50.962071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:50.962676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:51.156344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:51.159226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:51.196125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:51.196739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:51.197189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:51.204984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:51.205478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:51.213890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:51.320929 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f76bf8a-de9c-41f0-92e5-ec101c444662 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.184277 Aug 30 17:41:51.321896 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1691/3585] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:51 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:51.473337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:51.473975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:51.487336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:51.490016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:51.490467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:51.491188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:51.494607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:51.495209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:51.763924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef6081d349e4fd6949f035095ac8d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9296888eb37e46e3b37337339125816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:51.781848 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72e8cfed-aedc-4719-8c28-d1c456c60916 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 200 len: 1425 microversion: 2.1 time: 0.310574 Aug 30 17:41:51.783600 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1692/3586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:51 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 1425 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:51.939160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:51.948241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aec3ee93-10e2-431a-a6f5-d7ca0969e8c6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 1.014282 Aug 30 17:41:51.949195 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1895/3587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:50 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:52.332476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:52.334772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:52.348604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:52.350492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:52.356484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:52.357275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:52.358553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:52.359239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:52.359939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:52.370908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5970a615-dfa1-401a-9aa8-4968342a8b07", "name": "network-vif-deleted", "tag": "ab6d3797-99da-4061-bade-f4763cdb11f6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:52.413404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:52.413941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:52.415534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:52.445140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a387b98b-e883-40e0-b7b4-f9e4245af971 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.116385 Aug 30 17:41:52.446220 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1693/3588] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:52 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:52.454190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] Creating event network-vif-deleted:ab6d3797-99da-4061-bade-f4763cdb11f6 for instance 5970a615-dfa1-401a-9aa8-4968342a8b07 on n-h1-852771-11 Aug 30 17:41:52.459834 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-226d3cc8-7309-46be-bff7-0aee0dd91b5c req-c9b89b8a-ea4a-4fc1-9853-f1f7dfe662c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101408 Aug 30 17:41:52.461067 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1896/3589] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:52.804944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:52.806008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] [instance: 5970a615-dfa1-401a-9aa8-4968342a8b07] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:52.821456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:52.822174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:52.822840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:52.823807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:52.828142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:52.828915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:52.863251 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] HTTP exception thrown: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Request method failure captured: Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 HTTP/1.1 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkvFt6QFR6pl9srg3tRHb-XUwpitnLQUSzZ2DQVkF-gmFHdaggQUD73OcL79Uhq8n_4DRdJO43QAobbJMEd0YkjjDFA7O-5HGkCwBmTkT_kV5DVmgYBA9_naI_tpvgdocVCWjvwXeRwjUZE92a_RcDr9UMBk60GGxEUSxzJ6lwFRgyI Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9296888eb37e46e3b37337339125816a Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TenantUsagesTestJSON-787629239 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9296888eb37e46e3b37337339125816a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9296888eb37e46e3b37337339125816a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9296888eb37e46e3b37337339125816a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9296888eb37e46e3b37337339125816a"}]}] Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TenantUsagesTestJSON-787629239 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9296888eb37e46e3b37337339125816a Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TenantUsagesTestJSON-787629239 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TenantUsagesTestJSON-787629239-project Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8ef6081d349e4fd6949f035095ac8d87 Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TenantUsagesTestJSON-787629239-project Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5970a615-dfa1-401a-9aa8-4968342a8b07'} Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:41:52.865524 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] Returning 404 to user: Instance 5970a615-dfa1-401a-9aa8-4968342a8b07 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:41:52.871582 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d9bd95b-3738-41f8-99ab-ac50a9211a66 tempest-TenantUsagesTestJSON-787629239 tempest-TenantUsagesTestJSON-787629239-project] 10.222.0.50 "GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07" status: 404 len: 111 microversion: 2.1 time: 0.067750 Aug 30 17:41:52.873666 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1694/3590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:52 2022] GET /compute/v2.1/servers/5970a615-dfa1-401a-9aa8-4968342a8b07 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:41:52.968499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:52.976541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:52.977683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:53.004011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:53.004583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:53.005940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:53.011035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:53.016623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:53.018232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:53.458763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:53.460967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:53.476274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:53.476979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:53.477569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:53.486153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:53.487001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:53.487695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:53.554872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a301c09b-fe0e-4bed-94d4-d3b0062e02fe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.100297 Aug 30 17:41:53.557496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1695/3591] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:53 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:53.726808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:53.751812 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-32f62f59-63e8-4b50-9f68-02507bf81234 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.785191 Aug 30 17:41:53.752993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1897/3592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:52 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:54.537154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f403e41-6656-4a5d-8478-36f7dd58518e", "tag": "9311fb53-6ba1-49c7-a1a0-5a4416f7abad"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:54.564817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:54.566338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:54.567018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:54.568400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:54.570937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:54.590084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:54.590727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:54.591228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:54.596009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:54.600017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:54.603449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:54.629562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] Creating event network-changed:9311fb53-6ba1-49c7-a1a0-5a4416f7abad for instance 0f403e41-6656-4a5d-8478-36f7dd58518e on n-h2-852771-11 Aug 30 17:41:54.645469 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8835a8fe-514a-4dd6-8a77-a783ac8083d7 req-3b80d7fc-3e95-45f7-8d92-d02b0bae061c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113513 Aug 30 17:41:54.649235 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1696/3593] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:41:54.718913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a2641f9c-6ced-4d9d-b384-6a715a5fbe6b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.149710 Aug 30 17:41:54.720373 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1898/3594] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:54 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 17:41:54.782858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:54.783337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:54.798200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:54.798695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:54.799135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:54.799882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:54.800327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:54.800754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:55.285486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:55.295412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5a3aa3b-342f-4f5e-84c7-e68727f0f7b7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.524893 Aug 30 17:41:55.309256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1697/3595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:54 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:55.741097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:55.750751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:55.784067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:55.784744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:55.785340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:55.786592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:55.787759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:55.788807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:56.167434 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23743f1c-c0c9-40f0-ac62-e90bbb00c09c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.433633 Aug 30 17:41:56.175704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1899/3596] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:55 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:56.348031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:56.351676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:56.379709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:56.394102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:56.396690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:56.402308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:56.405012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:56.406135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:56.408214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:57.187099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:57.190282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:57.198014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:57.217591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:57.218179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:57.219142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:57.219438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:57.220160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:57.221057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:57.291158 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1665d5c-9776-4929-85c3-1f1c3a996b2b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.109344 Aug 30 17:41:57.298748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1900/3597] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:57 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:57.310532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:57.324903 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b790518-bafc-4978-9472-af5e0959f90f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 1.009248 Aug 30 17:41:57.331619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1698/3598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:56 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:58.307883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:58.311143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:58.344792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:58.353751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:58.354982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:58.365821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:58.367364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:58.368012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:58.368696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:58.371384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:58.374209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:58.375712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:58.378892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:58.379650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:58.381046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:58.386014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:58.386864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:58.461675 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae1167a2-6e1d-4d04-b67f-3448227a51c4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.159180 Aug 30 17:41:58.463164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1901/3599] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:58 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:58.865622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:41:58.883390 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f815eac-31db-471d-ada1-380888ddc011 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.535229 Aug 30 17:41:58.884360 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1699/3600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:58 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:41:59.486942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:59.489573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:59.518390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:59.526650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f403e41-6656-4a5d-8478-36f7dd58518e", "name": "network-vif-plugged", "status": "completed", "tag": "9311fb53-6ba1-49c7-a1a0-5a4416f7abad"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:41:59.534246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:59.535100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:59.539226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:59.549558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:59.551774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:59.584805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:59.585282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:59.588628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:59.611701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:41:59.631800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] Creating event network-vif-plugged:9311fb53-6ba1-49c7-a1a0-5a4416f7abad for instance 0f403e41-6656-4a5d-8478-36f7dd58518e on n-h2-852771-11 Aug 30 17:41:59.644914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8a800ea7-1ab5-4cde-a8cf-82cb1e37857a req-9ab95e6c-9c73-4f22-9ac8-d7fd473e989c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118774 Aug 30 17:41:59.658018 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1700/3601] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:41:59.681123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5731d3eb-0110-4f6d-a0b5-035c7126373e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 14 microversion: 2.1 time: 0.207984 Aug 30 17:41:59.682405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1902/3602] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:41:59 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:41:59.907800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:41:59.908506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:41:59.915256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:59.915841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:59.916279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:41:59.916985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:41:59.917440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:41:59.917925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:00.274444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:00.318060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82a9136e-3666-4a60-8dca-1121077f760c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1315 microversion: 2.1 time: 0.411142 Aug 30 17:42:00.321114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1701/3603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:41:59 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:00.694520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:00.696894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:00.718609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:00.719098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:00.719559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:00.720278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:00.720729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:00.721153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:00.819887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2492f26b-7ab7-4507-9018-c88ddbdd7a54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action" status: 200 len: 8202 microversion: 2.1 time: 0.129728 Aug 30 17:42:00.825384 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1903/3604] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:00 2022] POST /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b/action => generated 8202 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:00.831148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:00.832601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:00.853422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:00.853918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:00.861044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:00.861988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:00.862792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:00.864033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:01.347946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:01.348935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:01.366821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:01.370662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:01.372821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:01.377812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:01.378787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:01.382963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:01.536864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:01.557117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3910e49d-473b-4609-b269-6cdf27970bc3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.728625 Aug 30 17:42:01.557749 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1702/3605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:00 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:01.586533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:01.589392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:01.604308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:01.605095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:01.606925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:01.609085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:01.613092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:01.614071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:01.940867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:01.956057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9a00d94-414c-417f-a67b-a017ecf2fa88 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1502 microversion: 2.1 time: 0.611837 Aug 30 17:42:01.959276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1904/3606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:01 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1502 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:02.069667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:02.086337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2729dba2-a76d-4d03-b012-56dfd40de360 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.502343 Aug 30 17:42:02.089377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1703/3607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:01 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:02.109998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:02.110631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:02.140983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:02.143876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:02.144365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:02.148572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:02.149067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:02.153288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:02.315606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2118513182", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "c6ed4c8f-0f98-4f08-b171-33d834e51dfe"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:02.456858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] validate_networks() for [('c6ed4c8f-0f98-4f08-b171-33d834e51dfe', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:42:02.899199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:02.914726 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b95a7c1c-95e2-4985-96b3-f216058e62d5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.808821 Aug 30 17:42:02.917799 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1704/3608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:02 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:02.940592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:02.941501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:02.959141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:02.961569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:02.962138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:02.963153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:02.967653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:02.968426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:03.719656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:03.729933 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f1348ac-718a-4eb3-b83a-81d2a3a926a8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.795791 Aug 30 17:42:03.734606 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1705/3609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:02 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:03.755954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:03.757029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:03.769416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:03.780182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:03.780754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:03.781835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:03.782750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:03.784055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:03.928835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Locking {{(pid=122123) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 30 17:42:04.093974 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2504bca-a4e3-4a22-9315-4a4dd31d0a6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.342558 Aug 30 17:42:04.097858 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1706/3610] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:03 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:42:04.105840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:04.107466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:04.118752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.119602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.120616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.121691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.124832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.125523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.363589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:04.376371 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c12a696c-9b80-4ec6-a6ff-e8fe0ada2b11 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.277041 Aug 30 17:42:04.380555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1707/3611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:04 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:04.408025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:04.429927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.433358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.434110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.494587 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action HTTP/1.1 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 15 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: {"os-stop": {}} Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '100c6312-01c1-44c8-a98c-b1b04cc96c0e', 'body': {'os-stop': {}}} Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked Aug 30 17:42:04.496659 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:04.503966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 409 to user: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e is locked {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:04.505129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-acaf2080-5cd6-4c7a-a837-df2ed42d1ca8 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 409 len: 107 microversion: 2.1 time: 0.103720 Aug 30 17:42:04.506922 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1708/3612] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:04 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 107 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:42:04.520123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:04.526515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:04.540764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.547796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.547796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.547796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.547796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.547796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.660846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Unlocking {{(pid=122123) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 17:42:04.756656 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8206eb6d-b7a4-47df-b18a-3e1aa462335d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.245063 Aug 30 17:42:04.757728 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1709/3613] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:04 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:04.768218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:04.780036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.780925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.781779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.818239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:42:04.941699 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07795e51-8052-4177-bbb6-8e1dd2c75a1c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.179350 Aug 30 17:42:04.944229 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1710/3614] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:04 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:42:04.962750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:04.964535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:04.991397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.992486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:04.995021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:04.997271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:04.998798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:05.000362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:05.143283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:42:05.143854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:42:05.144590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:42:05.144842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:42:05.145251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:42:05.164613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:05.165114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:05.165557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:05.166292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:05.167216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:05.167840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:05.195918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Getting quotas for project f1c3313efdb84bf3ac6fa989129ad01e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:05.204159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Getting quotas for user b69c82fda7e841cc9145633d128631fa and project f1c3313efdb84bf3ac6fa989129ad01e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:05.222031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:42:05.224449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:42:05.292701 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-25d62c7a-00da-40f7-a325-e910c477506e tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.331544 Aug 30 17:42:05.293550 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1905/3615] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:42:05.306372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af1e8811-cbc6-4de5-8546-c8521772d190"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:05.308971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:05.323240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:05.323391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:05.324034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:05.325054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:05.328085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:05.328798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:05.908649 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c70d47b-1200-4b21-a79f-c9f227a4de0f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606867 Aug 30 17:42:05.931426 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1906/3616] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:42:05 2022] POST /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:05.955273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfc5aa9b-a4c3-462d-9a67-0d71b476786a tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:05.957972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfc5aa9b-a4c3-462d-9a67-0d71b476786a tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:06.166580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfc5aa9b-a4c3-462d-9a67-0d71b476786a tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:06.178324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfc5aa9b-a4c3-462d-9a67-0d71b476786a tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1228 microversion: 2.1 time: 0.242332 Aug 30 17:42:06.179824 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1907/3617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:05 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1228 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:06.195144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:06.199662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:06.216750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ec8d96c-1229-4a98-bb23-cca0904a411f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 1.262880 Aug 30 17:42:06.219274 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1711/3618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:04 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:07.208183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:07.208822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:07.228257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:07.232845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:07.233444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:07.244360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:07.245203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:07.249440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:07.252816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:07.253407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:07.307569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:07.317380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:07.317879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:07.318649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:07.319129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:07.333441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:07.459286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:07.472520 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15fb3b07-c596-4a5d-9619-2b40ed73fd9c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1288 microversion: 2.1 time: 0.271223 Aug 30 17:42:07.493634 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1908/3619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:07 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1288 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:07.928400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:07.945292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f48c967-0ed2-4afc-9ca1-1fed6767fd6f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.705778 Aug 30 17:42:07.948079 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1712/3620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:07 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:08.507422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:08.508047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:08.516364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:08.516857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:08.517292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:08.518306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:08.519280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:08.519912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:08.525184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:08.629004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:08.638247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11df54b8-6328-4535-acaa-cf2d1add6455 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1286 microversion: 2.1 time: 0.134299 Aug 30 17:42:08.648809 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1909/3621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:08 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:08.976266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:08.977771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:08.995446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:08.997317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:08.999010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:09.002916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:09.004039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:09.005812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:09.470451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:09.499420 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b44ede70-d5db-4234-ab2d-bda372c01ad6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.528706 Aug 30 17:42:09.500297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1713/3622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:08 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:09.662326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:09.663041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:09.676058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:09.676564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:09.677008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:09.677937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:09.678400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:09.678833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:10.132694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:10.148175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-63a2594e-a01a-49de-9370-948f8c57079c tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.488654 Aug 30 17:42:10.150411 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1910/3623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:09 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:10.385200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24acc0e7-ccd6-4d15-a8af-dc0420981aca", "tag": "68c79af9-3e83-43e7-ad0d-17a6f65b72cb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:10.423572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:10.424395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:10.425439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:10.458276 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] Creating event network-changed:68c79af9-3e83-43e7-ad0d-17a6f65b72cb for instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca on n-h1-852771-11 Aug 30 17:42:10.479082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-db10058a-5c4b-4242-b6f4-96e0c1a425b3 req-44cf9350-05f6-4d67-b52f-f29747197c9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098102 Aug 30 17:42:10.483470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1714/3624] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:10.528055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:10.529493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:10.553149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:10.557346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:10.558755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:10.561287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:10.564846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:10.569477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:11.178590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:11.179309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:11.197366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:11.197869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:11.198297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:11.203123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:11.203611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:11.204040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:11.337478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:11.357503 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-983731de-c5ec-46f9-b324-46c5d364a801 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.836104 Aug 30 17:42:11.358209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1911/3625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:10 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:11.563244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:11.570902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22df7520-6757-44dc-814d-73a2a161be51 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.396786 Aug 30 17:42:11.573446 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1715/3626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:11 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:12.379845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:12.381149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:12.396509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.397192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.398202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.400806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.404589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.405630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.597266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:12.597897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:12.606126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.610412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.615595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.616643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.617280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.617890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.895859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:12.917797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47238f95-3ce8-482d-a9c8-b549470b22e0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.534065 Aug 30 17:42:12.931896 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1912/3627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:12 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:13.104918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:13.163242 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85a4e52b-e14c-43a0-86c3-de762dc6d89b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.567885 Aug 30 17:42:13.164216 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1716/3628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:12 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:13.967992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:13.972499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53613487-1af6-4847-8d1b-f26924056597 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Action: 'create', calling method: .version_select at 0x7f2d9386bd30>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:13.977035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:14.027401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:14.027939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:14.031059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:14.033148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:14.034993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:14.036076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:14.465411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:14.474534 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b98c25f-d487-414e-bda2-33912e37b2cb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.524598 Aug 30 17:42:14.475122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1717/3629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:13 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:14.498686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:14.499648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:14.506472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:14.507186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:14.507819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:14.508688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:14.509333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:14.509927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:14.730436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:14.751346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a6569dae-263a-47c6-a3b6-7981cc49f067 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.256744 Aug 30 17:42:14.755674 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1718/3630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:14 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:15.181843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:15.542397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:15.543166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:15.561964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:15.562665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:15.563351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:15.567566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:15.568309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:15.569408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:15.751347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:15.763255 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1e0321d-c7d9-49eb-9a1f-be11e77aa6e3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1655 microversion: 2.1 time: 0.267078 Aug 30 17:42:15.769243 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1719/3631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:15 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1655 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:15.784561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:15.791455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:15.809401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:15.809974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:15.811332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:15.812360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:15.812826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:15.813259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:16.010746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:16.020588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b49f9048-5351-4a01-be49-94ddd42fbef1 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.249930 Aug 30 17:42:16.021375 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1720/3632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:15 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:16.027316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:16.034301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:16.035100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:16.037786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:16.065065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:42:16.121353 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22475698-a4bb-481d-bd2c-e110a55a704d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.098018 Aug 30 17:42:16.127331 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1721/3633] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:16 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:16.135106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:16.143273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:16.174934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:16.180422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:16.181069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:16.184624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:16.185543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:16.186130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:16.186674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:16.737383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:16.764357 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82a62a51-ef17-4999-a95a-6ab7cd05eafe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1664 microversion: 2.1 time: 0.635221 Aug 30 17:42:16.765143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1722/3634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:16 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1664 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:17.044524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:17.047114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:17.059788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:17.060608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:17.061563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:17.062510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:17.063180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:17.063854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:17.219258 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53613487-1af6-4847-8d1b-f26924056597 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.433737 Aug 30 17:42:17.220462 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1913/3635] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:42:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:17.232854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0bc95ff5-6e1b-474f-89db-eb8823f1f855 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d9386b820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:17.402505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:17.414622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43837fa2-516e-4caf-af32-b8d255a2eef9 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.376173 Aug 30 17:42:17.416057 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1723/3636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:17 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:17.787086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:17.791032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:17.801270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:17.801891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:17.802187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:17.802890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:17.803337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:17.803972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:17.872618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0bc95ff5-6e1b-474f-89db-eb8823f1f855 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/2404190c-d2f9-468f-b0f0-cfca887d2b5f" status: 200 len: 142 microversion: 2.1 time: 0.643064 Aug 30 17:42:17.881141 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1914/3637] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:42:17 2022] GET /compute/v2.1/os-floating-ips/2404190c-d2f9-468f-b0f0-cfca887d2b5f => generated 142 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:17.886245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17799a75-33e2-4b85-a93b-69b3e25103e9 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d9ccd0dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:18.026235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:18.044764 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7cbe9e8b-c6b1-4fb2-8318-71e95e249160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1664 microversion: 2.1 time: 0.261535 Aug 30 17:42:18.060515 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1724/3638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:17 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:18.266509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24acc0e7-ccd6-4d15-a8af-dc0420981aca", "name": "network-vif-plugged", "status": "completed", "tag": "68c79af9-3e83-43e7-ad0d-17a6f65b72cb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:18.296348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:18.296951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:18.299217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:18.322033 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] Creating event network-vif-plugged:68c79af9-3e83-43e7-ad0d-17a6f65b72cb for instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca on n-h1-852771-11 Aug 30 17:42:18.332495 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-caf49463-a7f8-440f-bf6a-fbfd2836d315 req-6c797566-b701-4e0a-b460-a5b20acabc76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077344 Aug 30 17:42:18.333996 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1725/3639] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:18.438112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:18.439058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:18.448324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:18.450987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:18.451884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:18.453290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:18.457253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:18.458059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:18.640160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17799a75-33e2-4b85-a93b-69b3e25103e9 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.756187 Aug 30 17:42:18.641087 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1915/3640] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:42:17 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:18.664396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c85f7f9a-e202-4b1c-9e83-c1133d70498b tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d9cd33280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:18.857056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:18.881542 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ef2e3cf-29ef-4c14-94ac-561fbd9c2b21 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1328 microversion: 2.1 time: 0.449031 Aug 30 17:42:18.895665 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1726/3641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:18 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:19.069892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:19.071101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:19.081278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:19.084532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:19.085052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:19.086511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:19.087281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:19.087984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:19.676958 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c85f7f9a-e202-4b1c-9e83-c1133d70498b tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/2404190c-d2f9-468f-b0f0-cfca887d2b5f" status: 202 len: 0 microversion: 2.1 time: 1.023844 Aug 30 17:42:19.678529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1916/3642] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:42:18 2022] DELETE /compute/v2.1/os-floating-ips/2404190c-d2f9-468f-b0f0-cfca887d2b5f => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:19.693759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-424f9ce0-504e-4740-ad66-dfd3560ff232 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Action: 'create', calling method: .version_select at 0x7f2d9cda1a60>, body: {"pool": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:19.806366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:19.819947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d8ac10f-eccd-4574-bdbe-735d9f0d6548 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.756094 Aug 30 17:42:19.820546 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1727/3643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:19 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:19.844139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:19.845102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:19.852213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:19.853106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:19.853812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:19.856029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:19.858804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:19.859404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.273194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:20.277306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:20.285493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c708f458-4cf6-4cc6-8454-89b750853cde tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.446308 Aug 30 17:42:20.286922 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1728/3644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:19 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:20.304141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:20.305695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:20.315977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.316632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.317211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.318041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.318574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.319040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.677336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:20.690363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dfbc8737-4c25-41d1-8aa8-d7add99eff89 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1528 microversion: 2.1 time: 0.401709 Aug 30 17:42:20.691972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1729/3645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:20 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1528 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:20.697797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:20.698480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:20.706273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.706767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.707259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.708258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.709138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.710082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.776957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Unlocking {{(pid=122123) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 17:42:20.859247 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1f95be0-9bbd-4d0a-a9e2-89c5fe651d40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.165519 Aug 30 17:42:20.861654 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1730/3646] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:20 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:20.873219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:20.874355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:20.887157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.888397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.889097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:20.890112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:20.890625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:20.891429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.291212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:21.321180 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3935c5a-2ea5-4d54-9bb7-c89b01140215 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1528 microversion: 2.1 time: 0.457080 Aug 30 17:42:21.322215 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1731/3647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:20 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1528 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:21.328714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:21.330675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:21.344158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.344725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.345475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.347806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.348292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.348785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.382016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:42:21.420387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-424f9ce0-504e-4740-ad66-dfd3560ff232 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.735275 Aug 30 17:42:21.429777 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1917/3648] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 30 17:42:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:21.429777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:21.429777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:21.439441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:21.441889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.442465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.442982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.444148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.444679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.446171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.552692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e61e6e38-0a6b-4a6f-8e69-f13f109c53f0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 204 len: 0 microversion: 2.1 time: 0.228383 Aug 30 17:42:21.554028 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1732/3649] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:21 2022] DELETE /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:21.762089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:21.763049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:21.771347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.771921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.772375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.773134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.773778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.774240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.792364 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] HTTP exception thrown: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Request method failure captured: Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca HTTP/1.1 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkvpJioqnRmbAWUFG61T2IcOs3EIyCtig8EmzQGE3anzRkHHIOKOuFQgLhVS6RuAUqn0bcWWZ9mFxcQcRQ7WJny0Y2QQCEkMtcSG7RGLu8BqQJvE4fnzli9loCud4RIOf121rcxPSC8qdABBkGnZLRzuU_ENwlNl_LKpk5_HoZ_3OtE Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 01865a427d15489eb55e220a47033e6c Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01865a427d15489eb55e220a47033e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01865a427d15489eb55e220a47033e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01865a427d15489eb55e220a47033e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01865a427d15489eb55e220a47033e6c"}]}] Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 01865a427d15489eb55e220a47033e6c Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestMultiTenantJSON-802520634-project Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: cb769191ea454d78a10825044424fce6 Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634-project Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24acc0e7-ccd6-4d15-a8af-dc0420981aca'} Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:21.794880 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Returning 404 to user: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57967c66-7859-4377-b1fb-4507be8a6a50 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] 10.222.0.50 "DELETE /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 404 len: 111 microversion: 2.1 time: 0.240708 Aug 30 17:42:21.802849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1733/3650] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:21 2022] DELETE /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:21.805081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f04aa6c-33ed-4dd3-a5e5-d2cf1abd3fe3 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d93972550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:21.805239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:21.814862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e08c7450-3637-4270-813b-f10a25dffa62 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.390582 Aug 30 17:42:21.816194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1918/3651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:21 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:21.823033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:21.828812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:21.843829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.844451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.849046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.849942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.850680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.851095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.244592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:22.256191 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9dbe4de-1dc2-4634-ac81-4d4806fd5c64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1554 microversion: 2.1 time: 0.438650 Aug 30 17:42:22.269926 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1919/3652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:21 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1554 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:22.280044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:22.280923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:22.287501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.288250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.288691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.289399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.289855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.290282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.670225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:22.679433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f33e8eca-9b42-4acb-9fa7-0294328e3f97 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1528 microversion: 2.1 time: 0.405169 Aug 30 17:42:22.680624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1920/3653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:22 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1528 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:22.687025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:22.687737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:22.695340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.696049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.696528 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f04aa6c-33ed-4dd3-a5e5-d2cf1abd3fe3 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75" status: 202 len: 0 microversion: 2.1 time: 0.897460 Aug 30 17:42:22.697410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1734/3654] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:42:21 2022] DELETE /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75 => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:22.698343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.699337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.701175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.701824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.708884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Action: 'update', calling method: >, body: {"server": {"name": "24acc0e7-ccd6-4d15-a8af-dc0420981aca_new"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:22.720869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:22.733683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.734110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.734689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.735393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.735950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.736784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.754354 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] HTTP exception thrown: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Request method failure captured: Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca HTTP/1.1 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 64 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkvpJioqnRmbAWUFG61T2IcOs3EIyCtig8EmzQGE3anzRkHHIOKOuFQgLhVS6RuAUqn0bcWWZ9mFxcQcRQ7WJny0Y2QQCEkMtcSG7RGLu8BqQJvE4fnzli9loCud4RIOf121rcxPSC8qdABBkGnZLRzuU_ENwlNl_LKpk5_HoZ_3OtE Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 01865a427d15489eb55e220a47033e6c Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01865a427d15489eb55e220a47033e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01865a427d15489eb55e220a47033e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01865a427d15489eb55e220a47033e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01865a427d15489eb55e220a47033e6c"}]}] Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 01865a427d15489eb55e220a47033e6c Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestMultiTenantJSON-802520634-project Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: cb769191ea454d78a10825044424fce6 Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-802520634-project Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "24acc0e7-ccd6-4d15-a8af-dc0420981aca_new"}} Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24acc0e7-ccd6-4d15-a8af-dc0420981aca', 'body': {'server': {'name': '24acc0e7-ccd6-4d15-a8af-dc0420981aca_new'}}} Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:22.756503 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] Returning 404 to user: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44d01b58-e280-4798-bf95-ed407adbd2a5 tempest-ServersNegativeTestMultiTenantJSON-802520634 tempest-ServersNegativeTestMultiTenantJSON-802520634-project] 10.222.0.50 "PUT /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 404 len: 111 microversion: 2.1 time: 0.060543 Aug 30 17:42:22.761396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1735/3655] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:42:22 2022] PUT /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:42:22.769957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d93972ee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:22.843999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 653d1431-763c-45b0-8112-1fe52b4ccc75 could not be found", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:42:22.847524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] HTTP exception thrown: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Request method failure captured: Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75 HTTP/1.1 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkv1RjbqVvfIo_XhwjpD8QUuZWa5xeBjLWgSuF9DTluyhUkb_qG320kKNfi-SXmVZcpvhxK6VcTdL4070WwTsKhJCVZzG0lKPMWe_ZioWu9nYP0WgeHMG2MwEROv6ZFkOrajKJP7wkbQY8jxL9Erb6zO8mXBJKSwuUHFwh5MCRQxJ_E Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c86f5d430d924c92a19c746cf99be488 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c86f5d430d924c92a19c746cf99be488"}]}] Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c86f5d430d924c92a19c746cf99be488 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-FloatingIPsTestJSON-169345459-project Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 85000e02e4754df68ed64f8f38c5e6be Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-FloatingIPsTestJSON-169345459-project Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: exception: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '653d1431-763c-45b0-8112-1fe52b4ccc75'} Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 653d1431-763c-45b0-8112-1fe52b4ccc75 could not be found Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce1b277d-92bf-4c36-b5fd-6a93d937b893'] Aug 30 17:42:22.851578 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75. Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:22.862991 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:22.870967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Returning 404 to user: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:22.874750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7aa2e5aa-e74d-41c2-81e3-35a90c680412 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75" status: 404 len: 111 microversion: 2.1 time: 0.110611 Aug 30 17:42:22.875216 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1736/3656] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 30 17:42:22 2022] GET /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:22.882631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:22.883185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:22.891620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.892226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.892797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.893460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:22.893958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:22.894395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:22.928047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:42:22.938569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:22.951919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b50e5fea-fbf6-4ba7-b33e-8265e602ece0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.267884 Aug 30 17:42:22.953342 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1921/3657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:22 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:22.964049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Calling method '.version_select at 0x7f2d9cda8040>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:23.071343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 653d1431-763c-45b0-8112-1fe52b4ccc75 could not be found", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:42:23.072770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] HTTP exception thrown: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Request method failure captured: Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75 HTTP/1.1 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkv1RjbqVvfIo_XhwjpD8QUuZWa5xeBjLWgSuF9DTluyhUkb_qG320kKNfi-SXmVZcpvhxK6VcTdL4070WwTsKhJCVZzG0lKPMWe_ZioWu9nYP0WgeHMG2MwEROv6ZFkOrajKJP7wkbQY8jxL9Erb6zO8mXBJKSwuUHFwh5MCRQxJ_E Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c86f5d430d924c92a19c746cf99be488 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c86f5d430d924c92a19c746cf99be488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c86f5d430d924c92a19c746cf99be488"}]}] Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c86f5d430d924c92a19c746cf99be488 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-FloatingIPsTestJSON-169345459 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-FloatingIPsTestJSON-169345459-project Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 85000e02e4754df68ed64f8f38c5e6be Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-FloatingIPsTestJSON-169345459-project Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: exception: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '653d1431-763c-45b0-8112-1fe52b4ccc75'} Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 653d1431-763c-45b0-8112-1fe52b4ccc75 could not be found Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2babc1cc-dcac-438a-ac42-aae2ff973247'] Aug 30 17:42:23.077510 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75. Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 Aug 30 17:42:23.083465 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:23.091749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] Returning 404 to user: Floating IP not found for ID 653d1431-763c-45b0-8112-1fe52b4ccc75 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:23.091749 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-984de21a-6da0-4383-8ceb-54fae3d28572 tempest-FloatingIPsTestJSON-169345459 tempest-FloatingIPsTestJSON-169345459-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75" status: 404 len: 111 microversion: 2.1 time: 0.137068 Aug 30 17:42:23.093058 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1922/3658] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:42:22 2022] DELETE /compute/v2.1/os-floating-ips/653d1431-763c-45b0-8112-1fe52b4ccc75 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:23.100829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:23.101771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:23.105782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-172cdfd6-b3ac-46d2-8831-eef6473ca94d tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 204 len: 0 microversion: 2.1 time: 0.228797 Aug 30 17:42:23.109159 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1737/3659] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:22 2022] DELETE /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:23.122418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:23.126740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.127815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:23.131443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.132205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.133318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.134014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.134688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.143793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.144682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.145372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.154594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.155382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.156079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.537446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:23.549080 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3a303603-9b4f-457f-8309-acbf86a3096a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.454162 Aug 30 17:42:23.549941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1923/3660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:23 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:23.556667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:23.557670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:23.565131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.566319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.567002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.567988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.568730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.569391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.848338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:23.863107 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4f9f539-9e83-49f5-b650-caa2acd29d29 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1554 microversion: 2.1 time: 0.310502 Aug 30 17:42:23.864361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1924/3661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:23 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:23.872851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:23.874093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:23.885321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.886144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.886838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:23.887911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:23.888615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:23.890824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:24.014988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:24.023335 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-895c268b-8c0e-48bc-adff-4d7316c11708 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1534 microversion: 2.1 time: 0.909493 Aug 30 17:42:24.030377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1738/3662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:23 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1534 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:24.040291 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-70d2961e-72ba-4087-a7e5-8421d3fbfaee tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.174466 Aug 30 17:42:24.041204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1925/3663] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:23 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:24.056597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:24.067928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:24.080245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:24.080988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:24.081775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:24.082912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:24.083587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:24.084314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:24.473164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:24.484372 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6efd2b9-7149-491c-8257-f88667831db3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1673 microversion: 2.1 time: 0.436523 Aug 30 17:42:24.485104 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1739/3664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:24 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1673 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:24.887828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:24.888550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:24.906051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:24.906781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:24.907869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:24.909860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:24.911848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:24.913116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.050725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:25.051345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:25.065681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:25.066170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:25.066636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.067546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:25.068069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:25.068493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.559718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:25.616772 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e878c5c3-5cf1-4b54-9041-f3653ac21e6f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1512 microversion: 2.1 time: 0.734080 Aug 30 17:42:25.618108 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1926/3665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:24 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1512 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:25.637941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f403e41-6656-4a5d-8478-36f7dd58518e", "name": "network-vif-deleted", "tag": "9311fb53-6ba1-49c7-a1a0-5a4416f7abad"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:25.689743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:25.692481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:25.692981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.760644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] Creating event network-vif-deleted:9311fb53-6ba1-49c7-a1a0-5a4416f7abad for instance 0f403e41-6656-4a5d-8478-36f7dd58518e on n-h2-852771-11 Aug 30 17:42:25.769400 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ece522fb-f7e1-4ad4-96c1-5f833f1edff2 req-c44c91ef-051a-47b3-9122-a6eda3606ec0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147680 Aug 30 17:42:25.770285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1927/3666] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:25.784929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:25.785995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:25.795121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:25.795656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:25.796100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.796846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:25.799410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:25.800784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:25.977480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:25.991803 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3792ee6c-0bcf-4c8b-a851-ced683e01854 tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1534 microversion: 2.1 time: 0.943383 Aug 30 17:42:25.994684 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1740/3667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:25 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1534 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:26.225142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:26.237645 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb29a083-a636-4b01-9a0d-ef07ce65f160 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1653 microversion: 2.1 time: 0.465664 Aug 30 17:42:26.240155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1928/3668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:25 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1653 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:26.272470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:26.285701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:26.295194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.295997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.296878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:26.297951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.298591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.299193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:26.453850 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f85c1749-c9b3-4e38-975f-5694693602f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.186781 Aug 30 17:42:26.472129 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1741/3669] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:26 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:42:26.640374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:26.641216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:26.671639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.676182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.677071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:26.678509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.679150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.680028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:26.700003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:26.861621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:26.863990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:26.907576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.908423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.910408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:26.913574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:26.914386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:26.915024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.050105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:27.094181 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a05563e-0b45-42ed-81ff-556578610366 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1346 microversion: 2.1 time: 0.458044 Aug 30 17:42:27.096152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1742/3670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:26 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1346 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:27.101971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:27.102958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:27.119792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.122344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.124759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.127359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.129452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.131161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.197293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.198054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.199273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.200270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lazy-loading 'fault' on Instance uuid 24acc0e7-ccd6-4d15-a8af-dc0420981aca {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:42:27.426279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:27.450311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8c3d8170-4d78-4060-bf77-c2d41cea2d45 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.987114 Aug 30 17:42:27.455994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1929/3671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:26 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:27.478201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:27.479193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:27.486885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.492189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.492894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.494564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.495203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.495843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.633521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c82fda7e841cc9145633d128631fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3313efdb84bf3ac6fa989129ad01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:27.642713 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9db0ea30-2e7b-456f-b231-5d21ad8e79ea tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 200 len: 1318 microversion: 2.1 time: 0.544933 Aug 30 17:42:27.649093 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1743/3672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:27 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:27.862959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24acc0e7-ccd6-4d15-a8af-dc0420981aca", "name": "network-vif-deleted", "tag": "68c79af9-3e83-43e7-ad0d-17a6f65b72cb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:27.879971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:27.886100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:27.886859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:27.888104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:27.914729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] Creating event network-vif-deleted:68c79af9-3e83-43e7-ad0d-17a6f65b72cb for instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca on n-h1-852771-11 Aug 30 17:42:27.932998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7271137b-ce3d-4089-b42b-fde8214f85cb req-abd88b71-f04b-41bb-8fd0-3305cf0aa384 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073561 Aug 30 17:42:27.935985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1744/3673] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:28.086021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:28.099952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4d12ab12-65cf-441e-81e1-0b856f6100cf tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.625582 Aug 30 17:42:28.101349 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1930/3674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:27 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:28.123034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:28.125852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:28.143259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.144631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:28.145418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.145850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.148324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.148996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.149346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:28.149955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.175621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.176851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.177970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.179354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.180089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.180825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.206049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:28.518545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:28.534697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6bfe3ab2-29f6-4c73-b2e6-716c7a049c65 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.405195 Aug 30 17:42:28.538628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1931/3675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:28 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:28.563029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:28.563846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:28.573813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.574463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.575753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.576625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.577204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.577748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.749168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:28.785562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71aa32ee-2843-43b0-9f53-b4d4ae17d5ed tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1346 microversion: 2.1 time: 0.672402 Aug 30 17:42:28.786840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1745/3676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:28 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1346 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:28.793088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:28.795176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] [instance: 24acc0e7-ccd6-4d15-a8af-dc0420981aca] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:28.801938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.802676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.803332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.804474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:28.805452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:28.806050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:28.828129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] HTTP exception thrown: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Request method failure captured: Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca HTTP/1.1 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkvaRF4Ww1QK4D_CQUR1VPN_CEhfbX-5BJFZRfFV60S0DsjQwSFBAZ9Al3V-F-Na_xJ5_2fLoIMo4NcMq9NiNWe0VENdISdVS_t7kBNHEWXsNnz45nD0GgW4Kb8XGSircnELh2nk3X2OVGyDeRMj7mDda8fdNZCh_KID-ha2Sghaso4 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f1c3313efdb84bf3ac6fa989129ad01e Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-311775572 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1c3313efdb84bf3ac6fa989129ad01e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1c3313efdb84bf3ac6fa989129ad01e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f1c3313efdb84bf3ac6fa989129ad01e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f1c3313efdb84bf3ac6fa989129ad01e"}]}] Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-311775572 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f1c3313efdb84bf3ac6fa989129ad01e Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-311775572 Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestMultiTenantJSON-311775572-project Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b69c82fda7e841cc9145633d128631fa Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-311775572-project Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '24acc0e7-ccd6-4d15-a8af-dc0420981aca'} Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:28.830031 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] Returning 404 to user: Instance 24acc0e7-ccd6-4d15-a8af-dc0420981aca could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fc44e31-7281-4cf1-8339-361febc7c23b tempest-ServersNegativeTestMultiTenantJSON-311775572 tempest-ServersNegativeTestMultiTenantJSON-311775572-project] 10.222.0.50 "GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca" status: 404 len: 111 microversion: 2.1 time: 0.044410 Aug 30 17:42:28.835356 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1746/3677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:28 2022] GET /compute/v2.1/servers/24acc0e7-ccd6-4d15-a8af-dc0420981aca => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:29.053446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:29.068190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50288858-86a5-4bb5-8380-7ecd81472cdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.509703 Aug 30 17:42:29.069330 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1932/3678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:28 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:29.094773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:29.095552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:29.102461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.103263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.103966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:29.104920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.105574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.106252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:29.513456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:29.530924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c86c66b7-6383-437c-8c9d-d5b1beb0615b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.440969 Aug 30 17:42:29.532199 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1747/3679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:29 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:29.552370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:29.553698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:29.561559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.562416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.563104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:29.564096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.564800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.565454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:29.812677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:29.813352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:29.826306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.826973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.827655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:29.829232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:29.832510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:29.833096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:30.026820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:30.036992 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1dfa6fd5-25e6-4daa-af9e-108105c7d6ec tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1346 microversion: 2.1 time: 0.228958 Aug 30 17:42:30.059780 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1748/3680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:29 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1346 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:30.476118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:30.487322 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b80123b-d498-41a7-a9fe-5e9fc278da83 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.939205 Aug 30 17:42:30.492395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1933/3681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:29 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:31.080393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:31.082243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:31.104706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.106476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.108513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.110441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.111244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.112287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.249924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:31.271732 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-511091d6-36a0-41d2-8066-39be72816dd9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1346 microversion: 2.1 time: 0.205771 Aug 30 17:42:31.296225 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1749/3682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:31 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:32.306031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:32.307723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:32.320762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:32.322072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:32.322983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:32.326318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:32.328936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:32.329889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:32.387568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:32.388436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:32.388944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:32.389584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lazy-loading 'fault' on Instance uuid 0f403e41-6656-4a5d-8478-36f7dd58518e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:42:32.551617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:32.563051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc8d8ef6-81a5-4073-aab3-a009317b3461 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 200 len: 1305 microversion: 2.1 time: 0.262762 Aug 30 17:42:32.566630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1934/3683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:32 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 1305 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:33.439171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49125060-f577-41e8-be06-8cc91dfb6997 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d938494c0>, body: {"keypair": {"name": "tempest-keypair-760951555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLLvI+NzH0HcByWabdkWNjJdJ9LbVYAoLgxoOQUKjnO7dGBu34heBXQXUnl2lOyaO2Zz+Xk/b9aXz3GU7CzH2SIVMR2JGGgBnqUvQZKJZig+5y1ERCppnoT4O10kqTk8g=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:33.459280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-49125060-f577-41e8-be06-8cc91dfb6997 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:33.466883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-49125060-f577-41e8-be06-8cc91dfb6997 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:33.492623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.493478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:33.501152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.501882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.502972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.503812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.504284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.504761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.513422 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49125060-f577-41e8-be06-8cc91dfb6997 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.201300 Aug 30 17:42:33.515524 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1750/3684] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 30 17:42:33.525490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24957f71-597e-4333-b25a-c95f0dd5be27 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d93a15af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.538111 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24957f71-597e-4333-b25a-c95f0dd5be27 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-760951555" status: 200 len: 512 microversion: 2.2 time: 0.016723 Aug 30 17:42:33.539751 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1751/3685] 10.222.0.50 () {60 vars in 1255 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-760951555 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:33.552518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a9b25ff-3e86-478c-86d6-6186a15931be tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d93a158b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.576751 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a9b25ff-3e86-478c-86d6-6186a15931be tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760951555" status: 204 len: 0 microversion: 2.2 time: 0.028234 Aug 30 17:42:33.578963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1752/3686] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 30 17:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760951555 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:42:33.597312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.597962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:33.604400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.605131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.606346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.607510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.608144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.608575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.626579 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e HTTP/1.1 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0f403e41-6656-4a5d-8478-36f7dd58518e'} Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:33.628626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.634062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.635546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:33.636586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92276924-4b54-42d9-97f7-6f7d1f8e6762 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 404 len: 111 microversion: 2.1 time: 0.043966 Aug 30 17:42:33.638327 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1753/3687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:33.644134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-869d9846-2b28-47a7-b8f2-d0e0ef27ef6b tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d93a155e0>, body: {"keypair": {"name": "tempest-keypair-638369413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIBoInbfpaM/YZFZwnleFf1+ob5Emkg+lDE83fyUYBjjzUogmTwKiL70DPEX1yWiBnK3ssHQXG9gp+HebpZG+m/yCADgpRaS+5O2YiqLrYNmVe+AIH1k4e7/EUuhfVUA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:33.661795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-869d9846-2b28-47a7-b8f2-d0e0ef27ef6b tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:33.668197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-869d9846-2b28-47a7-b8f2-d0e0ef27ef6b tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:33.694425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-869d9846-2b28-47a7-b8f2-d0e0ef27ef6b tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.054647 Aug 30 17:42:33.695621 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1754/3688] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 17:42:33.706905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4892dc9e-b5e9-4b49-a5bd-5a58974b1227 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d938b94c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.752505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4892dc9e-b5e9-4b49-a5bd-5a58974b1227 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-638369413" status: 204 len: 0 microversion: 2.2 time: 0.049686 Aug 30 17:42:33.754951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1755/3689] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 30 17:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-638369413 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:42:33.766163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-261c0a7c-4c43-473c-9a58-6547d4958f94 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d93849160>, body: {"keypair": {"name": "tempest-keypair-1321911683", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:33.802995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-261c0a7c-4c43-473c-9a58-6547d4958f94 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:33.813005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-261c0a7c-4c43-473c-9a58-6547d4958f94 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:33.846509 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-261c0a7c-4c43-473c-9a58-6547d4958f94 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.086147 Aug 30 17:42:33.847605 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1756/3690] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:33 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 17:42:33.857763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.862454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:33.870457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.871139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.872511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.873230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.874338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.874785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.888865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:33.901014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:33.902808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:33.904567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50479282-5a7d-4f0e-b0a7-31f91fce46b1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2956 microversion: 2.42 time: 0.417046 Aug 30 17:42:33.905150 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1935/3691] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2956 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e/os-volume_attachments HTTP/1.1 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '0f403e41-6656-4a5d-8478-36f7dd58518e'} Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 17:42:33.919914 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:42:33.925495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:33.931309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-908c8ded-6209-4f4c-a626-309d088fb52e tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9cde21f0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.931539 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d351eb4-c1f0-44b7-b668-d3b1727b48e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.082098 Aug 30 17:42:33.935054 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1757/3692] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e/os-volume_attachments => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:33.944214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.944904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:33.963269 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-908c8ded-6209-4f4c-a626-309d088fb52e tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321911683" status: 204 len: 0 microversion: 2.2 time: 0.055578 Aug 30 17:42:33.965647 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1936/3693] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Aug 30 17:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321911683 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:33.967198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.968011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.968663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.970138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.970792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.971247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.979867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4d2bef7c-4483-4584-8598-ac45d4e84823 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d9cda15e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-994655035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIuDsY7W3ZtX5Aw4i7CMTHQrpjA9k6cg1sI74kOXZeza97Rhy89oT5bz1eTW1puOv5VqTGFLWlceTcHLPI2xGemrNdUQrZ6UKNSnxj8MOG0Gx1aoi25q9HhcV8Zw2Bog=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.008686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-4d2bef7c-4483-4584-8598-ac45d4e84823 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:34.018277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-4d2bef7c-4483-4584-8598-ac45d4e84823 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:34.074210 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4d2bef7c-4483-4584-8598-ac45d4e84823 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.097022 Aug 30 17:42:34.083309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1937/3694] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 30 17:42:34.092305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6619365-30ac-4f13-9c40-d574dc4146a7 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d9cc454c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-842441314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/1rMX22+IuApj15ZqCGT2r3LqA62bbZ5iUYQ/QN2cSWpUXcOjtRTas5bKrjaRSV3+hBwK76V6dJDG1XETQLVEu8y2eM0MSeazdErtmZFYsg6TkScOilbfgQXIAhx6d4Q=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.133681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b6619365-30ac-4f13-9c40-d574dc4146a7 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:34.148843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b6619365-30ac-4f13-9c40-d574dc4146a7 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:34.213711 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6619365-30ac-4f13-9c40-d574dc4146a7 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.126122 Aug 30 17:42:34.215279 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1938/3695] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 17:42:34.231550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd368d6c-c31c-470f-aae7-52786ea6c658 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d93892a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-773598769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx+x3hMVR4fmU5cMOI8XdTcyAra8G7n4k8923qCKTU70AH7xbJ4pLQcgeBqrk8pep8jN5RKlBnx8fzINU7q0yLJPSI3nGDV97p698lKiATPesKqI2IqVKs1w1F/qfRDAw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.270835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bd368d6c-c31c-470f-aae7-52786ea6c658 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:34.290476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bd368d6c-c31c-470f-aae7-52786ea6c658 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:34.313188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-28bcb07a-0803-4ee8-a9fe-17e7e55cb8ea tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.375613 Aug 30 17:42:34.326415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1758/3696] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884/os-interface => generated 1830 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:42:34.331896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1899119594", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.344751 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd368d6c-c31c-470f-aae7-52786ea6c658 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.119195 Aug 30 17:42:34.345554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1939/3697] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 30 17:42:34.360732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89054cbe-dd60-4a80-bcdb-352331800804 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9ccd0940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.365392 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-89054cbe-dd60-4a80-bcdb-352331800804 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:42:34.381125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89054cbe-dd60-4a80-bcdb-352331800804 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.028737 Aug 30 17:42:34.388374 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1940/3698] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 30 17:42:34 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:34.393737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6d83f88-430e-4fbf-8824-124c64a52072 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9ccc6dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.410758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:42:34.430595 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6d83f88-430e-4fbf-8824-124c64a52072 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-773598769" status: 204 len: 0 microversion: 2.2 time: 0.039763 Aug 30 17:42:34.431945 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1941/3699] 10.222.0.50 () {60 vars in 1318 bytes} [Tue Aug 30 17:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-773598769 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:34.446104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d988f249-bd1c-4c58-a85f-3ecb5baaeb23 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d99058a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.475198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d988f249-bd1c-4c58-a85f-3ecb5baaeb23 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-842441314" status: 204 len: 0 microversion: 2.2 time: 0.036907 Aug 30 17:42:34.476706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1942/3700] 10.222.0.50 () {60 vars in 1318 bytes} [Tue Aug 30 17:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-842441314 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:34.488583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95a48a2a-b3c4-4a86-832b-77d330818da4 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d98e7caf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.516771 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95a48a2a-b3c4-4a86-832b-77d330818da4 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-994655035" status: 204 len: 0 microversion: 2.2 time: 0.033866 Aug 30 17:42:34.518282 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1943/3701] 10.222.0.50 () {60 vars in 1318 bytes} [Tue Aug 30 17:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-994655035 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:42:34.531546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd3d1ea3-ecb1-41f6-9aeb-76cb2919394c tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d9cd33af0>, body: {"keypair": {"name": "tempest-keypair-272782248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3HZDez5QJRNnEZpzH/VvzJgZxkwEYeAMaFgHa8VqazyEdkeK/H2ae2drXBu6yp8p7CLynnxa8FYgkoegDdDbKOv2bxtVZioVTyp3aoO+c6gBBw18xcKu19VSsHob6CsQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.551640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-cd3d1ea3-ecb1-41f6-9aeb-76cb2919394c tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:34.557869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-cd3d1ea3-ecb1-41f6-9aeb-76cb2919394c tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:34.589142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:34.597982 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd3d1ea3-ecb1-41f6-9aeb-76cb2919394c tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.071359 Aug 30 17:42:34.599457 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1944/3702] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 17:42:34.612053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e36c05d5-454d-4ce9-9fd6-ab72293d1b43 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9cde2c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.625651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e36c05d5-454d-4ce9-9fd6-ab72293d1b43 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-272782248" status: 200 len: 512 microversion: 2.2 time: 0.018834 Aug 30 17:42:34.627008 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1945/3703] 10.222.0.50 () {60 vars in 1255 bytes} [Tue Aug 30 17:42:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-272782248 => generated 512 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:34.639897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-74aae8a2-cc7c-4872-ac6b-7d66561b8025 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9cd93ca0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.644678 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-74aae8a2-cc7c-4872-ac6b-7d66561b8025 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:42:34.653692 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-74aae8a2-cc7c-4872-ac6b-7d66561b8025 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.018838 Aug 30 17:42:34.654578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1946/3704] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 30 17:42:34 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:34.666580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64df3cea-9fc8-4e3f-8fac-0b65ee0f5661 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9ccd0700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.693318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-64df3cea-9fc8-4e3f-8fac-0b65ee0f5661 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272782248" status: 204 len: 0 microversion: 2.2 time: 0.032191 Aug 30 17:42:34.694596 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1947/3705] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 30 17:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272782248 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:34.711732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Action: 'create', calling method: .version_select at 0x7f2d99210f70>, body: {"keypair": {"name": "tempest-keypair-2115994916", "type": "x509"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.736320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:34.744737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:34.768078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.processutils [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp80v1h40x/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp80v1h40x/temp.key -subj /CN=6f62d88e9546471cb0aaf4e27709980d -extensions v3_req_client {{(pid=122124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 17:42:35.021216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.processutils [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp80v1h40x/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp80v1h40x/temp.key -subj /CN=6f62d88e9546471cb0aaf4e27709980d -extensions v3_req_client" returned: 0 in 0.253s {{(pid=122124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 17:42:35.022657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.processutils [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp80v1h40x/temp.key -password pass: {{(pid=122124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 17:42:35.065312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.processutils [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp80v1h40x/temp.key -password pass:" returned: 0 in 0.042s {{(pid=122124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 17:42:35.179829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:35.190986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Getting quotas for user 6f62d88e9546471cb0aaf4e27709980d and project b5eeb4e404534e069b9d0ea0860fe3e7. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:35.227695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0bf1986d-2922-46ca-9627-0e68a79bcba1 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.524748 Aug 30 17:42:35.233351 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1948/3706] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 530 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:42:35.245509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a0010d4-923e-4cb9-8ff7-12ed8c8633bc tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9cd9b040>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:35.255933 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a0010d4-923e-4cb9-8ff7-12ed8c8633bc tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-2115994916" status: 200 len: 1534 microversion: 2.2 time: 0.015391 Aug 30 17:42:35.256858 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1949/3707] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 30 17:42:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2115994916 => generated 1534 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:35.275346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b127e5cf-2bf6-42fe-8cbd-5d7668cb6f81 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d9cd93a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:35.280447 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-b127e5cf-2bf6-42fe-8cbd-5d7668cb6f81 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:42:35.305821 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b127e5cf-2bf6-42fe-8cbd-5d7668cb6f81 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.031128 Aug 30 17:42:35.306740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1950/3708] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 30 17:42:35 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:35.318994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2dcef02-c764-45ca-8eb6-e1a5fb219347 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] Calling method '.version_select at 0x7f2d98f68550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:35.372417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2dcef02-c764-45ca-8eb6-e1a5fb219347 tempest-KeyPairsV22TestJSON-1289179286 tempest-KeyPairsV22TestJSON-1289179286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115994916" status: 204 len: 0 microversion: 2.2 time: 0.056484 Aug 30 17:42:35.380452 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1951/3709] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Aug 30 17:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115994916 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:35.551020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:42:35.551649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:42:35.552793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:42:35.553114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:42:35.554468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:42:35.583849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:35.588709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:35.589160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:35.590487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:35.591595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:35.592033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:35.662564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:35.681289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:35.721346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:42:35.723888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:42:35.828140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3076a09-966c-4d7d-b310-2193dc54def9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500234 Aug 30 17:42:35.829106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1759/3710] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:42:35.843669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a6add68-6661-4c47-a6f0-5af5816fcd85 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:35.846322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a6add68-6661-4c47-a6f0-5af5816fcd85 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:35.963467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a6add68-6661-4c47-a6f0-5af5816fcd85 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:35.983008 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a6add68-6661-4c47-a6f0-5af5816fcd85 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6" status: 200 len: 1215 microversion: 2.1 time: 0.146374 Aug 30 17:42:35.983654 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1952/3711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:35 2022] GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:36.018715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:36.022579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:36.070358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:42:36.576748 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.scheduler.client.report [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Deleted allocations for instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 Aug 30 17:42:36.583833 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Instance Mapping does not exist while attempting local delete cleanup. Aug 30 17:42:36.584990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-294939da-4f28-4189-af5b-8e420fdb58e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6" status: 204 len: 0 microversion: 2.1 time: 0.580683 Aug 30 17:42:36.585743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1760/3712] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:36 2022] DELETE /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:36.595609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:36.596414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:36.636924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 HTTP/1.1 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '70aaf2cf-5306-4e9f-acd1-2de934fd07c6'} Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:36.640086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:36.645913 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:36.645913 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:36.645913 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:36.645913 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:42:36.645913 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:36.647162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:36.648335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1dd99824-22f4-42f6-8a69-1d9dbd124e1b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6" status: 404 len: 111 microversion: 2.1 time: 0.058260 Aug 30 17:42:36.649127 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1953/3713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:36 2022] GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:36.852067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-427167933", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:36.917460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:42:38.179572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:42:38.180792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:42:38.181819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:42:38.182422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:42:38.183674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:42:38.200894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.201377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.201824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.202531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.202981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.203402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.252792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:38.287555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:38.294432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:38.328879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:42:38.331069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:42:38.433421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83b6f808-1d3a-4937-8e24-2dbb5816442d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588891 Aug 30 17:42:38.435180 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1761/3714] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:42:38.448586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22e81ea2-3e60-42be-82d4-1c1272213d99 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:38.450215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-22e81ea2-3e60-42be-82d4-1c1272213d99 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:38.571106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-22e81ea2-3e60-42be-82d4-1c1272213d99 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:38.602043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-22e81ea2-3e60-42be-82d4-1c1272213d99 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1214 microversion: 2.1 time: 0.158347 Aug 30 17:42:38.604233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1954/3715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:38 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:38.797689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Calling method '.version_select at 0x7f2d938b90d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:38.814579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.815697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.816378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.817433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.818097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.818695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.843870 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-192b7268-88b5-4a49-82ce-3c683583b82a tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.313824 Aug 30 17:42:38.847173 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1762/3716] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 30 17:42:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:38.937882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1881121344", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:39.072442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:42:39.456898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Getting quotas for project 8ff012ceb67b4c71b565b74dd73253dd. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:42:39.483617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Getting quotas for user efaa1073d4c64e13b91985de47d97eff and project 8ff012ceb67b4c71b565b74dd73253dd. Resources: dict_keys(['metadata_items']) {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:42:39.516558 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Request method failure captured: Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 1752 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkwOYU1M-qPbVoTiri-NDQbqE26oUE5yJhguZzFFQ7c72S5jY4vBDPsegMPksBQ29Z3RGIgdRRSjF_ShYoXkV8Yl0WlTW0ZT-HmzFFzfrG4--6IsTnbVS-kYvFQ9lC1__QqAcriPZ38KMSX3PZxbq7I0SBicSEry_gWY68RBqLZ6JfY Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8ff012ceb67b4c71b565b74dd73253dd Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1657598653 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ff012ceb67b4c71b565b74dd73253dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ff012ceb67b4c71b565b74dd73253dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ff012ceb67b4c71b565b74dd73253dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ff012ceb67b4c71b565b74dd73253dd"}]}] Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1657598653 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8ff012ceb67b4c71b565b74dd73253dd Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1657598653 Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efaa1073d4c64e13b91985de47d97eff Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1881121344", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:42:39.519893 n-d-852771-11 devstack@n-api.service[122124]: exception: Maximum number of metadata items exceeds 128 Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1881121344', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:39.522815 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 30 17:42:39.526570 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.531391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:39.531391 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50228326-aa3b-4749-b0f2-f207251de277 tempest-AbsoluteLimitsNegativeTestJSON-1657598653 tempest-AbsoluteLimitsNegativeTestJSON-1657598653-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.599237 Aug 30 17:42:39.531391 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1955/3717] 10.222.0.50 () {60 vars in 1148 bytes} [Tue Aug 30 17:42:38 2022] POST /compute/v2.1/servers => generated 87 bytes in 601 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:42:39.629578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:39.630500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:39.641998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:39.643005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:39.645109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:39.648935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:39.649823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:39.651686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:39.823550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:39.854252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd3cebb6-b49e-4fa9-803d-ce6eb1967dfc tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1266 microversion: 2.1 time: 0.229560 Aug 30 17:42:39.873285 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1763/3718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:39 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:40.889078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:40.889714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:40.899463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:40.900599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:40.901569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:40.903954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:40.905794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:40.906906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:40.996059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:41.008070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-40600b4f-0f93-439d-a9b3-f4cabe3f1c56 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1272 microversion: 2.1 time: 0.125160 Aug 30 17:42:41.009431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1956/3719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:40 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:42.031857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:42.032507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:42.047205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:42.047747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:42.048213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:42.048942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:42.049407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:42.049837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:42.237728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:42.251331 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79b31b63-cd24-48b0-8b96-1b1dc26011df tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1272 microversion: 2.1 time: 0.223830 Aug 30 17:42:42.254849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1764/3720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:42 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:43.274151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:43.275209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:43.293544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:43.293874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:43.295981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:43.297017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:43.297693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:43.298142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:43.656322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:43.665503 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-265575e2-e60d-4480-9de4-c6c56674ffe8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.395119 Aug 30 17:42:43.666654 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1957/3721] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:43 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:44.688156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:44.689410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:44.696563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:44.708957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:44.709666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:44.710606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:44.711221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:44.711929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:45.266303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:45.293426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd37e94e-e702-463e-92e2-81254686b3f5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.609064 Aug 30 17:42:45.295135 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1765/3722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:44 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:46.321069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:46.321713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:46.334293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:46.334796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:46.335221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:46.335961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:46.336426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:46.345482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:46.655120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d804f2-fb42-410b-aad1-bee345bdc880", "tag": "9d689ae2-0854-45ca-95c8-4bdaea9578ad"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:46.674363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:46.684642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:46.685241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:46.704269 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] Creating event network-changed:9d689ae2-0854-45ca-95c8-4bdaea9578ad for instance 20d804f2-fb42-410b-aad1-bee345bdc880 on n-h1-852771-11 Aug 30 17:42:46.712587 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-806b0c5e-1e84-4fed-84d4-a66557c896f0 req-cca05786-7ce7-46a5-89d5-d949095955d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061596 Aug 30 17:42:46.717638 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1766/3723] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:46.972414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:47.001579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5e29b72-d00d-4853-b7de-0961687a04a7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.684800 Aug 30 17:42:47.002302 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1958/3724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:46 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:48.031819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:48.033457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:48.041239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:48.042121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:48.042863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:48.043930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:48.044642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:48.045311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:48.812446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=28 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:48.831980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:48.890990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:48.907038 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74cbf9d0-23b5-4abe-90aa-0a8a19c187f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.879894 Aug 30 17:42:48.912255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1767/3725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:48 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:49.932959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:49.934369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:49.942844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:49.966898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:49.970474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:49.970979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:49.973486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:49.976873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:49.977617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:50.339902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:50.355058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed63c83c-6760-4759-ae07-47c7817b514a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.426148 Aug 30 17:42:50.356339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1959/3726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:49 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:51.377543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:51.378285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:51.397144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:51.397638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:51.398080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:51.398798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:51.399255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:51.399754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:53.497535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:53.501779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:53.518874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:53.520524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:53.521183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:53.523047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:53.523766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:53.524547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:53.748742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:53.773192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 2.399547 Aug 30 17:42:53.775030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8ca18f4-d67e-4163-94ce-9d7bb80f5fc9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.283068 Aug 30 17:42:53.780888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1960/3727] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:53 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:42:53.786865 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1768/3728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:51 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:53.789637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:53.790471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:53.805429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:53.806997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:53.807666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:53.811539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:53.812327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:53.813027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:54.264093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:54.277907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1670 microversion: 2.1 time: 0.492509 Aug 30 17:42:54.288994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1961/3729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:53 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:54.596736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:54.597918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001446 Aug 30 17:42:54.598613 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1769/3730] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 30 17:42:54 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 17:42:54.606496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:54.608387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002833 Aug 30 17:42:54.609355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1962/3731] 10.222.0.50 () {54 vars in 1035 bytes} [Tue Aug 30 17:42:54 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 30 17:42:54.616425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:54.618115 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45ff0d29-4159-4398-bac5-e80b6c34e213 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 30 17:42:54.619085 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1770/3732] 10.222.0.50 () {54 vars in 1041 bytes} [Tue Aug 30 17:42:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:54.627460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:54.628986 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-358e6170-2f06-4655-8507-a0ad5eed9e82 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002228 Aug 30 17:42:54.629597 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1963/3733] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 30 17:42:54 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 17:42:54.811100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:54.811874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:54.822592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:54.835837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:54.839665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:54.841035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:54.844429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:54.845203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:55.309524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:55.310361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:55.319105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:55.321352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:55.322820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:55.324368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:55.332874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:55.333539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:55.808274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:55.826729 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f1c325b-0a9f-48ea-9e6f-2d3cd0f4d2a9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1670 microversion: 2.1 time: 0.520936 Aug 30 17:42:55.830412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1964/3734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:55 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1670 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:55.965783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:55.976050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0907decd-5479-4163-8c8c-a065cd36176f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 1.169683 Aug 30 17:42:55.981203 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1771/3735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:54 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:56.850362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:56.850997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:56.858908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:56.859410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:56.859876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:56.872798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:56.873542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:56.874170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:57.003863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:57.004594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:57.016780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:57.020936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:57.021845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:57.023859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:57.025936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:57.026679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:57.095340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:57.459606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:57.475613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7a9436c-e65e-4b0b-877a-33de9d97bbc0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.629067 Aug 30 17:42:57.478570 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1965/3736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:56 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:57.656689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:57.673449 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bdaeaac7-7a3a-4aa5-a123-a5dfc635e1b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.674502 Aug 30 17:42:57.681361 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1772/3737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:56 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:42:58.701024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:58.701631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:58.719024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:58.719555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:58.720052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:58.721349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:58.722058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:58.722703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:58.736732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:59.357464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:59.369204 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-673606f0-507e-4df6-8bb6-9d870b11227a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.672452 Aug 30 17:42:59.373527 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1966/3738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:58 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:00.392250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:00.393288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:00.407784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:00.408407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:00.408940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:00.412567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:00.413635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:00.414568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:00.892598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:00.906462 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ab6fe52-c164-4f6f-b6f8-bdb4a56d8f98 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.518704 Aug 30 17:43:00.922524 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1773/3739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:00 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:00.939070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d804f2-fb42-410b-aad1-bee345bdc880", "name": "network-vif-plugged", "status": "completed", "tag": "9d689ae2-0854-45ca-95c8-4bdaea9578ad"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:00.956139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:00.961372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:00.962015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:00.996707 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] Creating event network-vif-plugged:9d689ae2-0854-45ca-95c8-4bdaea9578ad for instance 20d804f2-fb42-410b-aad1-bee345bdc880 on n-h1-852771-11 Aug 30 17:43:01.012560 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e9f12bf1-d064-4e8d-800b-9583720fb5e2 req-4285d800-909c-4b8e-8a39-5b71bfda0186 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078651 Aug 30 17:43:01.013548 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1967/3740] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:01.773268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:01.773892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:01.787646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:01.788296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:01.788855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:01.790233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:01.792069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:01.795457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:01.853404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:43:01.930738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:01.931452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:01.947375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:01.948106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:01.948925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:01.949788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:01.950248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:01.950678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:02.121327 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-314bdebf-b36d-4ef7-81a5-344e014751f8 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 204 len: 0 microversion: 2.32 time: 0.777684 Aug 30 17:43:02.126134 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1774/3741] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:43:01 2022] DELETE /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:43:02.132815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:02.133653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:02.150011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:02.156076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:02.156856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:02.157692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:02.158234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:02.158725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:02.487446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:02.502369 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02c2439b-4941-4d48-9d65-f7ef861f1b63 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1314 microversion: 2.1 time: 0.575781 Aug 30 17:43:02.504163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1968/3742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:01 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:02.969128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:02.987288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:02.989710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:02.995214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc861362-4a06-47d1-9195-4d3be57b5575 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2950 microversion: 2.32 time: 0.865452 Aug 30 17:43:02.997354 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1775/3743] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:02 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2950 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:03.529538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:03.530290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:03.543775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:03.548079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:03.548896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:03.549910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:03.550616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:03.552011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:03.597030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Calling method '.version_select at 0x7f2d938b9d30>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:03.841085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:43:03.841736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.security_group_api [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Neutron security group 554413b4-9564-4f90-ae3b-87f003f44008 not found {{(pid=122124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:43:03.842284 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] HTTP exception thrown: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.842284 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Request method failure captured: Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-groups/554413b4-9564-4f90-ae3b-87f003f44008 HTTP/1.1 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkwmTO12LpNz6P8OZVE7f7dJt4PWAFJ3EHSuaEQ0P1tcVRveJzbvLm9W2jJ_EBQFiebSOidIbk0GpjAjgVcoAOQ07rE5eHI_zR2r1QriOMwcv8Tpqfl35M_0ePGAxLa1L-wLYqJcELnBw6TqkkyCTMngJL3llXHHbAcLbLqDgBksWY4 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2305632af6254e94ab0b4b3c032c26d3"}]}] Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c87bc326a2ea414ca16265beacb03c48 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: exception: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '554413b4-9564-4f90-ae3b-87f003f44008'} Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:43:03.844669 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Returning 404 to user: Security group 554413b4-9564-4f90-ae3b-87f003f44008 does not exist Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-af6b2c0b-9693-4abf-b37b-d460b0ee0bb5'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf50c227-2668-4a98-a4d8-052ab7713b12 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/554413b4-9564-4f90-ae3b-87f003f44008" status: 404 len: 194 microversion: 2.1 time: 0.803446 Aug 30 17:43:03.849153 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1969/3744] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:43:03 2022] DELETE /compute/v2.1/os-security-groups/554413b4-9564-4f90-ae3b-87f003f44008 => generated 194 bytes in 805 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:43:03.856979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48893be9-c221-4661-98eb-d1411881a40f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003888 Aug 30 17:43:03.867854 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1970/3745] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 30 17:43:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 17:43:03.878156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:03.892733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faee47dd-9984-4532-b550-a83b3c27a791 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Calling method '.version_select at 0x7f2d9cc5c0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:03.894316 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98fce390-2c3b-4439-9e40-ea227d39a340 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1500 microversion: 2.1 time: 0.369556 Aug 30 17:43:03.899422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1776/3746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:03 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1500 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:03.919193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:03.919827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:03.926970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:03.927465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:03.928007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:03.929576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:03.930324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:03.931008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:04.042763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15918a66-22d3-48dc-a04e-e3d5adf07e9e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880/action" status: 202 len: 0 microversion: 2.1 time: 0.125567 Aug 30 17:43:04.051004 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1777/3747] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:43:03 2022] POST /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:43:04.069155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:04.072133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:04.086188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:04.091900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:04.092436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:04.094376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:04.094942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:04.095441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:04.677926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:04.700134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:04.702011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:04.703632 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8da3a46-c44c-4549-9fda-f4d10a38d7f6 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2950 microversion: 2.32 time: 0.651071 Aug 30 17:43:04.716013 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1778/3748] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:04 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2950 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:04.732259 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-faee47dd-9984-4532-b550-a83b3c27a791 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.862765 Aug 30 17:43:04.733201 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1971/3749] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:43:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:04.735507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:04.736164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:04.745089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:04.745775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:04.746460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:04.746916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Calling method '.version_select at 0x7f2d991ca4c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:04.747175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:04.747667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:04.748097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.100402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:05.159784 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b05b184d-dbae-45b4-a62b-de59e4610a00 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1485 microversion: 2.1 time: 0.442347 Aug 30 17:43:05.178063 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1779/3750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:04 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1485 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:05.186771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:05.187492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:05.194765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.195255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.195792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.197164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.198968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.199853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.244428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:43:05.402918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64d04b95-01f8-4727-915b-452cc162c60a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 204 len: 0 microversion: 2.1 time: 0.221652 Aug 30 17:43:05.408467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1780/3751] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:43:05 2022] DELETE /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:43:05.416743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:05.417587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:05.427949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.428434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.429732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.434614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.434614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.434828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.849787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG neutronclient.v2_0.client [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:43:05.850519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 30 17:43:05.850519 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Request method failure captured: Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-security-groups/62f08b82-4479-4a21-b950-084394b64246 HTTP/1.1 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkwmTO12LpNz6P8OZVE7f7dJt4PWAFJ3EHSuaEQ0P1tcVRveJzbvLm9W2jJ_EBQFiebSOidIbk0GpjAjgVcoAOQ07rE5eHI_zR2r1QriOMwcv8Tpqfl35M_0ePGAxLa1L-wLYqJcELnBw6TqkkyCTMngJL3llXHHbAcLbLqDgBksWY4 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2305632af6254e94ab0b4b3c032c26d3"}]}] Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c87bc326a2ea414ca16265beacb03c48 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: exception: Insufficient rights for removing default security group. Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '62f08b82-4479-4a21-b950-084394b64246'} Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:43:05.853027 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: Neutron server returns request_ids: ['req-2e99a538-ea67-4f98-8720-5f9e8aa38aeb'] {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-251d7611-acb7-4222-840b-bb1bb6289836 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/62f08b82-4479-4a21-b950-084394b64246" status: 400 len: 182 microversion: 2.1 time: 1.112418 Aug 30 17:43:05.859143 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1972/3752] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:43:04 2022] DELETE /compute/v2.1/os-security-groups/62f08b82-4479-4a21-b950-084394b64246 => generated 182 bytes in 1114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:43:05.870365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:05.873790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:05.886183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=78,nova_api:DELETE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:05.895872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.896473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.902040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.902871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:05.903621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:05.904651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:05.919810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:05.936567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c52d6770-27db-4c8c-a5e9-72213579c348 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1491 microversion: 2.1 time: 0.526611 Aug 30 17:43:05.943365 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1781/3753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:05 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1491 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:05.957277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Calling method '.version_select at 0x7f2d939954c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:06.007795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:43:06.008648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Neutron security group 8496d8ad-b28d-40af-a597-ba47f5da16bc not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:43:06.010139 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] HTTP exception thrown: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.010139 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Request method failure captured: Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-security-groups/8496d8ad-b28d-40af-a597-ba47f5da16bc HTTP/1.1 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkwmTO12LpNz6P8OZVE7f7dJt4PWAFJ3EHSuaEQ0P1tcVRveJzbvLm9W2jJ_EBQFiebSOidIbk0GpjAjgVcoAOQ07rE5eHI_zR2r1QriOMwcv8Tpqfl35M_0ePGAxLa1L-wLYqJcELnBw6TqkkyCTMngJL3llXHHbAcLbLqDgBksWY4 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2305632af6254e94ab0b4b3c032c26d3"}]}] Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: c87bc326a2ea414ca16265beacb03c48 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8496d8ad-b28d-40af-a597-ba47f5da16bc'} Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:43:06.014375 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] Aug 30 17:43:06.020895 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.030727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Returning 404 to user: Security group 8496d8ad-b28d-40af-a597-ba47f5da16bc does not exist Aug 30 17:43:06.030727 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-373ab2a7-4253-4b6e-9fd1-2e0641e06148'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:06.031890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0be6de0a-7c93-40c1-8d62-b7ecc6b8b096 tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/8496d8ad-b28d-40af-a597-ba47f5da16bc" status: 404 len: 194 microversion: 2.1 time: 0.087447 Aug 30 17:43:06.037364 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1782/3754] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:43:05 2022] GET /compute/v2.1/os-security-groups/8496d8ad-b28d-40af-a597-ba47f5da16bc => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:43:06.046979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Action: 'update', calling method: .version_select at 0x7f2d93a75dc0>, body: {"security_group": {"name": "tempest-sg-770109318", "description": "tempest-description-224771440"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:06.089487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG neutronclient.v2_0.client [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist", "detail": ""}} {{(pid=122123) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 17:43:06.090271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.security_group_api [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Neutron security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 not found {{(pid=122123) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 17:43:06.091971 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] HTTP exception thrown: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.091971 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Request method failure captured: Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: request: PUT /compute/v2.1/os-security-groups/7842bee1-700d-4fdc-b00d-a3f9c418b460 HTTP/1.1 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 100 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkwmTO12LpNz6P8OZVE7f7dJt4PWAFJ3EHSuaEQ0P1tcVRveJzbvLm9W2jJ_EBQFiebSOidIbk0GpjAjgVcoAOQ07rE5eHI_zR2r1QriOMwcv8Tpqfl35M_0ePGAxLa1L-wLYqJcELnBw6TqkkyCTMngJL3llXHHbAcLbLqDgBksWY4 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2305632af6254e94ab0b4b3c032c26d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2305632af6254e94ab0b4b3c032c26d3"}]}] Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2305632af6254e94ab0b4b3c032c26d3 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-90134791 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: c87bc326a2ea414ca16265beacb03c48 Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-90134791-project Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: {"security_group": {"name": "tempest-sg-770109318", "description": "tempest-description-224771440"}} Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: exception: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '7842bee1-700d-4fdc-b00d-a3f9c418b460', 'body': {'security_group': {'name': 'tempest-sg-770109318', 'description': 'tempest-description-224771440'}}} Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 17:43:06.094153 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] Returning 404 to user: Security group 7842bee1-700d-4fdc-b00d-a3f9c418b460 does not exist Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: Neutron server returns request_ids: ['req-de94d6c8-997a-4958-887f-c2b6f8cc9ebd'] {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-01cabe86-3a05-4211-8e10-79a5fb565d2f tempest-SecurityGroupsNegativeTestJSON-90134791 tempest-SecurityGroupsNegativeTestJSON-90134791-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/7842bee1-700d-4fdc-b00d-a3f9c418b460" status: 404 len: 194 microversion: 2.1 time: 0.057201 Aug 30 17:43:06.098557 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1783/3755] 10.222.0.50 () {60 vars in 1290 bytes} [Tue Aug 30 17:43:06 2022] PUT /compute/v2.1/os-security-groups/7842bee1-700d-4fdc-b00d-a3f9c418b460 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:43:06.970629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:06.971505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:06.988925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:06.989790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:06.991589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:06.993852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:06.995665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:06.997925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:07.436625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:07.453674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:07.457973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:07.462742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2422586c-334a-4361-94be-8f79857fc390 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2950 microversion: 2.32 time: 1.604478 Aug 30 17:43:07.481638 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1973/3756] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:05 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2950 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:07.847158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:07.863234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70d1ea78-470c-4db2-8672-1c2a93c292f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1491 microversion: 2.1 time: 0.901441 Aug 30 17:43:07.886365 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1784/3757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:06 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1491 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:08.498904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:08.507397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:08.525279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:08.529628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:08.530452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:08.531443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:08.533425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:08.534376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:08.889080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:08.890810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:08.894772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:08.913558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:08.918921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:08.918921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:08.918921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:08.918921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:08.918921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:09.156263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:09.172118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:09.176033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:09.179040 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9c6efd99-db61-4a86-9ce2-4717a1f56bbe tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2929 microversion: 2.32 time: 0.688226 Aug 30 17:43:09.180755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1974/3758] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:08 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2929 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:09.269693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:09.280843 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04c561f8-ce53-4c1a-8042-23047bd48fda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 200 len: 1449 microversion: 2.1 time: 0.395761 Aug 30 17:43:09.281448 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1785/3759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:08 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 1449 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:09.447040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d804f2-fb42-410b-aad1-bee345bdc880", "name": "network-vif-deleted", "tag": "9d689ae2-0854-45ca-95c8-4bdaea9578ad"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:09.500440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:09.501132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:09.501933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:09.559784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] Creating event network-vif-deleted:9d689ae2-0854-45ca-95c8-4bdaea9578ad for instance 20d804f2-fb42-410b-aad1-bee345bdc880 on n-h1-852771-11 Aug 30 17:43:09.582174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d5762093-a8fd-4bcb-a05d-1ebdc4ad50c1 req-c281e924-4200-4770-9901-acbf2f2fb3f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131029 Aug 30 17:43:09.585017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1975/3760] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:09.888868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-unplugged", "status": "completed", "tag": "1efd1cbc-14b8-4af8-af6a-74336c6365e6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:09.909599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:09.910267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:09.912322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:09.946567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] Creating event network-vif-unplugged:1efd1cbc-14b8-4af8-af6a-74336c6365e6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:09.973380 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9d59c390-0d3c-4fa1-91e5-37fe0ed00b2d req-c55c0c66-d507-48f9-a978-fe65fd4cf3fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088904 Aug 30 17:43:09.974417 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1786/3761] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:10.212873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:10.214505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:10.224292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:10.227036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:10.227763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:10.228790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:10.232443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:10.233267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:10.312920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:10.313856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:10.328893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:10.334609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:10.335331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:10.340630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:10.341186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:10.341631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:10.344926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:10.389348 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 HTTP/1.1 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '20d804f2-fb42-410b-aad1-bee345bdc880'} Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:10.399362 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:43:10.405404 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:10.419908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:10.419908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53c78b44-5f11-4f80-81c2-316ed4793293 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 404 len: 111 microversion: 2.1 time: 0.101027 Aug 30 17:43:10.421801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1787/3762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:10 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:43:10.774435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1304705035", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:10.816079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:10.826365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:10.842317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:10.843766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83423087-1a4b-4ece-8833-fd460172952c tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2908 microversion: 2.32 time: 0.640871 Aug 30 17:43:10.852332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1976/3763] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:10 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2908 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:10.907026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:43:11.755176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-deleted", "tag": "e09b0ace-5e6d-4599-8184-2fba845cccf9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:11.796527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:11.800784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:11.807190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:11.840924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] Creating event network-vif-deleted:e09b0ace-5e6d-4599-8184-2fba845cccf9 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:11.873775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-59f25e8e-c851-4334-8cf2-f076d5a5091f req-8bfa1cfe-ae7d-4b14-9d4a-39793648ffaf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121672 Aug 30 17:43:11.875647 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1977/3764] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:43:11.881170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:11.886871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:11.902597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:11.903589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:11.905728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:11.923022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:11.923672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:11.924144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:12.815595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:43:12.818178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:43:12.819102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:43:12.820290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:43:12.821549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:43:12.837157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:12.837840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:12.838447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:12.840630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:12.841289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:12.842945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:12.868640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:43:12.876392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:43:12.897639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:43:12.901789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:43:12.995183 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a4c91bff-9ebc-4519-98aa-9eed7b395b0c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222796 Aug 30 17:43:12.996994 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1788/3765] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:43:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:43:13.002438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-unplugged", "status": "completed", "tag": "e09b0ace-5e6d-4599-8184-2fba845cccf9"}, {"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-unplugged", "status": "completed", "tag": "8cfef511-9507-4a90-acfe-8095b6186336"}, {"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-unplugged", "status": "completed", "tag": "9e866e5a-f52d-4312-8c67-fb8506e0b7a6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:13.019522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:13.020217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:13.021313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:13.029272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:13.040685 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Creating event network-vif-unplugged:e09b0ace-5e6d-4599-8184-2fba845cccf9 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:13.041196 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Creating event network-vif-unplugged:8cfef511-9507-4a90-acfe-8095b6186336 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:13.041754 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] Creating event network-vif-unplugged:9e866e5a-f52d-4312-8c67-fb8506e0b7a6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:13.049459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:13.050468 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-bad67117-20d1-4e4c-bfe1-c347bdccdf2d req-b345d463-8716-49e0-94e4-0dd24ef6e8f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.051922 Aug 30 17:43:13.051083 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1789/3766] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:13.055648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:13.058591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c833d741-800c-4720-9480-3f135c567c8b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2862 microversion: 2.32 time: 1.181684 Aug 30 17:43:13.059833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d552db3-645c-4ae2-b13f-18eff15f53f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:13.060729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5d552db3-645c-4ae2-b13f-18eff15f53f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:13.075146 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1978/3767] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:11 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2862 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:13.673043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5d552db3-645c-4ae2-b13f-18eff15f53f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:13.681657 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d552db3-645c-4ae2-b13f-18eff15f53f1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1215 microversion: 2.1 time: 0.629069 Aug 30 17:43:13.684875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1790/3768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:13 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1215 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:14.090102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:14.090813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:14.102607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-deleted", "tag": "2e46b3c6-fd82-4521-b768-ee324e18d75b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:14.121102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:14.121992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:14.122966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:14.124063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:14.125079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:14.125689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:14.125920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:14.126408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:14.126838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:14.195758 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] Creating event network-vif-deleted:2e46b3c6-fd82-4521-b768-ee324e18d75b for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:14.210412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-55815184-869e-4d05-b886-789ea50b51da req-18b35670-f93e-421b-a189-1a5b29c2ca23 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113380 Aug 30 17:43:14.211692 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1791/3769] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:43:14.606894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:14.633371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:14.638668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:14.647773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-077efeb3-ae17-471d-b9d6-0ec017f8d92d tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2702 microversion: 2.32 time: 0.559099 Aug 30 17:43:14.652693 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1979/3770] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:14 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2702 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:14.713283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:14.715169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:14.749202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:14.750892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:14.751557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:14.752954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:14.754104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:14.754905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:15.125854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-unplugged", "status": "completed", "tag": "2e46b3c6-fd82-4521-b768-ee324e18d75b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:15.159861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:15.168127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:15.169928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:15.173107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:15.176742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d56705f-7b0c-4136-bd92-18521197c9aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1267 microversion: 2.1 time: 0.471819 Aug 30 17:43:15.178864 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1792/3771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:14 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1267 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:15.200090 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] Creating event network-vif-unplugged:2e46b3c6-fd82-4521-b768-ee324e18d75b for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:15.205440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5772d9f9-e2ad-4c7e-8ad4-acc02d5523f2 req-7c8ac536-d850-4ed9-8425-1ef4ea908807 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097508 Aug 30 17:43:15.207199 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1980/3772] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:43:15.680101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:15.681096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:15.692886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:15.694602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:15.695268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:15.696226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:15.702469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:15.703270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:16.208455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:16.210937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:16.222100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:16.223098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:16.224148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:16.225311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:16.227657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:16.228293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:16.457450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:16.472928 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea5e8d59-a030-46cf-a900-96ee3587e592 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1273 microversion: 2.1 time: 0.268981 Aug 30 17:43:16.475125 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1981/3773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:16 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:16.506137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-deleted", "tag": "8cfef511-9507-4a90-acfe-8095b6186336"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:16.561241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:16.564058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:16.566939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:16.593601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] Creating event network-vif-deleted:8cfef511-9507-4a90-acfe-8095b6186336 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:16.608853 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0892b356-ffa9-4ccc-a3cc-11fff82ad9e7 req-ec9f419d-468f-440d-b13d-6e50f7b6dc2e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121741 Aug 30 17:43:16.609482 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1982/3774] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:17.233637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:17.250999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:17.255345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:17.256703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8c3bdba-8cf6-4370-aef8-040d6c9d2abc tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2500 microversion: 2.32 time: 1.581013 Aug 30 17:43:17.257277 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1793/3775] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:15 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2500 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:17.504259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:17.504978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:17.513141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:17.513633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:17.514206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:17.514984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:17.515769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:17.516202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:17.594847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:17.606375 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99888c27-01c2-4080-93d3-b55baa8d6509 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1273 microversion: 2.1 time: 0.106597 Aug 30 17:43:17.607217 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1983/3776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:17 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:18.288223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:18.289138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:18.300756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:18.301249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:18.301686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:18.302423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:18.302881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:18.303310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:18.628743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:18.630093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:18.640325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:18.640971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:18.641512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:18.642384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:18.642934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:18.643431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:19.045482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:19.078909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:19.080950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:19.082521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-362653c9-706c-447b-a76d-7ac926ae5add tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2386 microversion: 2.32 time: 0.798874 Aug 30 17:43:19.083520 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1794/3777] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:18 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2386 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:19.349098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:19.362547 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b20b6fa-5ba5-4578-a5f5-5ef3dca31b80 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.737313 Aug 30 17:43:19.368706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1984/3778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:18 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:19.410806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-deleted", "tag": "1efd1cbc-14b8-4af8-af6a-74336c6365e6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:19.421878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:19.430399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:19.431736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:19.464136 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] Creating event network-vif-deleted:1efd1cbc-14b8-4af8-af6a-74336c6365e6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:19.471727 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-49221ea5-54e9-4995-b5c4-747232bf65bb req-501075bf-3665-45b3-adcb-f28288e95dbd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066755 Aug 30 17:43:19.472943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1795/3779] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:20.111306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:20.112948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:20.123384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:20.124140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:20.125086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:20.127327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:20.128032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:20.128655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:20.392844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:20.394009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:20.401661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:20.402253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:20.402814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:20.403801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:20.404481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:20.406132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:20.649090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:20.668404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:20.671021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:20.674188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a24e01d-a613-4152-804f-b0a7794f3d63 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2227 microversion: 2.32 time: 0.567257 Aug 30 17:43:20.675936 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1985/3780] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:20 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2227 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:20.994125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:21.008819 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1fe8f382-ef78-4257-8eb4-8bcbd9673e8f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.620951 Aug 30 17:43:21.009718 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1796/3781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:20 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:21.705120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:21.707358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:21.743140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:21.743796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:21.744263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:21.747765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:21.753702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:21.755099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:21.842301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6ccca7-8376-4206-ab07-3649442c8f45", "tag": "21dd566c-e305-40e4-bfb5-190e32766b84"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:21.873111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:21.875749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:21.879290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:21.930775 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] Creating event network-changed:21dd566c-e305-40e4-bfb5-190e32766b84 for instance 1e6ccca7-8376-4206-ab07-3649442c8f45 on n-h1-852771-11 Aug 30 17:43:21.952182 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0f3fb265-944d-4fdf-8971-d35bd272ec59 req-09973e7f-d01d-4ee3-a707-d42585985c2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114187 Aug 30 17:43:21.952826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1797/3782] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:43:22.032502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:22.033338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:22.048723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:22.052177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:22.056802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:22.061348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:22.062311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:22.066678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:22.089726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:22.131675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:22.133367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:22.145696 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06649ccd-5813-4de0-8232-18e09eb788e1 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 2160 microversion: 2.32 time: 0.435821 Aug 30 17:43:22.150757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1986/3783] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:21 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 2160 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:22.856604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:23.065519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:23.098588 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3401c037-ebcf-47d6-8b7e-994def1d13f3 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 1.071187 Aug 30 17:43:23.099221 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1798/3784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:22 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:23.174857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:23.176053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:23.191020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:23.191960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:23.192566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:23.194172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:23.194787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:23.196860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:23.340017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:23.350131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:23.361929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:23.363206 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fe9a0f3-ca17-4811-bb22-f62503e71bca tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.193841 Aug 30 17:43:23.364416 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1987/3785] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:23 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:23.999239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a1d765-84d8-4fcd-a03c-0e699b77ca56", "name": "network-vif-deleted", "tag": "9e866e5a-f52d-4312-8c67-fb8506e0b7a6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:24.007396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:24.029747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:24.030827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:24.031473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:24.053562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] Creating event network-vif-deleted:9e866e5a-f52d-4312-8c67-fb8506e0b7a6 for instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 on n-h2-852771-11 Aug 30 17:43:24.064615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-29aa50bb-1f76-4921-8fe7-593dedaff850 req-b783fb92-449f-4098-8386-77f305d2349c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074678 Aug 30 17:43:24.065934 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1799/3786] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:24.121005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:24.121826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:24.132200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:24.133649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:24.135187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:24.136584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:24.136963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:24.137400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:24.392633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:24.393326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:24.406005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:24.411087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:24.411743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:24.413504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:24.418528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:24.421189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:24.609736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:24.626842 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b4be476-2076-4e1e-b93c-38cd8acb8385 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.510436 Aug 30 17:43:24.633371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1988/3787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:24 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:24.873284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:24.882902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:24.889109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:24.898777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78865cf2-8a13-4ea5-b5bd-1bd28e4f9307 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.510530 Aug 30 17:43:24.899919 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1800/3788] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:24 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:25.665265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:25.668039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:25.676678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:25.678065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:25.678780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:25.679927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:25.680542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:25.681137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:25.926608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:25.927348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:25.940171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:25.940671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:25.941109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:25.941821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:25.942275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:25.942697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:26.100778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:26.117225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:26.129459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:26.130761 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d16c4071-cd75-47a0-a8ad-e5a0c5e58217 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.208153 Aug 30 17:43:26.131378 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1801/3789] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:25 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:43:26.425819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:26.437391 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-692bec0d-0042-4a46-b45f-e24f4672829b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.785832 Aug 30 17:43:26.456062 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1989/3790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:25 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:27.157327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:27.157953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:27.168504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:27.169231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:27.169824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:27.170945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:27.171657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:27.172234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:27.462350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:27.463089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:27.478959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:27.481405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:27.482073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:27.483015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:27.484603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:27.485441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:27.535691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:27.538574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:27.556244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:27.561136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:27.564703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5ce1053-ea0b-44c8-bfe7-d38b0d7f4c72 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.411945 Aug 30 17:43:27.566173 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1802/3791] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:27 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:27.834527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:27.844220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7997a315-ec5d-4025-b30c-58c8aff4e08f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.385897 Aug 30 17:43:27.860722 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1990/3792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:27 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:28.592600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:28.594126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:28.610929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:28.613875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:28.614726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:28.615994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:28.618711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:28.619985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:28.722477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:28.738906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:28.748267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:28.751000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-01aee18f-e049-4ac0-9e7a-1ed0f01f6825 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.163020 Aug 30 17:43:28.763512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1803/3793] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:28 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:28.814519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ccca7-8376-4206-ab07-3649442c8f45", "name": "network-vif-plugged", "status": "completed", "tag": "21dd566c-e305-40e4-bfb5-190e32766b84"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:28.856847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:28.857642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:28.859155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:28.865104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:28.866070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:28.875770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:28.878832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] Creating event network-vif-plugged:21dd566c-e305-40e4-bfb5-190e32766b84 for instance 1e6ccca7-8376-4206-ab07-3649442c8f45 on n-h1-852771-11 Aug 30 17:43:28.879157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:28.880638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:28.885606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:28.886317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:28.886863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:28.887636 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-90f60a6f-0a21-4020-be9e-12254f9206a8 req-52f15b9d-f786-426e-a2bd-a085ab76f75a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089254 Aug 30 17:43:28.888805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1991/3794] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:29.214637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:29.223185 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5787129d-34c4-4b30-8630-adae24b92304 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1315 microversion: 2.1 time: 0.362236 Aug 30 17:43:29.228001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1804/3795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:28 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:29.502554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:29.503581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:29.512416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.513123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.514504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:29.515618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.516364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.516937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:29.778549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:29.779886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:29.788999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.790072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.791829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:29.793155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.793885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.794451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:29.845265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:29.862571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ede5c525-1c66-4b16-8352-7334c0458b8c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.364449 Aug 30 17:43:29.864747 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1992/3796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:29 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:29.890249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:29.890879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:29.903049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.903654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.905368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:29.906560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:29.908186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:29.910277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:30.236577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:30.281537 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b30aed3-a245-4f81-b0b5-33a1d6fba64b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.396531 Aug 30 17:43:30.297022 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1993/3797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:29 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:30.317943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:30.318609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:30.329319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:30.333495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:30.333954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:30.334705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:30.335772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:30.336215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:30.486934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:30.519300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:30.525020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:30.530991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-716eda11-6b51-4dc6-b4b6-2fe8b4187405 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.757584 Aug 30 17:43:30.532794 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1805/3798] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:29 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:30.555017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:30.559659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:30.581789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:30.582288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:30.588643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:30.592168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:30.594111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:30.596296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.001945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:31.020644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc41187f-655f-402c-8c51-34a3f230a64a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1502 microversion: 2.1 time: 0.722364 Aug 30 17:43:31.022369 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1994/3799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:30 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1502 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:31.058761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:31.059588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:31.096231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.099689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.105592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.109023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.111436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.114429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.201735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lazy-loading 'flavor' on Instance uuid 1e6ccca7-8376-4206-ab07-3649442c8f45 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:43:31.515180 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef1fa3e6-e2c2-463a-9ed4-5055997ea522 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45/action" status: 202 len: 0 microversion: 2.1 time: 0.467206 Aug 30 17:43:31.516510 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1995/3800] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:43:31 2022] POST /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:43:31.544393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:31.550078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:31.573109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.573926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.574378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.575129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.575615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.576047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.651615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:31.667402 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae959d6c-45f9-4650-bbc6-eaac7e80c789 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 1.128106 Aug 30 17:43:31.668856 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1806/3801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:30 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:31.678212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:31.679181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:31.693018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.693661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.694104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.694987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.695448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.695979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.828796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:31.845711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:31.850068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:31.852162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf6f4cc6-f9f1-4825-b30e-a2e52a8bacab tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.181914 Aug 30 17:43:31.852895 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1807/3802] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:31 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:31.877086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:31.877970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:31.886692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.887394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.891002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:31.892388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:31.893025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:31.893715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:32.152848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:32.161283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8dc12dd-f9a7-4b73-9fc1-6140cbe49262 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.639100 Aug 30 17:43:32.164166 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1996/3803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:31 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:32.431808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:32.442921 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7048ca2e-40b1-4fe9-ab82-f7d88766f6de tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.569757 Aug 30 17:43:32.447610 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1808/3804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:31 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:32.687750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1169833487", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "59938744-e1cd-4152-9402-9a2134605439"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:32.823031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] validate_networks() for [('59938744-e1cd-4152-9402-9a2134605439', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:43:32.882603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:32.883263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:32.894985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:32.895397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:32.895858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:32.896591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:32.897040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:32.897462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:32.962530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:33.179498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:33.211784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:33.216111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:33.229737 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7d51c64-f7ab-48bc-8b70-032a41a9cd5b tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.356164 Aug 30 17:43:33.254529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1809/3805] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:32 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:33.262088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:33.263104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:33.272111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:33.272857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:33.273448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:33.274929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:33.276316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:33.277999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:33.742066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:33.754487 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c9c0229-b40d-4134-add6-477b67b5963e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.498483 Aug 30 17:43:33.756439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1810/3806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:33 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:34.269348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:34.271142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:34.279735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.280964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.281718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.282863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.283644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.284272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.436883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:34.451882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:34.455754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:34.460611 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a256b91b-6e3c-43a9-ae81-472babf64e0a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.200413 Aug 30 17:43:34.462850 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1811/3807] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:34 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:43:34.568122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:43:34.569371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:43:34.570001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:43:34.570734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:43:34.571467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:43:34.592690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.593427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.603120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.604289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.606544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.608148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.657816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:43:34.675548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:43:34.712533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:43:34.723198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:43:34.779080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:34.780070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:34.797651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.800811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.801270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.802000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:34.802455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:34.802883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:34.840432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb514f5c-d140-4d1a-ba98-aebe23f1e07f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.158405 Aug 30 17:43:34.844264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1997/3808] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:43:34.861515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10e5138a-22ff-4994-8eaf-d3c0a8f8f782 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:34.866200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-10e5138a-22ff-4994-8eaf-d3c0a8f8f782 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:34.995887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-10e5138a-22ff-4994-8eaf-d3c0a8f8f782 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:35.009111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10e5138a-22ff-4994-8eaf-d3c0a8f8f782 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1215 microversion: 2.1 time: 0.152908 Aug 30 17:43:35.011062 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1998/3809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:34 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:35.425101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:35.441235 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b561dc9e-c8e6-4782-9d98-7d542ad07fb6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.668145 Aug 30 17:43:35.449622 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1812/3810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:34 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:35.487083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:35.487692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:35.524223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:35.524770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:35.530086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:35.533392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:35.536242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:35.538422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:35.723235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:35.743776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:35.747793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:35.752904 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2fdfffb1-c2b9-41dc-b37e-8ef1597c0c78 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.269911 Aug 30 17:43:35.754985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 1999/3811] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:35 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:35.954268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72a2edd5-78a4-43ca-8447-1bda93b9d268 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Action: 'create', calling method: .version_select at 0x7f2d93a5b3a0>, body: {"keypair": {"name": "tempest-keypair-764243328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr08NXWoUWmaQnANwu0bcqRfUZAR83VJObaefxD+3hrAnsroktnXYm2TTwEJnk+Puara8dZYq7Q9rv9qy/urW0UKk0fYHg7gVxvtRqQYkynn5BdyXhD/AqTxBizQfWvzw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:36.033595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-72a2edd5-78a4-43ca-8447-1bda93b9d268 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for project 848833b99ee74c5f828a06638a56cb64. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:43:36.034959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:36.036006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:36.052120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:36.054436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-72a2edd5-78a4-43ca-8447-1bda93b9d268 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for user ed73f24596f749a2a3ec3e86cd35630a and project 848833b99ee74c5f828a06638a56cb64. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:43:36.057430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.058327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.058927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.061841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.062490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.063080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.160504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72a2edd5-78a4-43ca-8447-1bda93b9d268 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.572003 Aug 30 17:43:36.167093 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1813/3812] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:43:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:36.233273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:36.248675 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea14dcda-58bd-410c-b13d-44ec36a91551 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1219 microversion: 2.1 time: 0.220673 Aug 30 17:43:36.271978 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2000/3813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:36 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:36.474940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:36.475985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:36.493921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.495936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.497651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.499543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.500111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.500554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.787091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:36.787822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:36.803526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.805197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.807011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.808232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:36.812124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:36.813832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:36.962633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:36.985501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:36.989819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:36.993261 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5cf59569-9f7a-4aa9-8105-ff137bf5017a tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.214212 Aug 30 17:43:36.995869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2001/3814] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:36 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:37.269068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:37.285473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75b87c8b-a4e9-4cd9-a494-cacb0e912a7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.819153 Aug 30 17:43:37.289399 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1814/3815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:36 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:37.303286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:37.303286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:37.328381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:37.330924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:37.332304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:37.335944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:37.337420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:37.338716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:37.464589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:37.477686 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5dcdee4b-e50c-4318-abe4-688155471f8f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1285 microversion: 2.1 time: 0.203696 Aug 30 17:43:37.484236 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2002/3816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:37 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:38.021184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:38.022042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:38.034340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.036207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.040439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.042844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.043629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.045361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.274227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:38.297222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:38.300741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:38.307121 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1433c33e-5ee7-4774-8db0-d051e1b8111f tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.288847 Aug 30 17:43:38.308058 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1815/3817] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:38 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:38.316188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:38.317385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:38.334857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.335543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.339905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.341034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.341528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.341976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.507603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:38.508119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:38.521578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.522084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.522517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.524016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:38.526796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:38.527246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:38.646650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:38.658656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12e99c71-b0e6-4a23-b6c7-23aeb6afccb5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.351502 Aug 30 17:43:38.660219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2003/3818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:38 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:38.774756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:38.784385 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1c51be3-e899-40eb-bdf6-3c593886fbfb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1273 microversion: 2.1 time: 0.281419 Aug 30 17:43:38.796570 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1816/3819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:38 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:39.340787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:39.341491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:39.364452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.365152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.365384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:39.366092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.366551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.366979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:39.516935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:39.533942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:39.535798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:39.537221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a05e8be-9ab3-483e-bc45-b02ea3e39d29 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.209701 Aug 30 17:43:39.539069 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2004/3820] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:39 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:39.681300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:39.682796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:39.687003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:39.704173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.704708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.705164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:39.711109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.711652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.712107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:39.807562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:39.808195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:39.821393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.822107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.826160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:39.827172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:39.827897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:39.828540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:40.286092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:40.314632 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f2dbdaee-e0e5-4753-ad86-f0cce0ab6330 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.509137 Aug 30 17:43:40.316740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2005/3821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:39 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:40.563930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:40.564764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:40.574965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:40.596530 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-202f92f4-2163-45cb-abef-cdf21e406433 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.918178 Aug 30 17:43:40.597815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1817/3822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:39 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:40.615588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:40.616358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:40.617045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:40.618065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:40.618736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:40.620951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:40.787187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:40.812332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:40.814272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:40.815756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9db60a0-57c9-4b57-b985-fae35a30e99e tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.256350 Aug 30 17:43:40.816863 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2006/3823] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:40 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:41.347720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:41.348540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:41.372656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.377453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.378419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:41.380355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.381496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.384455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:41.624597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:41.625226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:41.647770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.657075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.662975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:41.664303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.669100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.673578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:41.699883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:41.898092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:41.915499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa0ec556-a9af-4bab-857c-22e73ba7e02f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.572466 Aug 30 17:43:41.918562 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1818/3824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:41 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:41.936420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:41.945954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:41.972834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.973506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.975580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:41.976448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:41.982302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:41.984164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:42.205688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:42.217589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:42.234327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:42.236231 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55eee283-b36d-4c74-a567-a473569deeda tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.313491 Aug 30 17:43:42.243630 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1819/3825] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:41 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:42.271155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:42.280408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ecffa38-628a-4129-8b17-6c66af5aa76f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.661660 Aug 30 17:43:42.291534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2007/3826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:41 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:42.938457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:42.939204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:42.952356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:42.953184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:42.954078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:42.956918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:42.968186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:42.968988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.064507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e592710-30bd-4e8d-afe4-3e1d0743e1ed", "tag": "2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:43.079263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:43.087403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:43.088536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.117403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] Creating event network-changed:2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4 for instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed on n-h2-852771-11 Aug 30 17:43:43.135020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8c26b75e-0c3a-40f0-ba03-c0b14950acf6 req-fa41a0de-add4-4c31-925a-d4d37d0f614f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072442 Aug 30 17:43:43.137482 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2008/3827] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:43.285591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:43.289473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:43.309120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:43.309839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:43.310681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.311566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:43.312161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:43.312753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.366882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:43.376468 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3335636-6357-4ee1-a3af-e0e77084c022 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.441895 Aug 30 17:43:43.382795 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1820/3828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:42 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:43.390505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:43.394751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:43.411354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:43.414965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:43.415457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:43.416819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.417583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:43.418400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:43.418855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:43.428458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:43.429918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:43.431136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2fe1bd34-f900-4194-a964-83b1aab0bbec tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.164108 Aug 30 17:43:43.443580 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2009/3829] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:43 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:43.940723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:43.953249 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5e8708c-9de6-49cc-bc6b-2d6e6b4bb16f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.569053 Aug 30 17:43:43.971913 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1821/3830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:43 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:44.402982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:44.404538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:44.413666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.414790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.415465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:44.424867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.425673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.426014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:44.455928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:44.456635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:44.467667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.474322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.480779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:44.481935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.482432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.483862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:44.637110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:44.703945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:44.714912 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-987af5f6-28a1-42f0-8742-ad3522115744 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.316657 Aug 30 17:43:44.715557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2010/3831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:44 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:44.876770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:44.887343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:44.888823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:44.890068 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8907fc27-92c1-4aaa-9a8c-87cf2d11ca32 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1605 microversion: 2.32 time: 0.438280 Aug 30 17:43:44.909911 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1822/3832] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:44 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1605 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:44.978974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:44.979553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:44.988081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.988838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.989280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:44.994477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:44.995008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:44.995534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:45.007466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:45.422383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:45.435801 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52e1e0b2-c4b5-4b29-b116-6aa39e91acda tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.461021 Aug 30 17:43:45.437203 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2011/3833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:44 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:45.741198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:45.742647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:45.754932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:45.755423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:45.755880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:45.756573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:45.760646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:45.761787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:45.920663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:45.922852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:45.940924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:45.941418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:45.941855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:45.942567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:45.947954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:45.950095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:46.059161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:46.059720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:46.060176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:46.060648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lazy-loading 'fault' on Instance uuid e2a1d765-84d8-4fcd-a03c-0e699b77ca56 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:43:46.093095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:46.191430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:46.205304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:46.207126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3425189160ed4a2ca2eede57b605bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a7e4b51e574eedbd25ece987c09b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:46.209083 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95dc07f0-c399-4534-9e2c-c8e3400839ae tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 200 len: 1610 microversion: 2.32 time: 0.294230 Aug 30 17:43:46.210715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2012/3834] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:45 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 1610 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:43:46.460709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:46.461306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:46.480592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:46.481085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:46.482449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:46.483186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:46.483905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:46.484348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:46.544410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:46.559688 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ceaaa8ca-5774-4fce-9b9f-5e5c463bc1c6 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.823739 Aug 30 17:43:46.560332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1823/3835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:45 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:46.939042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:46.948368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f534441d-933a-4d36-bbfa-697f9940425f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.494660 Aug 30 17:43:46.949306 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2013/3836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:46 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:47.240764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:47.241488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:47.251930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.252688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.253316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:47.254244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.255113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.255748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:47.276942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] HTTP exception thrown: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Request method failure captured: Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 HTTP/1.1 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkq9DRzGXagcQkNCKmqX4mx5GZzD3KXkmAvfnpcBPuHNRMx7cZVtenPp-26iVtPmHD6elogg8KKc9d3IK6e0EmATvmgz3B56il-gFskVAYcoYJ7aKfPFjG1gC8yhVL25Lh-xpTTp9KGm1hCTk_ZDKJXCxG9qxqFXOUvszXpTd81lOGI Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90a7e4b51e574eedbd25ece987c09b8f"}]}] Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 3425189160ed4a2ca2eede57b605bf66 Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'e2a1d765-84d8-4fcd-a03c-0e699b77ca56'} Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:47.278874 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Returning 404 to user: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:47.282211 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b03d6f2-9089-498f-8feb-27d4c0b716af tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 404 len: 111 microversion: 2.32 time: 0.045603 Aug 30 17:43:47.284482 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1824/3837] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:47 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:43:47.291457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb1c6ec5-38fe-4490-bc42-cbb00335c487 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '.version_select at 0x7f2d9cc5c0d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:47.328374 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb1c6ec5-38fe-4490-bc42-cbb00335c487 tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907443127" status: 204 len: 0 microversion: 2.32 time: 0.040395 Aug 30 17:43:47.330838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2014/3838] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907443127 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:43:47.585009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:47.585884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:47.596812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.597487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.600040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:47.600917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.602569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.603817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:47.881854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:47.892608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ae77ed1-f2ac-4be5-9811-b3ba90f75cda tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.311418 Aug 30 17:43:47.893866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1825/3839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:47 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:47.971556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:47.972312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:47.986406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.986926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.989491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:47.992946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:47.993450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:47.997888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:48.438069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:48.450940 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9be8ae3-124a-4a04-9a68-d17d84f91e59 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.483505 Aug 30 17:43:48.454105 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2015/3840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:47 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:48.915453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:48.916818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:48.927299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:48.928232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:48.928867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:48.929847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:48.930494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:48.931175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:49.224278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:49.234020 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17b46bd6-cbc9-4301-a68f-bae09034e54f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.323157 Aug 30 17:43:49.238837 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1826/3841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:48 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:49.480563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:49.481879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:49.491584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:49.492355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:49.493015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:49.496551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:49.497248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:49.504404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:49.674971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e592710-30bd-4e8d-afe4-3e1d0743e1ed", "name": "network-vif-plugged", "status": "completed", "tag": "2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:49.694531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:49.697902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:49.699991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:49.719936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:49.732747 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee3ad132-a97c-4a90-9fb1-6f89a8562e83 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.257298 Aug 30 17:43:49.753931 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2016/3842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:49 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:49.756678 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] Creating event network-vif-plugged:2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4 for instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed on n-h2-852771-11 Aug 30 17:43:49.763680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a1a474dd-1903-4cd0-962d-df35eadbf214 req-eee1abad-d011-4cd8-a1f2-3f8c74bd48c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092047 Aug 30 17:43:49.765013 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1827/3843] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:50.257740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:50.258871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:50.275828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:50.276606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:50.277159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:50.278011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:50.280051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:50.280194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:50.588482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:50.602170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-317659e2-6113-4222-8833-860739874824 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1315 microversion: 2.1 time: 0.349480 Aug 30 17:43:50.618445 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2017/3844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:50 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:50.764022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:50.765370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:50.774812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:50.798640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:50.799424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:50.800401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:50.801282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:50.802240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:50.830677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:51.067940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:51.080474 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03d4b2f0-513d-4f6a-9340-bdfb79dd7e64 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.321908 Aug 30 17:43:51.082479 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1828/3845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:50 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:51.626946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:51.629834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:51.648376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:51.651664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:51.654608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:51.659517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:51.660812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:51.662044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:52.103943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:52.106205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:52.118111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:52.137576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:52.151167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:52.152003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:52.152503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:52.152939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:52.175525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:52.184073 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a8bcd56-65a5-4a2e-91fb-c2617c6341fb tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1501 microversion: 2.1 time: 0.561963 Aug 30 17:43:52.187816 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2018/3846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:51 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1501 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:52.209842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:52.211404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:52.234879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:52.236095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:52.237276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:52.238952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:52.240448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:52.242151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:52.403982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:52.416299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f6f370f-868e-4d40-b9a2-3cde077140fe tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.316163 Aug 30 17:43:52.417284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1829/3847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:52 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:52.738321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Removing security group 199e8840-725b-477f-95dc-fd9feba06593 from port 2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4 Aug 30 17:43:53.443904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:53.445106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:53.483177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:53.490143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:53.495227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:53.496578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:53.498557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:53.504033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:53.549071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb44717f-b772-4bf0-8f44-508aeb220847 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed/action" status: 202 len: 0 microversion: 2.1 time: 1.344901 Aug 30 17:43:53.550359 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2019/3848] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:43:52 2022] POST /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed/action => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:43:53.559298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:53.563911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:53.593686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:53.594697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:53.597274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:53.600166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:53.603883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:53.604944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:53.928985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:53.938397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:53.948499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c67637fd-cb06-4b94-81e2-fa1e5fed4a8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.511402 Aug 30 17:43:53.951246 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f73d14dc-f647-49fe-8268-177e84e0d006 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1459 microversion: 2.1 time: 0.396254 Aug 30 17:43:53.952770 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2020/3849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:53 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1459 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:53.983573 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1830/3850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:53 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:53.992889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:53.993624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:54.015828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:54.016319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:54.017006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:54.017571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:54.017889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:54.018309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:54.321059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e592710-30bd-4e8d-afe4-3e1d0743e1ed", "tag": "2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:54.339563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:54.341104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:54.341711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:54.363835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] Creating event network-changed:2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4 for instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed on n-h2-852771-11 Aug 30 17:43:54.373105 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a86259f6-d1be-41de-955c-7ac481b9d6e4 req-3e47a973-3248-461c-831a-f9ef29339453 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418914 Aug 30 17:43:54.374268 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2021/3851] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:43:54.414253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:54.427518 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6620abb0-2986-4478-bc6b-ce061c2c3b49 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.442535 Aug 30 17:43:54.428735 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1831/3852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:53 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:54.464412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:54.466253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:54.489114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:54.493842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:54.494370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:54.495126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:54.497339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:54.499649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:54.995069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:54.995821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:55.014909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.015407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.015877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:55.016697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.017259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.017566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:55.233564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:55.251648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87818a10-e448-46f4-849b-e0eb473521b7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.796734 Aug 30 17:43:55.270381 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2022/3853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:54 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:55.282061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:55.289125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:55.305829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.306612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.308250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:55.309185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.311736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.312873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:55.326493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:55.339796 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d891292-b3b9-44a3-9000-a69bee074866 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 0.345918 Aug 30 17:43:55.340844 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1832/3854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:54 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:55.880792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:55.904870 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b8cb770-5d8e-4bd1-9e36-92da35891302 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.630157 Aug 30 17:43:55.905862 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2023/3855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:55 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:55.933944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:55.935318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:55.962320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.963418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.966487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:55.967307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:55.967835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:55.972529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:56.364087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:56.365408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:56.379935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:56.382613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:56.383547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:56.387047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:56.388994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:56.389460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:56.510789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:56.519903 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85fa5dc4-ccdd-4d60-860d-36bcacfa7d6e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.590761 Aug 30 17:43:56.524028 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1833/3856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:55 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:56.762862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2074493155", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "59938744-e1cd-4152-9402-9a2134605439"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:43:56.835844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] validate_networks() for [('59938744-e1cd-4152-9402-9a2134605439', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:43:57.372724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:57.386202 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ca8b0d9-ec52-449c-943f-ab593c68459b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1508 microversion: 2.1 time: 1.025774 Aug 30 17:43:57.394135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2024/3857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:56 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1508 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:43:57.405078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:57.405745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:57.414557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.416112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.416965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.418091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.418695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.419273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.456818 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] HTTP exception thrown: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Request method failure captured: Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 HTTP/1.1 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkq9DRzGXagcQkNCKmqX4mx5GZzD3KXkmAvfnpcBPuHNRMx7cZVtenPp-26iVtPmHD6elogg8KKc9d3IK6e0EmATvmgz3B56il-gFskVAYcoYJ7aKfPFjG1gC8yhVL25Lh-xpTTp9KGm1hCTk_ZDKJXCxG9qxqFXOUvszXpTd81lOGI Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90a7e4b51e574eedbd25ece987c09b8f"}]}] Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 3425189160ed4a2ca2eede57b605bf66 Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e2a1d765-84d8-4fcd-a03c-0e699b77ca56'} Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:43:57.459243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.464165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.466129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Returning 404 to user: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:57.467740 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-714fbf41-d063-437b-8297-f31abeb14ded tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 404 len: 111 microversion: 2.32 time: 0.068176 Aug 30 17:43:57.469319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2025/3858] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:43:57 2022] DELETE /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:43:57.480695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:57.481565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] [instance: e2a1d765-84d8-4fcd-a03c-0e699b77ca56] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:57.490622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.491360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.492353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.496567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.497049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.497506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.514829 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] HTTP exception thrown: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Request method failure captured: Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 HTTP/1.1 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkq9DRzGXagcQkNCKmqX4mx5GZzD3KXkmAvfnpcBPuHNRMx7cZVtenPp-26iVtPmHD6elogg8KKc9d3IK6e0EmATvmgz3B56il-gFskVAYcoYJ7aKfPFjG1gC8yhVL25Lh-xpTTp9KGm1hCTk_ZDKJXCxG9qxqFXOUvszXpTd81lOGI Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90a7e4b51e574eedbd25ece987c09b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90a7e4b51e574eedbd25ece987c09b8f"}]}] Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 90a7e4b51e574eedbd25ece987c09b8f Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1934594391 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 3425189160ed4a2ca2eede57b605bf66 Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TaggedBootDevicesTest-1934594391-project Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e2a1d765-84d8-4fcd-a03c-0e699b77ca56'} Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.517411 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. Aug 30 17:43:57.521462 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:43:57.526662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] Returning 404 to user: Instance e2a1d765-84d8-4fcd-a03c-0e699b77ca56 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:43:57.528433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b895aa0-9636-4950-baa1-188c970a6cad tempest-TaggedBootDevicesTest-1934594391 tempest-TaggedBootDevicesTest-1934594391-project] 10.222.0.50 "GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56" status: 404 len: 111 microversion: 2.32 time: 0.054427 Aug 30 17:43:57.529652 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2026/3859] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:43:57 2022] GET /compute/v2.1/servers/e2a1d765-84d8-4fcd-a03c-0e699b77ca56 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:43:57.876896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:43:57.877493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:43:57.878074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:43:57.878442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:43:57.879095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:43:57.900478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.901196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.902379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.904303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:57.906047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:57.910771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:57.991399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:43:58.016205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Getting quotas for user 6439f09540af4d31a6e60ee1c7aee8ae and project 5cf5f68455814153b89800033ef5a061. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:43:58.041120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:43:58.045837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:43:58.161660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5eb97787-f796-4bd3-b774-c67835177675 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403985 Aug 30 17:43:58.163995 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1834/3860] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:43:58.176218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cceea16b-b4ca-4625-b6b1-f6c8e453048b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:58.177500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cceea16b-b4ca-4625-b6b1-f6c8e453048b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:58.357782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cceea16b-b4ca-4625-b6b1-f6c8e453048b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:58.410041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:58.410981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:58.420289 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cceea16b-b4ca-4625-b6b1-f6c8e453048b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1215 microversion: 2.1 time: 0.247113 Aug 30 17:43:58.431590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2027/3861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:58 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:58.438506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:58.439954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:58.441362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:58.442240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:58.445498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:58.447385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:58.857855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:58.882538 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-23c33e78-9e7d-4a57-8682-74c181885cc5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1529 microversion: 2.1 time: 0.472329 Aug 30 17:43:58.885835 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1835/3862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:58 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1529 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:59.447666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:59.449056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:59.465663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:59.474308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:59.475099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:59.476063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:59.478607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:59.479501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:59.543705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:43:59.730060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:43:59.743002 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc378fd8-a3a9-471e-9cea-0d07a1ff2db7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1267 microversion: 2.1 time: 0.300202 Aug 30 17:43:59.749843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2028/3863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:59 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:43:59.912996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:43:59.913627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:43:59.948355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:59.948856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:59.949304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:43:59.950045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:43:59.950461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:43:59.950883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:00.358511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:00.381000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c399532-5a5b-42e0-a0f9-5c1b9b306379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.478877 Aug 30 17:44:00.397487 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1836/3864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:43:59 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:00.773168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:00.776149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:00.816428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:00.821409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:00.822456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:00.823235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:00.823742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:00.836942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:01.129335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:01.151839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-014dd579-bef1-4c85-94c9-c971de6bde41 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1273 microversion: 2.1 time: 0.385348 Aug 30 17:44:01.168864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2029/3865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:00 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1273 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:01.409586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:01.410238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:01.423216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:01.423744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:01.424184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:01.424896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:01.425353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:01.425781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:02.175792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:02.176411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:02.203587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:02.207363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:02.218902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:02.219736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:02.220230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:02.220645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:02.476126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:02.493736 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43975fb4-da78-41a4-9b1f-66dcfa3a0516 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 1.083926 Aug 30 17:44:02.495222 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1837/3866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:01 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:02.559097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:02.576988 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a8bb631-4923-4496-abe4-ee86aadeb4cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1273 microversion: 2.1 time: 0.404253 Aug 30 17:44:02.579898 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2030/3867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:02 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1273 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:03.432839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ccca7-8376-4206-ab07-3649442c8f45", "name": "network-vif-plugged", "status": "completed", "tag": "21dd566c-e305-40e4-bfb5-190e32766b84"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:03.467187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:03.483426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:03.484820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:03.519278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:03.520080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:03.541406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:03.552295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:03.554496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:03.555303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:03.555889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:03.556945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] Creating event network-vif-plugged:21dd566c-e305-40e4-bfb5-190e32766b84 for instance 1e6ccca7-8376-4206-ab07-3649442c8f45 on n-h1-852771-11 Aug 30 17:44:03.557484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:03.578017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2f3c2de7-fb62-4aaa-9f98-1221ef938121 req-e7d4aa87-64e7-4373-834d-a47811834405 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147242 Aug 30 17:44:03.579993 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1838/3868] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:03.601048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:03.603793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:03.614528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:03.619871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:03.620669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:03.622723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:03.623851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:03.625992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:04.068330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:04.080510 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7e2d9e5-c417-42eb-9ad4-2547e9d53be7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.565875 Aug 30 17:44:04.092514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2031/3869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:03 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:04.218109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:04.229549 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ce880ff-c485-49c2-b29f-f74b1d4d4042 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.633073 Aug 30 17:44:04.236109 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1839/3870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:03 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:05.133060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:05.134616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:05.155770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:05.157063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:05.158606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:05.162555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:05.163298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:05.163774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:05.252826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:05.253488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:05.263582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:05.264172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:05.264487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:05.265192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:05.283911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:05.284381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:05.709982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:05.726345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:05.739070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c27ea69-e95a-4ed7-991a-aff033e00862 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.626252 Aug 30 17:44:05.740860 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e19d1167-5518-4f38-8ae2-0659c888a3ff tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.492064 Aug 30 17:44:05.741971 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1840/3871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:05 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:05.742438 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2032/3872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:05 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:05.856351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d07349-8f33-4482-ae40-072b7843dc45", "tag": "234e8dee-5a44-43c5-8f91-4fd57ed789a6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:05.880471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:05.881243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:05.885084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:05.938947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] Creating event network-changed:234e8dee-5a44-43c5-8f91-4fd57ed789a6 for instance d3d07349-8f33-4482-ae40-072b7843dc45 on n-h1-852771-11 Aug 30 17:44:05.954981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-719e2c8b-82de-4107-8c12-5181a787cac9 req-b92453bf-b55c-432c-afa8-a7979903fa72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103107 Aug 30 17:44:05.965013 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1841/3873] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:06.767736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:06.768564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:06.769281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:06.769654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:06.782391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:06.787927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:06.788799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:06.789638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:06.794124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:06.795966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:06.797136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:06.797603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:06.797732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:06.798053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:06.819456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:06.820012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:06.820470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:07.521409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:07.533089 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea742f73-eff0-4190-9094-e873340cc9ec tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.774280 Aug 30 17:44:07.534396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2033/3874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:06 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:07.550712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:07.576549 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dedb3080-b349-4283-b8e3-2f95d670a92d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.812312 Aug 30 17:44:07.580869 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1842/3875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:06 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:08.558896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:08.559717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:08.606723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:08.607822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:08.627280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:08.639708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:08.640548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:08.663682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:08.664326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:08.672608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:08.681434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:08.682025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:08.682474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:08.686019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:08.689072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:08.689573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:08.690329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:08.690788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:08.704937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:09.415616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:09.423832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-908fb6ef-722a-49dd-a11f-8640d64d3714 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.873242 Aug 30 17:44:09.431019 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2034/3876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:08 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:09.492498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:09.502916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eeabd433-8797-4c63-8813-d298564bee84 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.901031 Aug 30 17:44:09.518943 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1843/3877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:08 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:10.444825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:10.445469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:10.477048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:10.478589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:10.479068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:10.487443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:10.495357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:10.497916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:10.529503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:10.531527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:10.535611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:10.578750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:10.579258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:10.584545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:10.588006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:10.588435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:10.588880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:10.930266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:10.938717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ec2606f-b448-4e41-a1ad-4328c0fe5452 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.497929 Aug 30 17:44:10.943118 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2035/3878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:10 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:11.109477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:11.126981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45707d9a-6254-44ee-b9b4-2ed7780cdb06 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.601717 Aug 30 17:44:11.134029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1844/3879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:10 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:11.401908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d07349-8f33-4482-ae40-072b7843dc45", "name": "network-vif-plugged", "status": "completed", "tag": "234e8dee-5a44-43c5-8f91-4fd57ed789a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:11.425916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:11.442161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:11.450249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:11.498867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] Creating event network-vif-plugged:234e8dee-5a44-43c5-8f91-4fd57ed789a6 for instance d3d07349-8f33-4482-ae40-072b7843dc45 on n-h1-852771-11 Aug 30 17:44:11.524564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e2e4b2c9-e53c-43af-9e26-4cb55836f761 req-967084f0-aa72-477d-b3dc-8708afedd6a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128043 Aug 30 17:44:11.527612 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2036/3880] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:44:11.965827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:11.966444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:11.979492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:11.980254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:11.980896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:11.981822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:11.982482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:11.983111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:12.154765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:12.155501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:12.177594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:12.178100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:12.178556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:12.179278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:12.179781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:12.180746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:12.285017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:12.309029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d8dd4d4-34c3-4b06-bf73-483fa67b4db9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1315 microversion: 2.1 time: 0.344803 Aug 30 17:44:12.309987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1845/3881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:11 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:12.538628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:12.558604 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1c0fa4df-442a-462b-aa2c-d8d8121468e8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.407974 Aug 30 17:44:12.559625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2037/3882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:12 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:13.330920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:13.332192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:13.364737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.368371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.371389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.372392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.375649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.377411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.580557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:13.581192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:13.599353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.610616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.611103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.611910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.612391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.612826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.648666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:13.659276 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1cdef8ba-4b7f-4fe8-a9db-5b2d8cb3ffd7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1502 microversion: 2.1 time: 0.332823 Aug 30 17:44:13.681420 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1846/3883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:13 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1502 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:13.699771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:13.700476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:13.708753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.709243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.721166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.722110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.722726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.723343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.732626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:13.881936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03f92ff5-715d-4808-9036-ec553851adf9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45/action" status: 202 len: 0 microversion: 2.1 time: 0.188161 Aug 30 17:44:13.882575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1847/3884] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:44:13 2022] POST /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:44:13.892002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:13.894240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:13.915245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.916176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.916827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:13.917769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:13.918418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:13.919197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:14.323887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:14.332066 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1c86715-7f34-49dc-80bf-5c8296e56274 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1507 microversion: 2.1 time: 0.444559 Aug 30 17:44:14.332655 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1848/3885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:13 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:14.356553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:14.365625 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8116318-76c1-4d8e-8f32-621f0e4b64aa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.788948 Aug 30 17:44:14.374244 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2038/3886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:13 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:15.375931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:15.379004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:15.389151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:15.390896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:15.420166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:15.421300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:15.424813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:15.425574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:15.426501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:15.428226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:15.429149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:15.431149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:15.432841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:15.433140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:15.437408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:15.440908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:16.142137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:16.153519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8035b3bb-2723-4dfe-9ce6-ce2efa69a8c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.768700 Aug 30 17:44:16.168134 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2039/3887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:15 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:16.297615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:16.310089 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-74dcd405-d7a5-4248-9b26-226cbd0a100c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1487 microversion: 2.1 time: 0.957489 Aug 30 17:44:16.314460 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1849/3888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:15 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1487 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:16.338777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:16.339523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:16.356557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:16.358637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:16.359308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:16.364647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:16.366679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:16.367391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:16.470943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lazy-loading 'flavor' on Instance uuid d3d07349-8f33-4482-ae40-072b7843dc45 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:44:17.083875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4a25b8c-2c4c-4281-9574-b62741b75788 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45/action" status: 202 len: 0 microversion: 2.1 time: 0.731982 Aug 30 17:44:17.085226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2040/3889] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:44:16 2022] POST /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:44:17.096498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:17.097790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:17.114459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:17.115877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:17.117309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:17.119287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:17.120124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:17.121433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:17.182870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:17.183866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:17.194169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:17.198092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:17.198748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:17.200291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:17.210955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:17.212149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:17.526776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:17.557499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-589d4179-b7b6-4d33-b5ee-87964fa7b159 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1493 microversion: 2.1 time: 0.466794 Aug 30 17:44:17.569616 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1850/3890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:17 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1493 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:17.699908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:17.712718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7abe57d-c575-4c92-9161-bd9b07a24c2a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.540347 Aug 30 17:44:17.718712 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2041/3891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:17 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:18.591770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:18.592502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:18.621148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:18.622206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:18.625339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:18.627384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:18.628121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:18.630210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:18.743831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:18.744966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:18.768902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:18.769400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:18.770948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:18.773441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:18.788870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:18.789532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:19.117909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:19.150035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:19.150939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9342e43-b536-4245-a0a2-76714f040d6c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1514 microversion: 2.1 time: 0.547557 Aug 30 17:44:19.151672 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1851/3892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:18 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1514 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:19.176764 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-75497c44-c639-495a-a7fd-04f09580e91e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.439419 Aug 30 17:44:19.191868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2042/3893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:18 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:19.954495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-221408693", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "97b7f95a-e08f-494b-ada2-b1dbed3b4453"}], "security_groups": [{"name": "tempest-securitygroup--1837613776"}], "key_name": "tempest-keypair-764243328", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0121c431-bcb1-401d-acad-57bc5693d26c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:20.177832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:20.179502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:20.201039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:20.201548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:20.201997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:20.202721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:20.203183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:20.203646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:20.323987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] validate_networks() for [('97b7f95a-e08f-494b-ada2-b1dbed3b4453', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:44:20.599076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:20.602773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:20.621125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bec4a364-f4b6-44f1-8ff9-4fe9a983acdc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.447359 Aug 30 17:44:20.622334 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2043/3894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:20 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:20.637305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:20.641318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:20.662774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:20.667196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:20.667818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:20.668699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:20.672794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:20.673310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.355239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:21.371572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-897b1153-6164-4c31-a947-ab1da78ec21f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.744986 Aug 30 17:44:21.373387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2044/3895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:20 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:21.500826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d07349-8f33-4482-ae40-072b7843dc45", "name": "network-vif-plugged", "status": "completed", "tag": "234e8dee-5a44-43c5-8f91-4fd57ed789a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:21.535278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:21.541126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:21.544743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.577631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for project 848833b99ee74c5f828a06638a56cb64. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:44:21.601133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for user ed73f24596f749a2a3ec3e86cd35630a and project 848833b99ee74c5f828a06638a56cb64. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:44:21.604856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] Creating event network-vif-plugged:234e8dee-5a44-43c5-8f91-4fd57ed789a6 for instance d3d07349-8f33-4482-ae40-072b7843dc45 on n-h1-852771-11 Aug 30 17:44:21.639011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-141df833-7cdf-456a-9f13-9db8cf95ce5f req-716a82cc-5527-46ea-8e82-3f439edb058e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142439 Aug 30 17:44:21.645224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2045/3896] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:44:21.666066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:44:21.667270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:44:21.669983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:44:21.670665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:44:21.671300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:44:21.684297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:21.695212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:21.710410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:21.717432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:21.718115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.723183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:21.724145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:21.724577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.733743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:21.734233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:21.734678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.735411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:21.735896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:21.736328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:21.844758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for project 848833b99ee74c5f828a06638a56cb64. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:44:21.861671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Getting quotas for user ed73f24596f749a2a3ec3e86cd35630a and project 848833b99ee74c5f828a06638a56cb64. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:44:22.020032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:44:22.022358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0121c431-bcb1-401d-acad-57bc5693d26c',volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:44:22.225484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:22.237689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f2a183eb-c4f1-43fb-b0af-2d30ab404b24 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.590152 Aug 30 17:44:22.240635 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2046/3897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:21 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:22.398047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:22.400580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:22.420821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:22.421487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:22.421947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:22.422687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:22.423227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:22.423690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:22.601379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff59cbb5-6b31-4b17-83bf-7e36a6037236 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.654626 Aug 30 17:44:22.604825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1852/3898] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:44:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:44:22.636441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13f6e64b-33ad-4515-a451-abda624b1175 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:22.637810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13f6e64b-33ad-4515-a451-abda624b1175 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:22.718557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-13f6e64b-33ad-4515-a451-abda624b1175 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:22.727447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-13f6e64b-33ad-4515-a451-abda624b1175 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1120 microversion: 2.1 time: 0.102293 Aug 30 17:44:22.728169 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1853/3899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:22 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1120 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:23.032062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:23.050589 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dcf5d93b-2cbd-456e-b687-ca8a93c16567 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.659801 Aug 30 17:44:23.064012 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2047/3900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:22 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:23.269373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:23.269998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:23.307144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:23.307678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:23.308122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:23.308838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:23.309297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:23.309718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:23.756071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad4e77a1-1688-43e5-9ff5-fbf61d718395 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:23.756071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad4e77a1-1688-43e5-9ff5-fbf61d718395 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:23.910829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:23.933473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3dbdb075-05ff-44c8-844c-d8e62185ee13 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.675388 Aug 30 17:44:23.949098 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1854/3901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:23 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:24.027468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad4e77a1-1688-43e5-9ff5-fbf61d718395 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:24.044183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad4e77a1-1688-43e5-9ff5-fbf61d718395 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1120 microversion: 2.1 time: 0.295146 Aug 30 17:44:24.045919 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2048/3902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:23 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1120 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:24.078682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:24.079343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:24.101111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:24.109567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:24.110024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:24.110779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:24.111241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:24.111703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:24.592997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:24.606827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dc413f66-83b3-42cf-8114-ebfbf20a9675 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.532103 Aug 30 17:44:24.609511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1855/3903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:24 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:24.959634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:24.960505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:24.986435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:24.987185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:24.990680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:24.992759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:24.994493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:24.995367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:25.072893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:25.074892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:25.090678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:25.091683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:25.092379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:25.093465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:25.094131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:25.094718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:25.410392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:25.425761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a1e14f4-432b-4fb8-a873-5806b0ef1476 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.467315 Aug 30 17:44:25.427694 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2049/3904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:24 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:25.454450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:25.465003 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b18879cd-8fdb-481c-ab8d-901c99dcf060 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1218 microversion: 2.1 time: 0.398307 Aug 30 17:44:25.481446 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1856/3905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:25 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:25.640338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:25.641573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:25.662482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:25.666046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:25.668907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:25.673647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:25.676299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:25.676811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:26.453142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:26.453749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:26.475747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:26.484274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:26.487186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:26.488643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:26.494327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:26.495613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:26.588699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:26.606786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ae93e90-59df-4ef3-afa2-4edb820f5e8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.971339 Aug 30 17:44:26.615048 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2050/3906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:25 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:26.641025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:26.642942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:26.679600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:26.685283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:26.688405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:26.692096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:26.700037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:26.700722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:27.028652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:27.040626 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7963c35e-4365-498b-94c3-550b14b1a2a2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1236 microversion: 2.1 time: 0.424225 Aug 30 17:44:27.052679 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2051/3907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:26 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1236 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:27.143984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:27.156411 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15efa94e-e116-4686-8850-fafa6fb8ab02 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.705784 Aug 30 17:44:27.157049 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1857/3908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:26 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:27.641355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:27.642594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:27.655439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:27.656124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:27.657792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:27.658681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:27.661313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:27.667881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:28.078438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:28.079051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:28.095289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:28.106213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:28.108176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:28.110579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:28.111150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:28.119605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:28.772628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:28.796844 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-777f29f6-4599-4cc8-9785-f5865458ca35 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 0.711560 Aug 30 17:44:28.800329 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1858/3909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:28 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:28.817083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:28.822791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:28.859731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:29.338750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:29.355143 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe5a24c1-1105-4afe-b1e9-0cbf397265bb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 1.717228 Aug 30 17:44:29.364755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2052/3910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:27 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:29.500363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:29.512756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-16f8cdf9-4865-4a9d-a909-55134312c4cc tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.711296 Aug 30 17:44:29.513340 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1859/3911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:28 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:29.880694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:29.881382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:29.928390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:29.934799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:29.935327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:29.936122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:29.936591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:29.937018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:30.389979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:30.390776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:30.408456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:30.435343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:30.435836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:30.436601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:30.437063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:30.454147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:30.530807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:30.547052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3539f296-fb4f-4357-ac9a-761b25b3c637 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 0.673142 Aug 30 17:44:30.547709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2053/3912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:29 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:30.588047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:30.591492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:30.614882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:30.625223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:30.626541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:30.627734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:30.630670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:30.634121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:31.778488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:31.789897 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a9fff4b-9f77-424a-9a86-1bf63ba5e712 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 1.221762 Aug 30 17:44:31.790520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2054/3913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:30 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:31.803826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:31.804364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:31.804364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:31.817341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:31.821077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:31.821546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:31.824165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:31.824691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:31.825131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:32.010352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:32.026813 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3872454-9f62-4092-87ef-3b280c4226b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 1.639460 Aug 30 17:44:32.043523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1860/3914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:30 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:32.813588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:32.814330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:32.835428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=12 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:32.844784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:32.847053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:32.850219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:32.852470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:32.853185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:32.853875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:33.174273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:33.198133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba8c2a73-246c-44e4-9b6f-487de11d6572 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 1.403957 Aug 30 17:44:33.204916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2055/3915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:31 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:33.227613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:33.228344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:33.264356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:33.265117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:33.268073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:33.269646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:33.270273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:33.275509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:33.926935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:33.936247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3043166a-8fed-4247-9c85-abbaaeb9b569 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1524 microversion: 2.1 time: 0.730214 Aug 30 17:44:33.939187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2056/3916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:33 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1524 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:33.978714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:33.999161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5571980b-db0e-4ff7-9fb9-fe7f97efc940 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 1.191774 Aug 30 17:44:34.001204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1861/3917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:32 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:34.078939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2067d9-0aee-4f3c-af42-19044e15fc01", "tag": "0058e789-104d-4d37-8859-48a816dceb0f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:34.095883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:34.103809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:34.105600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:34.116370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:34.179531 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] Creating event network-changed:0058e789-104d-4d37-8859-48a816dceb0f for instance ac2067d9-0aee-4f3c-af42-19044e15fc01 on n-h2-852771-11 Aug 30 17:44:34.197393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5210a008-2bf8-4b0e-930d-93ce4f503814 req-c030f681-1aef-4b67-8544-c911619ae0b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124094 Aug 30 17:44:34.210113 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2057/3918] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:34.226112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:34.227679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:34.262621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:34.266316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:34.269652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:34.270635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:34.271299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:34.275061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:34.975460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:34.986707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:34.998985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:35.000530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:35.003583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:35.004741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:35.005597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:35.006312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:35.148966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:35.165426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff28cab6-3a7c-4a6d-8d4e-73b0d2e7f19e tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 0.939654 Aug 30 17:44:35.166563 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1862/3919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:34 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:35.177557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:35.178346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:35.192672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:35.196335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:35.197091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:35.199255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:35.200099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:35.201494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:35.508513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:35.528747 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d88d4cc3-6102-4045-8091-762b1cac250c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1506 microversion: 2.1 time: 0.568341 Aug 30 17:44:35.532349 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2058/3920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:34 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:36.188786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:36.189817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:36.221927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:36.224102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:36.224674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:36.229430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:36.230088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:36.230640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:36.262695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:36.273007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97d42b83-080d-473e-aea0-0cb062c107ca tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 1.105301 Aug 30 17:44:36.281646 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1863/3921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:35 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:36.557353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:36.558253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:36.566014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:36.566922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:36.567851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:36.568944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:36.569768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:36.570645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:36.604866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:36.734456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:36.752074 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-288eebce-ae15-4f6d-9248-f838c0128fcd tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 0.565210 Aug 30 17:44:36.753866 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2059/3922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:36 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:37.241449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:37.287567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-301fd0fe-0d83-46ff-ab3b-9fa0f153c547 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1506 microversion: 2.1 time: 0.706071 Aug 30 17:44:37.290653 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1864/3923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:36 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:37.292626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ccca7-8376-4206-ab07-3649442c8f45", "name": "network-vif-unplugged", "status": "completed", "tag": "21dd566c-e305-40e4-bfb5-190e32766b84"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:37.312072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:37.313039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:37.313615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=56 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:37.321653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:37.322548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:37.324962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:37.340024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:37.341403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:37.342509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:37.344455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:37.346204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:37.350586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:37.383260 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] Creating event network-vif-unplugged:21dd566c-e305-40e4-bfb5-190e32766b84 for instance 1e6ccca7-8376-4206-ab07-3649442c8f45 on n-h1-852771-11 Aug 30 17:44:37.397907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d42cd203-14bb-4133-adfc-a54d966e5fe5 req-861f6431-0b71-4b33-b2fb-1a2c9b928efa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113402 Aug 30 17:44:37.421526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2060/3924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:37.778259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:37.779906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:37.812735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:37.813718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:37.814426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:37.817979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:37.819453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:37.822007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:38.002520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:38.030742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7977f4c-eac0-434b-9fc0-ead920855865 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.730528 Aug 30 17:44:38.034291 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1865/3925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:37 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:38.317779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:38.319136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:38.333276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:38.336658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:38.338774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:38.339820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:38.341741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:38.342486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:38.407179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:38.424758 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0da7384-4cb6-4dd5-8f53-3a59ac440de6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1304 microversion: 2.1 time: 0.652621 Aug 30 17:44:38.427492 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2061/3926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:37 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1304 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:38.688782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:38.702457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-deeff220-9438-4870-9f18-fbb765c0aa27 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 200 len: 1509 microversion: 2.1 time: 0.389982 Aug 30 17:44:38.710623 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1866/3927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:38 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:38.750643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:38.751393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:38.770966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:38.772010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:38.775540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:38.777274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:38.779101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:38.779101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:38.941150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:44:38.956975 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Working on deleting snapshot 81c3ee4d-5541-4ce2-bfac-6c38235981b3 from shelved instance... Aug 30 17:44:39.444383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:39.445532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:39.493785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:39.497030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:39.497556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:39.498306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:39.498773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:39.499210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:39.634182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:44:39.782552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:39.985966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-194c8136-52de-4514-8949-d4b069e889f6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 204 len: 0 microversion: 2.42 time: 1.245416 Aug 30 17:44:39.990633 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2062/3928] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:44:38 2022] DELETE /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 0 bytes in 1251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:44:40.033729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:40.035499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:40.051265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:40.054592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:40.055999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:40.057740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:40.062722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:40.065421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:40.748169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:40.767414 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83c49e16-e2fc-4367-9fde-62d9aa4c7ee5 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.768181 Aug 30 17:44:40.782211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2063/3929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:39 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:40.798152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:40.800992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:40.824949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:40.825718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:40.826862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:40.827698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:40.828164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:40.828603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:41.846120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:41.873946 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8019f93f-6a4d-4d90-aac9-bdd3dd755f2d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 1.095426 Aug 30 17:44:41.874567 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2064/3930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:40 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:41.897154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:41.904139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Doing local delete in cell d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122123) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 17:44:41.909946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:41.910837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:41.911452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:41.915995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:41.917107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:41.918916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 17:44:41.934514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] deallocate_for_instance() {{(pid=122123) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 17:44:41.936783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:41.937452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:41.939207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:41.941240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:41.944001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:41.945850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:42.625400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:42.646245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:42.647967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:42.649718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0071eef0-1c14-43ce-a306-1ac17490287b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2962 microversion: 2.42 time: 0.765050 Aug 30 17:44:42.650296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2065/3931] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:41 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2962 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:42.676187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:42.680549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:42.706215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:42.707037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:42.707686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:42.708638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:42.709244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:42.709872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:43.298567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:43.310907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-099144f1-eb77-4c1e-936f-9e91aad71924 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.644602 Aug 30 17:44:43.315345 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2066/3932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:42 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:43.341457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:43.343773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:43.355888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:43.356392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:43.356862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:43.357546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:43.358005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:43.375909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:43.932743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:43.951197 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4eec513a-3c91-4891-8bdb-68e25e249c6f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 0.634497 Aug 30 17:44:43.966812 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2067/3933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:43 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:43.979242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:43.983243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:44.004767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.005268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.005741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.009744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.010319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.011174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.208591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Updating instance_info_cache with network_info: [] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:44:44.690847 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e3c5660c-8ca2-423e-8de9-891e9e04c7c2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 204 len: 0 microversion: 2.1 time: 5.944257 Aug 30 17:44:44.695213 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1867/3934] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:44:38 2022] DELETE /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 0 bytes in 5946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:44:44.705039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ccca7-8376-4206-ab07-3649442c8f45", "name": "network-vif-deleted", "tag": "21dd566c-e305-40e4-bfb5-190e32766b84"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:44.758670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.759172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.759640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.788010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.server_external_events [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] Unable to find a host for instance 1e6ccca7-8376-4206-ab07-3649442c8f45. Dropping event network-vif-deleted {{(pid=122123) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:44:44.789456 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1eb6ebe0-4ac7-462c-a0ed-4bf4783702a6 req-20be3d33-e1c5-4fb7-b030-6b9cfb94df55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.093074 Aug 30 17:44:44.816930 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1868/3935] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:44:44.833764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:44.843599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:44.872768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.874927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:44.877922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.878464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.880920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.884067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.885655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.897834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:44.904266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:44.909483 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ac150d3-c3db-4987-9740-0069c493109a tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2962 microversion: 2.42 time: 0.941443 Aug 30 17:44:44.914820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2068/3936] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:43 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2962 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:44.921838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:44.926401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:44.940381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.941285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.941880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.947556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:44.948845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:44.949610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:44.997524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 HTTP/1.1 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1e6ccca7-8376-4206-ab07-3649442c8f45'} Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:44:44.999963 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1444189c-48d3-4cc0-931e-6585d75b83b1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 404 len: 111 microversion: 2.1 time: 0.085096 Aug 30 17:44:45.010499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2069/3937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:44 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:44:45.023609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:45.026385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:45.070761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:45.080915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:45.081865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:45.088623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:45.089397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:45.091048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:45.488981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:45.533799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47f0e7c6-2fa4-4d67-be33-4610dc176286 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 0.526326 Aug 30 17:44:45.547505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2070/3938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:45 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:45.566926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-772420955", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:45.828959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:44:46.776993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:46.794490 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56777300-d5e7-49e1-bae1-45ed2eede168 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 1.970204 Aug 30 17:44:46.796012 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1869/3939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:44 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:46.819007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-unplugged", "status": "completed", "tag": "a41be049-3f81-4729-a403-3c5995e16c6f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:46.889110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:46.896546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:46.901123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:46.951635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] Creating event network-vif-unplugged:a41be049-3f81-4729-a403-3c5995e16c6f for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:46.980874 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d121d8fc-d4a2-457c-b69a-b46158e6ebf7 req-bce73b98-ce06-4aa7-b108-7482085cd6db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181401 Aug 30 17:44:46.989712 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1870/3940] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:47.010918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:47.013382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:47.033149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:47.034339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:47.037639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:47.041756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:47.041756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:47.041756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.169673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:48.182737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:48.190336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:48.191915 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55fd4762-2231-49f9-b467-a4b279ad19f1 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2941 microversion: 2.42 time: 1.199684 Aug 30 17:44:48.193447 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1871/3941] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:46 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2941 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:48.209239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:48.210992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:48.220969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.221678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.222279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.230415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.231107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.231721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.300950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:44:48.301938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:44:48.302584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:44:48.303165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:44:48.303627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:44:48.331324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.332096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.332746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.333963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.345777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.346499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.415600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:44:48.430243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:44:48.474308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:44:48.484593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:44:48.624125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0dae28ac-f310-4c49-a55e-2d8fddadd6be tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.081426 Aug 30 17:44:48.628064 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2071/3942] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:44:48.645788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:48.651469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:48.689334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.692011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.693488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:48.696837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:48.700407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:48.701372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:49.314258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.325845 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-179f05fb-dab1-4e28-9afd-abe3be6e06d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.695630 Aug 30 17:44:49.340021 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2072/3943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:48 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:49.355689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcc69562-0cae-4526-9f69-12bc0964c494 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:49.374413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcc69562-0cae-4526-9f69-12bc0964c494 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:49.468213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fcc69562-0cae-4526-9f69-12bc0964c494 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.476425 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcc69562-0cae-4526-9f69-12bc0964c494 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1214 microversion: 2.1 time: 0.134936 Aug 30 17:44:49.479706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2073/3944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:49 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:49.487089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-unplugged", "status": "completed", "tag": "213461bb-32e1-4964-83aa-30286c3e0786"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-unplugged", "status": "completed", "tag": "0d3c28d9-98b6-4954-9c09-7d4c35a4cb98"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-unplugged", "status": "completed", "tag": "ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff"}, {"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-unplugged", "status": "completed", "tag": "41b7d26f-8346-4351-9c9f-f18ac5466fab"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:49.518227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:49.518708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:49.522341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:49.551312 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Creating event network-vif-unplugged:213461bb-32e1-4964-83aa-30286c3e0786 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:49.551849 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Creating event network-vif-unplugged:0d3c28d9-98b6-4954-9c09-7d4c35a4cb98 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:49.553615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Creating event network-vif-unplugged:ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:49.556871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] Creating event network-vif-unplugged:41b7d26f-8346-4351-9c9f-f18ac5466fab for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:49.569228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9800a11e-d1fd-4059-aa05-b0b211382062 req-28eb2d83-bafa-408e-ad80-2e1a1a30602d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.087728 Aug 30 17:44:49.570886 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2074/3945] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:49.583825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:49.587768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:49.600011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:49.600842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:49.603609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:49.604794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:49.605604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:49.609346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:49.645607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.660907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03e45c24-5fb3-4a88-959c-46de79cda24a tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 1.463485 Aug 30 17:44:49.663743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1872/3946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:48 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:49.890997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.910960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.915900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:49.920055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98daf309-2cfb-4a23-83c2-2e78568c863d tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2941 microversion: 2.42 time: 0.347486 Aug 30 17:44:49.921823 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2075/3947] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:49 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2941 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:50.353377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:50.354388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:50.390228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.390727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.391169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:50.399161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.404322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.407427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:50.514836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:50.524430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:50.568159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.572588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.573848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:50.577336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.577834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.578284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:50.735829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:50.752160 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2d10b427-e45d-4180-be15-bd3c1f702e66 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1266 microversion: 2.1 time: 0.253721 Aug 30 17:44:50.756299 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2076/3948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:50 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:50.769460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:50.770706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:50.790394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.795389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.796251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:50.797621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:50.798428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:50.799052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.205016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:51.218494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e39246a-4787-46d4-b638-e9c87b79037d tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 0.457204 Aug 30 17:44:51.220632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2077/3949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:50 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:51.236918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:51.261117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:51.288260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:51.290155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:51.292253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.293180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:51.295322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:51.297995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.461519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:51.478686 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1adfc855-0222-4f75-8cf2-e20dccecc866 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 1.131233 Aug 30 17:44:51.499641 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1873/3950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:50 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:51.593574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2067d9-0aee-4f3c-af42-19044e15fc01", "name": "network-vif-plugged", "status": "completed", "tag": "0058e789-104d-4d37-8859-48a816dceb0f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:51.621752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:51.622370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:51.623359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.675607 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] Creating event network-vif-plugged:0058e789-104d-4d37-8859-48a816dceb0f for instance ac2067d9-0aee-4f3c-af42-19044e15fc01 on n-h2-852771-11 Aug 30 17:44:51.688952 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-746cf9b3-ae8a-4f3b-a106-852f11288f40 req-7e0f54c0-ecf6-4348-9603-6b280f082c6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103023 Aug 30 17:44:51.691514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1874/3951] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:44:51.778955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:51.780155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:51.794987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:51.800517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:51.802448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.806215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:51.807416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:51.808243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:51.939879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:51.956499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:51.958313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:51.960037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2bc19dea-27ad-4586-93a5-a35f7fb30f46 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2920 microversion: 2.42 time: 0.738029 Aug 30 17:44:51.971992 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2078/3952] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:51 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2920 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:52.255179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:52.256182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:52.275819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:52.276856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:52.277474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:52.279656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:52.282876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:52.284213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:52.458835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:52.487671 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ff0c29c-b0d3-451f-aec1-12914668dbaa tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1272 microversion: 2.1 time: 0.713237 Aug 30 17:44:52.497243 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1875/3953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:51 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1272 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:52.513390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:52.514230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:52.529072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:52.537195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:52.537658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:52.540216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:52.540707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:52.541141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:52.901806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:52.904254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:52.910310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:52.917083 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eba0cbe1-a1ad-4e39-8919-1ce3fa5d8657 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1506 microversion: 2.1 time: 0.407574 Aug 30 17:44:52.917685 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1876/3954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:52 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:52.932304 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4115d34a-c2c7-471c-bb62-02ef0094382f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1292 microversion: 2.1 time: 0.695859 Aug 30 17:44:52.941741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2079/3955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:52 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1292 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:52.986695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:52.987414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:52.998211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.002818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.003416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.004423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.008159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.008816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.342680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-deleted", "tag": "0d3c28d9-98b6-4954-9c09-7d4c35a4cb98"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:53.361912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.364239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.365134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.393487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] Creating event network-vif-deleted:0d3c28d9-98b6-4954-9c09-7d4c35a4cb98 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:53.406427 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c76a55e4-b297-4d22-a8a8-0e92db9b0a49 req-3546f230-4380-4daa-b773-80757405e29b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067394 Aug 30 17:44:53.409121 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2080/3956] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:44:53.522079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:53.523368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:53.539738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.542262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.542904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.549882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.550494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.551112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.676325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:53.685983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85ffa632-ba4a-4af6-a24e-cc387af9c7cb tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1272 microversion: 2.1 time: 0.168857 Aug 30 17:44:53.686585 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2081/3957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:53 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:53.702618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:53.743422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:53.745452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:53.749576 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2773dd25-01c9-4507-8420-94ef178577eb tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2873 microversion: 2.42 time: 0.766605 Aug 30 17:44:53.750274 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1877/3958] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:52 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2873 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:53.952656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:53.954399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:53.966431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:53.967547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:53.973451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.974985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.976147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.982880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.984597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.985417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.986067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.986564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.987179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:53.988335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:53.994225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:53.996513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:53.996979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.230090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:54.240177 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec94b862-05bf-4878-8d6a-99e75f85176a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1506 microversion: 2.1 time: 0.297806 Aug 30 17:44:54.242621 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2082/3959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:53 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:54.443367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:54.467585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2a846b0-3cfb-4db6-ade6-ce63777b48f5 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1482 microversion: 2.1 time: 0.505902 Aug 30 17:44:54.469124 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1878/3960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:53 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1482 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:44:54.504232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:54.504747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:54.513698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.515094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.516142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.517905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.524809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.525284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.709948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:54.710820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:54.732086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.734476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.750309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.753876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.759773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.760676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.773110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7089d71-493c-4a35-9136-8220a9f2fb2f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271618 Aug 30 17:44:54.779191 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2083/3961] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:44:54 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:54.786143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:54.787568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:54.797957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.799412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.800118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:54.801106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:54.801958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:54.802685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.294487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:55.312432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:55.314181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:55.317549 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-163f7cdf-5cc9-4c8d-b8bf-9cb34f92e1d9 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2759 microversion: 2.42 time: 0.537047 Aug 30 17:44:55.331903 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2084/3962] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:54 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2759 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:44:55.346860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:55.347517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:55.365017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:55.365517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:55.365978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.367390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:55.372351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:55.373027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.787283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:55.792887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:55.797073 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11d8a76a-8de1-43d7-b6bf-3a2504b85841 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 200 len: 1509 microversion: 2.1 time: 0.463785 Aug 30 17:44:55.801763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2c5d4e7-3c27-49bb-8187-8fe9e351b3b5 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 1.096018 Aug 30 17:44:55.812846 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2085/3963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:55 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 1509 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:55.817097 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1879/3964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:54 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:55.843218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d07349-8f33-4482-ae40-072b7843dc45", "name": "network-vif-unplugged", "status": "completed", "tag": "234e8dee-5a44-43c5-8f91-4fd57ed789a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:55.848437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:55.853648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:55.888258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:55.890270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:55.891584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:55.892771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:55.893274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.893681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.895962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:55.899977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:55.900480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:55.948681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] Unable to find a host for instance d3d07349-8f33-4482-ae40-072b7843dc45. Dropping event network-vif-unplugged {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:44:55.970313 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ff184c80-074e-4f25-806c-af984f23ed35 req-de2a4e43-c2ba-4624-a0f9-20cc8b5e5453 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.137623 Aug 30 17:44:55.974431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2086/3965] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 161 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:44:56.352780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:56.354220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:56.370444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:56.371515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:56.372704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:56.373682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:56.376632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:56.377370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:56.524419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:56.542665 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc924b15-ef88-4d9e-be77-24ea209cf54d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.704432 Aug 30 17:44:56.569809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1880/3966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:55 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:56.588642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:56.590872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:56.608608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:56.611204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:56.611982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:56.612902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:56.615423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:56.618481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:57.222767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:57.239994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:57.249707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:57.251516 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89f3b1f1-4de5-426e-be1f-85a1301e77ff tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2759 microversion: 2.42 time: 0.905663 Aug 30 17:44:57.255084 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2087/3967] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:56 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2759 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:44:57.288589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:57.289570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:57.308914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:57.314436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:57.314906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:57.317595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:57.324330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:57.325050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:57.545249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:57.571156 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57ac671d-73a4-4916-ae79-dc833cd88484 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.996828 Aug 30 17:44:57.573175 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1881/3968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:56 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:57.586747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-deleted", "tag": "41b7d26f-8346-4351-9c9f-f18ac5466fab"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:44:57.620995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:57.625688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:57.627652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:57.673174 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] Creating event network-vif-deleted:41b7d26f-8346-4351-9c9f-f18ac5466fab for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:44:57.695283 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1ab889a2-bdc7-4d97-ab27-02ccf00567f6 req-3364bd68-7b88-4626-8faf-750fd20cb0a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112982 Aug 30 17:44:57.697508 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1882/3969] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:44:57.721929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:57.722654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:57.756225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:57.761580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:57.763933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:57.764887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:57.765539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:57.768492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:58.072644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:58.087988 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4674e5a1-06b5-4b78-9fc3-b078e488205d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 0.830191 Aug 30 17:44:58.089033 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2088/3970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:57 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:58.282451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:58.283302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:58.293172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:58.295701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:58.296149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:58.297071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:58.297723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:58.301757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:58.394304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:58.809116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:58.822058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:58.829298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:58.831052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99bf0cca-feac-42cb-94fc-d85b435a2ef2 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2598 microversion: 2.42 time: 0.552620 Aug 30 17:44:58.836760 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2089/3971] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:44:58 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2598 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:44:59.110612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:59.111995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:59.127705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.128461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.129269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:59.130192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.130860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.131545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:59.176240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:59.192869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ee507aa-8b03-4a7a-b628-4417ffdd0975 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 1.492745 Aug 30 17:44:59.203628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1883/3972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:57 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:59.226978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:59.227762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:59.239710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.240210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.240648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:59.241985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.242433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.242856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:59.476112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:44:59.753682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:44:59.790205 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d80b4bac-0864-4aa3-8dc3-b910929ca4de tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 0.681248 Aug 30 17:44:59.793130 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2090/3973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:59 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:44:59.830559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:44:59.831288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:44:59.866851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.869205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.869674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:44:59.874247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:44:59.878301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:44:59.879154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.347321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:00.363932 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05ea7c83-f685-49c0-9665-d3b35f14d8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1482 microversion: 2.1 time: 0.567242 Aug 30 17:45:00.414271 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2091/3974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:59 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1482 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:00.423433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:00.436380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2067d9-0aee-4f3c-af42-19044e15fc01", "tag": "0058e789-104d-4d37-8859-48a816dceb0f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:00.464410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.467871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.468606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.480455 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d92186d-e505-4bb6-8580-486dd946e7c1 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 1.259398 Aug 30 17:45:00.486975 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1884/3975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:44:59 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:00.511212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:00.532015 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] Creating event network-changed:0058e789-104d-4d37-8859-48a816dceb0f for instance ac2067d9-0aee-4f3c-af42-19044e15fc01 on n-h2-852771-11 Aug 30 17:45:00.539941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:00.548643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a2d51eea-1add-415c-9b44-fb0f2247d876 req-41b304fc-227e-4965-a666-02ee77f7a61b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123831 Aug 30 17:45:00.551732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2092/3976] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:00.563087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a309c56c-6ff8-40bc-b302-4de325bb2d84", "tag": "f795dbf1-e02e-43bc-9955-e2f746a288bf"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.581406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.607138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.607790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.612296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.639362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] Creating event network-changed:f795dbf1-e02e-43bc-9955-e2f746a288bf for instance a309c56c-6ff8-40bc-b302-4de325bb2d84 on n-h1-852771-11 Aug 30 17:45:00.650894 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-11a96774-5471-4ca2-8914-7891744d0458 req-3fa7aa67-e3f1-42e1-9b45-0f3370b34324 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096725 Aug 30 17:45:00.652127 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2093/3977] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:00.668063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:00.690100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.692278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.692781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.758995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Going to try to stop instance {{(pid=122124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:45:00.890713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7358048-7c95-4ccf-9b7e-745b46c1f46f tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.220451 Aug 30 17:45:00.891662 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2094/3978] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:45:00 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:00.916516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:00.917243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:00.948820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.949244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.949688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:00.952391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:00.952967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:00.953412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:01.436483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:01.452240 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-207f1050-693c-43b4-a59d-0c5d2bfcd219 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 0.552373 Aug 30 17:45:01.457197 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2095/3979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:00 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:01.472015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:01.473035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:01.484916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:01.485739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:01.488855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:01.489808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:01.490523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:01.492038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:01.581623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:01.604407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:01.608252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:01.614603 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98be3b48-3772-4aa3-a8ff-3ed0116f4ff4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2551 microversion: 2.42 time: 1.121455 Aug 30 17:45:01.629739 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1885/3980] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:00 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2551 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:02.143247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:02.153099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9c650c0-5bea-4ee5-bebb-165fbf69ba04 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.694171 Aug 30 17:45:02.157092 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2096/3981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:01 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:02.479148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:02.480144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:02.501037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:02.501785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:02.502413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:02.503417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:02.504649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:02.505224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:02.652533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:02.654778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:02.687641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:02.688558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:02.691746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:02.705607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:02.708621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:02.713277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:03.310802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:03.324091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:03.325531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:03.326858 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba9e770e-0e5b-477d-a059-23c5d88345da tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2551 microversion: 2.42 time: 0.685869 Aug 30 17:45:03.327460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2097/3982] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:02 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2551 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:03.333505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-deleted", "tag": "a41be049-3f81-4729-a403-3c5995e16c6f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:03.344651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:03.345139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:03.345576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:03.358804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] Creating event network-vif-deleted:a41be049-3f81-4729-a403-3c5995e16c6f for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:45:03.365627 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-40b55e5d-c1a9-4b57-91a8-296ab2d6460b req-615c935b-6e1d-4131-aca9-1ba8c43f0960 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036881 Aug 30 17:45:03.367275 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2098/3983] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:03.386482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:03.387223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:03.409204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:03.411940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:03.412769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:03.413926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:03.415079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:03.416587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:03.418689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:03.645829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:03.657773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ee5bb75-bc36-4176-a2a2-cb34dfd85af9 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.289192 Aug 30 17:45:03.661882 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2099/3984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:03 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:03.935703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:03.950830 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6db9cee6-6d60-4e9f-babe-b68fcf72396d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 1.475389 Aug 30 17:45:03.951917 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1886/3985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:02 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:04.358400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:04.359160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:04.374886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:04.375402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:04.376941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:04.379682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:04.380176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:04.382046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:04.684950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:04.685728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:04.699033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:04.701136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:04.703529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:04.705613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:04.708844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:04.709522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:04.718413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:04.721071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:04.732846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:04.735255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:04.736766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bf8ee10-7ad3-4928-b753-c5c26eb035c3 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2259 microversion: 2.42 time: 0.383410 Aug 30 17:45:04.752516 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2100/3986] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:04 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2259 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:04.979966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:04.981799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:04.997200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:04.998279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:04.998986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:04.999824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:05.000745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:05.012956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:05.251318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:05.264201 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c6f0072-cfe2-4fe5-b085-9c336162270e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 0.289969 Aug 30 17:45:05.265417 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2101/3987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:04 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:05.667834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a309c56c-6ff8-40bc-b302-4de325bb2d84", "name": "network-vif-plugged", "status": "completed", "tag": "f795dbf1-e02e-43bc-9955-e2f746a288bf"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:05.696495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:05.697294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:05.699725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:05.714749 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] Creating event network-vif-plugged:f795dbf1-e02e-43bc-9955-e2f746a288bf for instance a309c56c-6ff8-40bc-b302-4de325bb2d84 on n-h1-852771-11 Aug 30 17:45:05.726117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5f0afc18-7ac6-4e98-a762-a0a08fe035b7 req-a52d5e27-c6f2-4275-84fa-2120e757d95d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 Aug 30 17:45:05.727051 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2102/3988] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:45:05.765570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:05.766505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:05.794510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:05.795262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:05.796445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:05.798135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:05.798933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:05.799614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:05.833064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:05.858453 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d023c52-954f-45a3-8505-5fc5e8f668f3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 1.177799 Aug 30 17:45:05.867988 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1887/3989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:04 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:05.879867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-deleted", "tag": "213461bb-32e1-4964-83aa-30286c3e0786"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:05.902989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:05.906372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:05.908178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:05.932004 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] Creating event network-vif-deleted:213461bb-32e1-4964-83aa-30286c3e0786 for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:45:05.939020 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-25359124-2be9-4a4a-b155-caa425f5dcc4 req-8361f03c-b64a-4ef9-97d3-23d522ad3563 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068980 Aug 30 17:45:05.940158 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1888/3990] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:06.156696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:06.185065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:06.189093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:06.193010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba15e179-6c4a-4496-8cce-6fe7e52eafab tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 2212 microversion: 2.42 time: 0.433340 Aug 30 17:45:06.200356 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2103/3991] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:05 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 2212 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:06.290516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:06.291229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:06.298276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:06.298764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:06.299425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:06.300188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:06.300800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:06.301506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:06.586480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:06.602051 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4411d756-936e-4b44-8c76-fc1dd552f286 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1314 microversion: 2.1 time: 0.316125 Aug 30 17:45:06.619579 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1889/3992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:06 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:06.885857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:06.886414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:06.901437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:06.901933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:06.914107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:06.916764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:06.918323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:06.918960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:07.222611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:07.224155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:07.234226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:07.241906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:07.242473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:07.243446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:07.244131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:07.244563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:07.482981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:07.497968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:07.499303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:07.511059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fbad6c6-1fde-49cf-b016-70f23e8789b0 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.292515 Aug 30 17:45:07.513585 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1890/3993] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:07 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:07.626268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:07.626889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:07.637164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:07.637660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:07.638114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:07.638840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:07.639299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:07.639831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:07.902496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:07.916966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d88853ce-7c96-43b9-927f-a8fd2f4b8b40 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 1.035746 Aug 30 17:45:07.921534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2104/3994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:06 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:08.055466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29f9666-d9f6-44d9-b2d9-80b65da2c884", "name": "network-vif-deleted", "tag": "ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:08.077465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.077960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.078672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.093459 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] Creating event network-vif-deleted:ac2e02c9-7e19-45fa-bfc7-63a1df6aeaff for instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 on n-h1-852771-11 Aug 30 17:45:08.111775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0d393df3-d522-42e0-bb3f-7e2311e7fea0 req-93a84af0-8daa-48cd-9938-3fc6a3b88ebd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060438 Aug 30 17:45:08.119861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2105/3995] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:08.197943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:08.206637 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-caaa1385-1ef6-4fce-937c-b5679a191aa7 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1500 microversion: 2.1 time: 0.584179 Aug 30 17:45:08.229864 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1891/3996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:07 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1500 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:08.237319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:08.248533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.251309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.251791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.308299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Going to try to stop instance {{(pid=122124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:45:08.409242 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48238622-9ae1-40b5-94c8-33af1e3191a8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84/action" status: 202 len: 0 microversion: 2.1 time: 0.177166 Aug 30 17:45:08.409790 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2106/3997] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:45:08 2022] POST /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:08.418844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:08.419838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:08.433499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.435624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.436320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.438530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.439249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.441039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.539448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:08.540208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:08.549951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.552065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.557030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.558652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.559289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.559921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.716377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:08.730135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cdcf80ae-a2a2-442e-ab4a-7de9c8bf58c8 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.315747 Aug 30 17:45:08.730817 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1892/3998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:08 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:08.845139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:08.860437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:08.879157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:08.888964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6dfd2dd5-35db-470a-ac9c-4b1111e673bc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.354730 Aug 30 17:45:08.903427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2107/3999] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:08 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:08.940538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:08.941475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:08.955341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.961780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.962238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:08.962994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:08.963454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:08.963932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:09.378085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:09.387010 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aed110fa-8262-4e6a-9117-3d4e30100a59 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.450526 Aug 30 17:45:09.407061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1893/4000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:08 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:09.753888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:09.754513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:09.766190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:09.766690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:09.773313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:09.774453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:09.775131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:09.775767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:09.923120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:09.924233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:09.946631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:09.947321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:09.948325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:09.951872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:09.955905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:09.956509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:10.087049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:10.099290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:10.106347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:10.111121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:10.114737 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bfc9c6b6-4f2e-4968-b954-54099556c7cc tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.203221 Aug 30 17:45:10.117849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1894/4001] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:09 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:10.310680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:10.320183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a480613c-ea57-46c3-b4ad-1b32d3a91867 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.570083 Aug 30 17:45:10.320795 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2108/4002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:09 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:10.415348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:10.416296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:10.430472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:10.445289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:10.448207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:10.449208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:10.452405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:10.454014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:10.872168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:10.888400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-81048ab4-4cad-4f67-ae51-0771a4c697a4 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1678 microversion: 2.1 time: 0.477574 Aug 30 17:45:10.890829 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1895/4003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:10 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1678 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:11.153139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:11.156403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:11.185329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.186346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.190544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:11.192076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.192758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.195384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:11.353461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:11.355053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:11.362102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:11.382378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.386091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:11.388340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:11.389147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.390524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9452b0c3-8617-4973-a81a-2c3c6262f31c tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.252156 Aug 30 17:45:11.393028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:11.396412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.400127 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2109/4004] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:11 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:11.402977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.403831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:11.870837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:11.880778 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9b28bf0-bc96-4a62-8e60-e72d0f5d1137 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.531852 Aug 30 17:45:11.884513 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1896/4005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:11 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:11.913315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:11.914340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:11.935575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.936087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.936534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:11.941365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:11.942028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:11.943543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:12.304605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-248427965", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4ef2f9df-c102-491a-bbd5-a4f9783d3a0a"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:12.331090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:12.405348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] validate_networks() for [('4ef2f9df-c102-491a-bbd5-a4f9783d3a0a', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:45:12.413156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:12.424444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-61d74656-15cd-473a-a1d5-a9bb006c36f7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1655 microversion: 2.1 time: 0.515595 Aug 30 17:45:12.427249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2110/4006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:11 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1655 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:12.448939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:12.449563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:12.461826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:12.461960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:12.462377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:12.463077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:12.463812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:12.464679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:12.622621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:12.641825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:12.643320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:12.656174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a7d761b-b7da-4382-8ae7-4c1584f89209 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.227169 Aug 30 17:45:12.656792 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2111/4007] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:12 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:12.669529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:12.698714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:12.699597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:12.700050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:12.774319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Going to try to start instance {{(pid=122124) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:45:12.898251 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d355ed8-ef70-458b-9ecc-b66e4c7e36d7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.237901 Aug 30 17:45:12.903349 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2112/4008] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:45:12 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:12.928391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:12.929366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:12.945059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:12.947259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:12.948104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:12.954738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:12.956161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:12.956869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.398187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:13.418279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e58d8d64-c435-466c-a40c-e3577bc6b5ed tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1664 microversion: 2.1 time: 0.512892 Aug 30 17:45:13.423326 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2113/4009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:12 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1664 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:13.437795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:13.438735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:13.450003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.451779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.452438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.454182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.455337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.457802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.700864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:45:13.701462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:45:13.702047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:45:13.702551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:45:13.703282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:45:13.721414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.726820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.727445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.728566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.729201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.732421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.774003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Getting quotas for project a0b4878f3b444044b4bb9ea8104436bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:45:13.780599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Getting quotas for user 0ac26d5d104e40d2b5d1af9acc9f1f41 and project a0b4878f3b444044b4bb9ea8104436bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:45:13.796122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:45:13.798824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:45:13.873285 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-724e84fe-0295-44a2-a6f9-60ba4a03b78c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.945383 Aug 30 17:45:13.878145 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1897/4010] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 17:45:13.888742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:13.893384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:13.909202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.910070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.910717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:13.911772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:13.913400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:13.914232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:14.069570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.081839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d2ca5157-b594-4b64-ad8c-29e0c63580e2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.657087 Aug 30 17:45:14.091088 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2114/4011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:13 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:14.096931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:14.104628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:14.399931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.455008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.462959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.470165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.477563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3c57969-b5f1-4623-af42-191d2da0373e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1258 microversion: 2.21 time: 0.381917 Aug 30 17:45:14.482941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.483645 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2115/4012] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:14 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1258 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:14.485396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:14.486804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e3a01fc-33ff-4ef7-a99c-1ab4944e15dd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.607360 Aug 30 17:45:14.490887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1898/4013] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:13 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:14.508495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:14.510576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:14.543774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:14.545558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:14.547712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:14.549684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:14.552375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:14.553320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.105400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.115917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:15.116308 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cb0c2dd-55ae-4a80-8f95-2d035516024e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1664 microversion: 2.1 time: 0.630193 Aug 30 17:45:15.116621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:15.116721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2116/4014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:14 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1664 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:15.124807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.125291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.125729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.126428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.126933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.127297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.510802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:15.512151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:15.533577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.534273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.534877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.538902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.539589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.540183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.596799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.614268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c4721af-b3cc-452d-8044-b1fc2e4c00da tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.502415 Aug 30 17:45:15.615113 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1899/4015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:15 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:15.637708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:15.638695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:15.659728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.665656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.666485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.667463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:15.671217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:15.671958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:15.734177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.736572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:15.749754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.764626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.767361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb4ca65c-0454-4c36-bbba-e7229c97de70 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1310 microversion: 2.21 time: 0.262590 Aug 30 17:45:15.784216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2117/4016] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:15 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1310 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:15.949509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.967810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.969053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:15.970273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a14afa98-0deb-4b2b-b6b2-eedaf6baf5c6 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.349715 Aug 30 17:45:15.970846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1900/4017] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:15 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:16.137856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:16.138396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:16.146169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.146693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.154560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:16.158548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.159285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.159971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:16.652332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:16.652874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:16.665749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.670827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.672156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:16.673272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.674811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.675451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:16.808460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:16.827191 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ecd3040-c586-4daa-a168-78652d870f50 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.692644 Aug 30 17:45:16.832566 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2118/4018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:16 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:16.851605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:16.852923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:16.865179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.866321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.867230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:16.868134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:16.868645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:16.869084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.053351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.064435 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-caf0fc34-f7d3-43a8-8345-056092d6e33b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.429564 Aug 30 17:45:17.070371 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1901/4019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:16 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:17.082263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:17.083117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:17.104610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.105761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.107235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.110772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.111832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.113267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.162775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.177301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.181302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.190591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65b4a9aa-6724-4536-9f24-f1f86d2aedef tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1316 microversion: 2.21 time: 0.354933 Aug 30 17:45:17.191206 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2119/4020] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:16 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:17.206352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:17.206352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:17.214621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.215151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.215685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.220286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.220786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.221248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.314904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.332868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.334543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.345174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a0328c3-5144-4582-bcd3-b374331f4b36 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.142695 Aug 30 17:45:17.346145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2120/4021] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:17 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:17.702125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:17.727993 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4974e8ed-c1cb-4c14-bfac-1652bafbdacd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.655413 Aug 30 17:45:17.731733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1902/4022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:17 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:17.758249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:17.759273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:17.773520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.775105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.777062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:17.778578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:17.780663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:17.783914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.087833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:18.089809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:18.106695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.107624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.108398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.123238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.124642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.126719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.202117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:18.217105 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf5b0d0a-3836-4a00-bb96-16dbf28cd3a2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.463980 Aug 30 17:45:18.217718 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2121/4023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:17 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:18.242659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:18.243288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:18.267148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.267816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.268489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.275973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.276526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.276974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.486518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:18.503089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:18.511514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:18.514718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-952df567-f832-4ed3-be3f-a81eb34bbdf9 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1316 microversion: 2.21 time: 0.280968 Aug 30 17:45:18.533266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2122/4024] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:18 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:18.546820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:18.551183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:18.565836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.567977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.569772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.571607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.572239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.573581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.795089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:18.810143 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-406b8688-ef88-4f61-a350-cff822e04ad0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.726669 Aug 30 17:45:18.812114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1903/4025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:18 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:18.822203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:18.822810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:18.850847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.851331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.851783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:18.852741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:18.853398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:18.854135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.020627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:19.044983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3fbce7f5-0f0b-4924-ac63-8111b0a42a94 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.510201 Aug 30 17:45:19.045828 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2123/4026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:18 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:19.069545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:19.070927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:19.093924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.095559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.097217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.098620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.099378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.100884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.172244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:19.189135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:19.194879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:19.206690 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e93c5b61-0c2c-41b2-90ec-a6c6726c73e8 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.389290 Aug 30 17:45:19.211676 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1904/4027] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:18 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:19.507714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:19.520804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94403543-865c-467a-b2f5-f7253fcee8d3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.454881 Aug 30 17:45:19.522319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2124/4028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:19 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:19.542547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:19.542773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:19.543161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:19.543276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:19.551974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.552389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.553948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.554519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.555230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.555579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.556920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.558992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.562066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.562259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.562874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.568990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.633586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lazy-loading 'flavor' on Instance uuid 100c6312-01c1-44c8-a98c-b1b04cc96c0e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:19.806186 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-010f29c7-93e2-485a-9e28-6889547fde5b tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.267404 Aug 30 17:45:19.817848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2125/4029] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:45:19 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:19.850754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:19.852887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:19.870658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.871447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.871940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:19.872691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:19.873157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:19.873588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.093169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.104650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.106738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.108257 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b59d7d0-4130-42f2-aa4b-f65705db0171 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.569561 Aug 30 17:45:20.109141 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1905/4030] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:19 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:20.114601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:20.115664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:20.123734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:20.124297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:20.124742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.125460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:20.125914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:20.127964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.198165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.214883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-116d79d1-a28f-4e6a-8bd6-ecfcb62ace3a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1676 microversion: 2.1 time: 0.390725 Aug 30 17:45:20.215833 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2126/4031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:19 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1676 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:20.236022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:20.237092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:20.249542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:20.250641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:20.251176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.252856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:20.253542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:20.254288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.406378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.418680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.420378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.422161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-041759c0-79e0-404a-af70-3398c666f04b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.191341 Aug 30 17:45:20.440294 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2127/4032] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:20 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:20.549522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:20.583220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9465b564-a8b7-4ff7-879a-51a74970650e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.472737 Aug 30 17:45:20.587158 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1906/4033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:20 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:20.887596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a", "tag": "4fa1e973-068e-49c8-83be-03ea683780da"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:20.902693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:20.903900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:20.913885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:20.956833 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] Creating event network-changed:4fa1e973-068e-49c8-83be-03ea683780da for instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a on n-h1-852771-11 Aug 30 17:45:20.968173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2a41a126-b996-4ab3-96c9-f09613fb2127 req-b6644b36-ccbd-46d2-a679-06eb5b2a1e8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084348 Aug 30 17:45:20.969359 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2128/4034] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:21.134394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:21.136396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:21.157543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.160597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.161204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.163828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.163998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.164456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.239321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:21.240951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:21.287607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.288662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.289353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.290548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.291196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.291827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.532321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.554511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.557529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.559707 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-739d154e-dfc6-4ee6-ad7f-930cc49fb8f5 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.432265 Aug 30 17:45:21.572248 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1907/4035] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:21 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:21.584879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:21.585760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:21.593238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.593945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.594533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.595856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.596383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.597153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.739246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.754609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.756311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.757865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:21.760635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5cc18ea7-8d8f-4ded-834a-9d3047fb6748 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.179523 Aug 30 17:45:21.761219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1908/4036] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:21 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:21.771172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:21.774557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:21.779581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-277a6f7d-a90d-4b55-b9d5-68bdf81460d0 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1659 microversion: 2.1 time: 0.546685 Aug 30 17:45:21.789223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.793679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.794375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.795288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.795830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2129/4037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:21 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1659 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:21.796435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.797022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.801250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:21.802101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:21.809374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.810074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.810654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.811613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:21.813832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:21.814426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:21.975836 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5013a3e8-5c47-44d9-bae0-a26a71275dd3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.174983 Aug 30 17:45:21.980137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2130/4038] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:45:21 2022] POST /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:45:21.989383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:21.992940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:22.004596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.005390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:22.008100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.009649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.011836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.013512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.014530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.031177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e2583e53-a9ff-4b47-8130-836b75fdb02a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.265528 Aug 30 17:45:22.032766 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1909/4039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:21 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:22.452375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:22.461385 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be7349fb-7d28-4a5d-aa5c-05a52129e968 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1665 microversion: 2.1 time: 0.476859 Aug 30 17:45:22.473749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2131/4040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:21 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1665 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:22.587352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:22.587996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:22.601891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.604719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.605419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.608321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.608993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.609576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.785016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:22.785879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:22.799190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.800140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.800759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.801623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:22.803991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:22.816187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:22.863493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:23.020873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.036334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.038695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.042796 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e75a6c5e-f41b-4d9e-a77c-3cebc348b970 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.460922 Aug 30 17:45:23.063882 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1910/4041] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:22 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:23.073664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:23.078023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:23.091644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:23.092411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:23.093020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:23.094292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:23.103797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:23.104417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:23.604925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.614666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.621421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.628967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-90eba104-298a-4bc5-b556-9040e4f21640 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.847871 Aug 30 17:45:23.644180 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2132/4042] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:22 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:23.651698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:23.655121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:23.667968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:23.670244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:23.671073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:23.672200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:23.672972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:23.674020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:23.753211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:23.790629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:23.831032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:23.851622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d35e6872-1e3f-4d93-a0f2-c06b19018641 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.784287 Aug 30 17:45:23.854609 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1911/4043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:23 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:24.080203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:24.080848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:24.098839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.102140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.108942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.121268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:24.122771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.125629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.128399 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e709da5c-2ba1-4ed2-837a-990c3da3677a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1665 microversion: 2.1 time: 0.479236 Aug 30 17:45:24.128627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:24.132257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2133/4044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:23 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1665 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:24.139756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:24.437795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.455472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.457106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.462424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5681e0b-868d-460e-926a-64dd0f4a459e tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.387518 Aug 30 17:45:24.465080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1912/4045] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:24 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:24.657134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:24.657675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:24.659671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:24.677305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.678088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.678524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:24.679160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.679727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.680183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:24.775088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.792875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.798699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:24.800761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c594f9b-52cb-4809-8214-3b0785744416 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.147631 Aug 30 17:45:24.815513 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2134/4046] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:24 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:24.879054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:24.879776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:24.889546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.890036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.895010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:24.897557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:24.898079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:24.898525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.114560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.127194 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e2d8219-8004-4caa-8db4-abe31ee57479 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.251792 Aug 30 17:45:25.165348 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1913/4047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:24 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:25.167511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:25.168531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:25.192860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.193842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.195682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.197029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.198201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.199206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.426525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.435674 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5387cb3b-d02c-4d60-84d7-61fac8fb76da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.282518 Aug 30 17:45:25.437139 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2135/4048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:25 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:25.461599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:25.469957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:25.481225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a", "name": "network-vif-plugged", "status": "completed", "tag": "4fa1e973-068e-49c8-83be-03ea683780da"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:25.491292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.493919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.495971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.498531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.499826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.501739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.516034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.516834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.517172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.557306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] Creating event network-vif-plugged:4fa1e973-068e-49c8-83be-03ea683780da for instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a on n-h1-852771-11 Aug 30 17:45:25.571491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-67e5edb2-de3e-4508-8ec6-e23d455c84ca req-fc3c60ef-3851-46ce-91f2-1ba556bbd5fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103236 Aug 30 17:45:25.572129 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2136/4049] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:25.590106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:25.597206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:25.605154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.605648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.606078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.606785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.607235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.607689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.814823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.834775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.837543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.839176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d625f46-7652-4748-a60f-56c144ae28be tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.253759 Aug 30 17:45:25.858057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2137/4050] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:25 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:25.866290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:25.866886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:25.876453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.877113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.877556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.879701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:25.882894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:25.883465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:25.950606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:25.975440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9cd89921-49ed-44ca-a568-f3aa0719dda3 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1668 microversion: 2.1 time: 0.518408 Aug 30 17:45:25.976071 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1914/4051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:25 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1668 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:26.000571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:26.001090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:26.015434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.016126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.017375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:26.018131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.020766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.024191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:26.032595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:26.047880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:26.052000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:26.055687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f81519d6-c6f9-4558-8073-c39173cfb337 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.194056 Aug 30 17:45:26.056366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2138/4052] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:25 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:26.096332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:26.104525 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Working on deleting snapshot 00beb684-dba8-477f-995d-41a1720fe6e3 from shelved instance... Aug 30 17:45:26.168961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:26.169666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:26.181362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.181869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.182307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:26.183024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.183503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.183938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:26.438641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:26.452755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c3133cf-e64d-4d0b-97f6-6bf10a9353b4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.288209 Aug 30 17:45:26.467508 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2139/4053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:26 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:26.867085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:26.867866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:26.885600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.886122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.891131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:26.891131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:26.893051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:26.893051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.184100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.195222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.196931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.198226 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92d43ac5-538b-4207-be6f-f296d9748b0c tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1358 microversion: 2.21 time: 0.337414 Aug 30 17:45:27.199065 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2140/4054] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:26 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:27.223059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:27.232343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:27.245589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.261318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.262009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.263397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.265122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.268044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Doing local delete in cell d64e249a-e872-487f-b759-da855b1e5621(cell1) {{(pid=122123) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 17:45:27.268444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.269811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.270366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.271945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.272400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 17:45:27.276305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] deallocate_for_instance() {{(pid=122123) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 17:45:27.380185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.401401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.404688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.406601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf4ba91c-6389-49ce-bb72-f22bdf84f9d4 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.205938 Aug 30 17:45:27.408406 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2141/4055] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:27 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:27.488561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:27.490980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:27.502078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.502800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.503636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.504569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.505177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.506385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:27.716184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:27.724819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c307916-3e62-4cc1-8eb1-0121da26fbd4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.246252 Aug 30 17:45:27.725626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2142/4056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:27 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:27.937764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Updating instance_info_cache with network_info: [] {{(pid=122123) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 17:45:27.947454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d07349-8f33-4482-ae40-072b7843dc45", "name": "network-vif-deleted", "tag": "234e8dee-5a44-43c5-8f91-4fd57ed789a6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:27.970259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:27.976286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:27.976828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.011307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] Unable to find a host for instance d3d07349-8f33-4482-ae40-072b7843dc45. Dropping event network-vif-deleted {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:45:28.012406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-364a12c5-6908-4d9a-a1b3-3c402c815886 req-66f1f408-5cc6-4779-817b-14e5b9151038 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.077023 Aug 30 17:45:28.031557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2143/4057] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:45:28.222038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.222691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.237220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.237700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.238390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.243426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.249335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.249793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.310167 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6bb3bc3a-8181-4a25-aacc-5200da41ec0d tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 204 len: 0 microversion: 2.1 time: 2.311447 Aug 30 17:45:28.311699 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1915/4058] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:25 2022] DELETE /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 0 bytes in 2315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:45:28.321331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.321947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: d3d07349-8f33-4482-ae40-072b7843dc45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.356472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.356937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.357372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.358173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.358760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.359085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.399457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 HTTP/1.1 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd3d07349-8f33-4482-ae40-072b7843dc45'} Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:28.399850 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. Aug 30 17:45:28.403724 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:28.405760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 404 to user: Instance d3d07349-8f33-4482-ae40-072b7843dc45 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:28.407804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-daff3c65-cd9a-4e23-b84b-8c8eec0e711e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45" status: 404 len: 111 microversion: 2.1 time: 0.090549 Aug 30 17:45:28.409376 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1916/4059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/d3d07349-8f33-4482-ae40-072b7843dc45 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:45:28.422332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.423342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.433987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.434506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.434946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.435959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.440328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.440757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.518102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:28.569313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.582599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.586726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.592916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f16c443-3fc3-4422-9903-4c9e1741c7d4 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1552 microversion: 2.21 time: 0.375096 Aug 30 17:45:28.594499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2144/4060] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1552 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:28.599923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.600538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.606614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.607097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.607716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.608550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.609137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.609695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.679999 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5ef525c-e777-47f7-9d1a-b8974a42d5a7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 204 len: 0 microversion: 2.1 time: 0.262427 Aug 30 17:45:28.681118 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1917/4061] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:28 2022] DELETE /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:45:28.687371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.688046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.695837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.696331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.696770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.697473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.697926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.698352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.738946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:28.759772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.779612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.781539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.782890 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb69a1a2-33a0-4b84-ab53-970340a4530b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.187294 Aug 30 17:45:28.783907 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2145/4062] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:28.790245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.791348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.799016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.800002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.801075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.803234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.803955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.804597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.887706 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-300561e4-9fd4-4db4-946f-68447e2b0695 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 204 len: 0 microversion: 2.21 time: 0.204344 Aug 30 17:45:28.888994 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1918/4063] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:45:28 2022] DELETE /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:45:28.901149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.901872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:28.920302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.920792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.921217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.921914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:28.922361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:28.922778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:28.971151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:28.984316 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92166940-4b38-48bb-94fb-6d340cce9287 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1465 microversion: 2.1 time: 0.198525 Aug 30 17:45:28.985734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2146/4064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1465 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:28.996283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:28.997262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:29.006684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:29.007925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:29.008672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:29.009815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:29.010548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:29.011403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:29.175606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.193909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.196199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.197624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c3e3b54-48ca-4365-acbc-1c6919b2f27f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1558 microversion: 2.21 time: 0.210699 Aug 30 17:45:29.199604 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2147/4065] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:29.448180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.456178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:29.461308 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-240cd32e-7af5-4ac3-98fa-d83853d53ac4 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.570588 Aug 30 17:45:29.462255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1919/4066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:28 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:29.812483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:29.813286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:29.816835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:29.825033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:29.825938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:29.826745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:29.827796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:29.828401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:29.829157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:29.920014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.934222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.936948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:29.939064 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8df5f0ab-9e33-4d12-bb08-8b697b61dc94 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1605 microversion: 2.42 time: 0.130728 Aug 30 17:45:29.940525 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2148/4067] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:29 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:30.006338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:30.007018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:30.023672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.025348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.026662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.028556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.029273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.030118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.223145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:30.223924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:30.235457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.238068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.238626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.240717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.244350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.245070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.327199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:30.337333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5a08718-e1bb-44d8-8dd2-3c70dc5b2196 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1465 microversion: 2.1 time: 0.334725 Aug 30 17:45:30.347198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1920/4068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:30 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1465 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:30.486770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:30.488975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:30.497307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.498117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.499189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.500218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.500910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.501590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.651132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:30.665206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:30.667089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:30.668497 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a544404a-dec2-40b3-bc83-c9d20e6b7c0f tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1558 microversion: 2.21 time: 0.450018 Aug 30 17:45:30.669257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2149/4069] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:30 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1558 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:30.964834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:30.965945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:30.969276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:30.979134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.979910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.980311 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-836c70e0-8488-4624-b3f2-61305f12a27b tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.498881 Aug 30 17:45:30.980980 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1921/4070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:30 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:30.983662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:30.984634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:30.985109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:30.985609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.017917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:31.064031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.064712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.065174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.065638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lazy-loading 'fault' on Instance uuid d29f9666-d9f6-44d9-b2d9-80b65da2c884 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:31.199542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.211650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.213246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59f53cefb4b9447aa5665fc9b9ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc892859f18341db86c3a9e931d683a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.214529 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b08979c8-a434-4bcf-9339-5a0d233e5acd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 200 len: 1610 microversion: 2.42 time: 0.255745 Aug 30 17:45:31.215117 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2150/4071] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:30 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 1610 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:45:31.216573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e592710-30bd-4e8d-afe4-3e1d0743e1ed", "name": "network-vif-deleted", "tag": "2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:31.285163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.288330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.290604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.336334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] Creating event network-vif-deleted:2ba9046a-2dd5-4c13-be2e-1541d7d8a1c4 for instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed on n-h2-852771-11 Aug 30 17:45:31.346213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-72e3c9e9-dabc-4d95-9139-cbd697464b41 req-9b8e27d9-534d-4f65-bb71-58ac595fc2c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149391 Aug 30 17:45:31.347575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1922/4072] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:31.371351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:31.371997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:31.378583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.379126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.379685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.380575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.381032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.382015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.466549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.467047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.467718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.468177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lazy-loading 'fault' on Instance uuid 5e592710-30bd-4e8d-afe4-3e1d0743e1ed {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:31.553220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.564856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d12a38ca-9050-4ebe-8919-ba8275e85473 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 200 len: 1305 microversion: 2.1 time: 0.197373 Aug 30 17:45:31.570355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2151/4073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:31 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 1305 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:31.697196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:31.697874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:31.712306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.712972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.714409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.715294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.725247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.726038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.761507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a", "name": "network-vif-deleted", "tag": "4fa1e973-068e-49c8-83be-03ea683780da"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:31.803439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:31.803968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:31.804437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:31.853232 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] Creating event network-vif-deleted:4fa1e973-068e-49c8-83be-03ea683780da for instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a on n-h1-852771-11 Aug 30 17:45:31.868828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-77b800a1-0dac-4f16-b2d2-11e595d5b128 req-3a1e2ed7-1d1f-4b51-bcac-815f66dae596 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117445 Aug 30 17:45:31.869873 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2152/4074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:31.880122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.900292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.903343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ac26d5d104e40d2b5d1af9acc9f1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b4878f3b444044b4bb9ea8104436bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:31.905653 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-394257bd-d3a7-44ed-8661-c18b1e1c77c2 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 200 len: 1516 microversion: 2.21 time: 0.213748 Aug 30 17:45:31.906483 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1923/4075] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:31 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:45:32.006176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.007183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.026158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.027427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.027921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.028791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.029325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.029948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.243353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.244892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.256477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.257403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.258308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.259547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.260560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.261395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.296899 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] HTTP exception thrown: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Request method failure captured: Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 HTTP/1.1 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDksSA4MR5E6ZTHrAOdjaX5Em5unWl6mVFOZpWrQEuYGmwHM081J7zdMZhFSYV8nxWPNBlRE3pUPOq2yJWPaOnZmXsIbQt2VRyA8yzt78ScROSQhN-NvYoaRAMsAudQHveoOqpLnuN-5BAZElcgm5eCWa4B7_CN4HMjEDqyyCfEHY8Eo Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dc892859f18341db86c3a9e931d683a8"}]}] Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 59f53cefb4b9447aa5665fc9b9ef5e1a Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd29f9666-d9f6-44d9-b2d9-80b65da2c884'} Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.299906 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:32.304539 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.305833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:32.315856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Returning 404 to user: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:32.323140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56e3bd9d-b37c-4101-82bb-5cde25352f63 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 404 len: 111 microversion: 2.42 time: 0.086866 Aug 30 17:45:32.324756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6014a240-7e71-4384-9d78-8febf7543710 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.324823 Aug 30 17:45:32.325715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2153/4077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:31 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:32.325891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1924/4077] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:32 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:45:32.338470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-881be049-34b3-41aa-a5e4-08f73be282bd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '.version_select at 0x7f2d9cb6faf0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.381385 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-881be049-34b3-41aa-a5e4-08f73be282bd tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343930443" status: 204 len: 0 microversion: 2.42 time: 0.051132 Aug 30 17:45:32.387065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1925/4078] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:45:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343930443 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:45:32.600416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.601696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 5e592710-30bd-4e8d-afe4-3e1d0743e1ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.612651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.613409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.613901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.615690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.616553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.617144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.636748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed HTTP/1.1 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5e592710-30bd-4e8d-afe4-3e1d0743e1ed'} Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:32.639744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. Aug 30 17:45:32.645268 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:32.651002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 404 to user: Instance 5e592710-30bd-4e8d-afe4-3e1d0743e1ed could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:32.653460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87389b8f-64b0-432f-82ed-378f027172da tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed" status: 404 len: 111 microversion: 2.1 time: 0.060367 Aug 30 17:45:32.654557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2154/4079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:32 2022] GET /compute/v2.1/servers/5e592710-30bd-4e8d-afe4-3e1d0743e1ed => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:45:32.664723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.665507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.672513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.673248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.673683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.674413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.674873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.675335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.712652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:32.888492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:32.892908 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-974b3922-2060-4fd8-8310-4bc508e48b54 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 204 len: 0 microversion: 2.1 time: 0.234007 Aug 30 17:45:32.905759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.906444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.910641 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1926/4080] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:32 2022] DELETE /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:45:32.914695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.915401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.916223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.917185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.917808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.918416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.935839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:32.936716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:32.955287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.956170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.956783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.957730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:32.958955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:32.960095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:32.998371 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] HTTP exception thrown: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Request method failure captured: Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a HTTP/1.1 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkynEkxz4VQwl1VTlzr8xxmly879lzeE7leyjn05IVX9cdtH8-DalRGqxzA9ktG0F2H3ckRisCKG8-5kelO1f6jXETSHlFbBBCjOLUfafjehf4frrlJGb3caKmUX1hTS6DO8-C8msmqZbHFvx7_dKpow0l7DYplJtzpOy-lPqZ-AoHo Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0b4878f3b444044b4bb9ea8104436bc"}]}] Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0ac26d5d104e40d2b5d1af9acc9f1f41 Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a'} Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.008802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.013176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.016126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Returning 404 to user: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:33.017176 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f504453c-164b-488d-b79b-d9e829102101 tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 404 len: 111 microversion: 2.21 time: 0.087268 Aug 30 17:45:33.022135 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1927/4081] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:32 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:45:33.028199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '.version_select at 0x7f2d9827c3a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.029075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:33.035839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.037444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.038583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.039559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.040280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.040919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.148773 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c852e410-2f3b-4fff-9cc5-f29fb3ee6efe tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.124554 Aug 30 17:45:33.153323 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1928/4082] 10.222.0.50 () {60 vars in 1337 bytes} [Tue Aug 30 17:45:33 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a/os-instance-actions => generated 611 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:45:33.167364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.167898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:33.173899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.174374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.174814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.175528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.176158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.176740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.193028 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] HTTP exception thrown: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Request method failure captured: Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a HTTP/1.1 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkynEkxz4VQwl1VTlzr8xxmly879lzeE7leyjn05IVX9cdtH8-DalRGqxzA9ktG0F2H3ckRisCKG8-5kelO1f6jXETSHlFbBBCjOLUfafjehf4frrlJGb3caKmUX1hTS6DO8-C8msmqZbHFvx7_dKpow0l7DYplJtzpOy-lPqZ-AoHo Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0b4878f3b444044b4bb9ea8104436bc"}]}] Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0ac26d5d104e40d2b5d1af9acc9f1f41 Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a'} Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:33.195753 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.199406 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.202077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Returning 404 to user: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:33.203258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d69c786-071b-4925-bb58-ed160a443b3a tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 404 len: 111 microversion: 2.21 time: 0.040405 Aug 30 17:45:33.207632 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1929/4083] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:45:33 2022] DELETE /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:45:33.216035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.217013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] [instance: 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:33.224699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.225647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.226951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.227279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.227988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.228477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.245352 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] HTTP exception thrown: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Request method failure captured: Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a HTTP/1.1 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkynEkxz4VQwl1VTlzr8xxmly879lzeE7leyjn05IVX9cdtH8-DalRGqxzA9ktG0F2H3ckRisCKG8-5kelO1f6jXETSHlFbBBCjOLUfafjehf4frrlJGb3caKmUX1hTS6DO8-C8msmqZbHFvx7_dKpow0l7DYplJtzpOy-lPqZ-AoHo Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0b4878f3b444044b4bb9ea8104436bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0b4878f3b444044b4bb9ea8104436bc"}]}] Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a0b4878f3b444044b4bb9ea8104436bc Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-867161579 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0ac26d5d104e40d2b5d1af9acc9f1f41 Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceActionsV221TestJSON-867161579-project Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a'} Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.247251 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:33.252253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] Returning 404 to user: Instance 3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:33.253600 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-81eb04fe-eaba-47d8-92c9-d7a06eda55ac tempest-InstanceActionsV221TestJSON-867161579 tempest-InstanceActionsV221TestJSON-867161579-project] 10.222.0.50 "GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a" status: 404 len: 111 microversion: 2.21 time: 0.042626 Aug 30 17:45:33.271897 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1930/4084] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:33 2022] GET /compute/v2.1/servers/3e4be0e4-5be1-491f-9c0f-7f2596cbbb3a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:45:33.348859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.350476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:33.364197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.367468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.368131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.368989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.369592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.372282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.373358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:33.389132 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-913f1e2c-de1d-4ff8-b081-ed6e2db3dd67 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1507 microversion: 2.1 time: 0.490632 Aug 30 17:45:33.403406 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2155/4085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:32 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:33.634923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.640740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:33.643694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Searching by: {'deleted': False, 'project_id': '848833b99ee74c5f828a06638a56cb64'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:45:33.661305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.663120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.663966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.667269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.668967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.669991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.738742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:45:33.822847 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a75297f-c46b-4342-9fea-cb6d37a9b18f tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195919 Aug 30 17:45:33.826873 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2156/4086] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:45:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:33.858679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:33.873363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:33.878732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Searching by: {'deleted': False, 'project_id': '848833b99ee74c5f828a06638a56cb64'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:45:33.893326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.895001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.897074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.898452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:33.900977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:33.902146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:33.913255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:33.924892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c97bd3e4-fc52-42c0-938a-c6c844c89346 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.580072 Aug 30 17:45:33.925787 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1931/4087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:33 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:33.965341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:45:34.053953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:34.064921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.065542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.066096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.392228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d75c4a49-ba59-4a0d-a07b-218d7ac9e31c tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.549175 Aug 30 17:45:34.393117 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2157/4088] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:45:33 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:34.418200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:34.418883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:34.420936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b78894c-60df-4a20-b86c-0ccd817606d6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:34.431227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b78894c-60df-4a20-b86c-0ccd817606d6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014997 Aug 30 17:45:34.435755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.439832 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2158/4089] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:45:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:34.439988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.440389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.441155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.441624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.442056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.815723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:34.817110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:34.832856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.834586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.835283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.836239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.836890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.837736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.887703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:34.890706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:34.900938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-51e60f6f-bfa3-4f19-a927-ae48845c1ce7 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1507 microversion: 2.1 time: 0.488306 Aug 30 17:45:34.904238 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1932/4090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:34 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:34.950335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:34.951675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:34.961607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.965833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.966461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:34.967351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:34.968005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:34.969049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:35.108290 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e71bef8-cf65-4a10-85bc-bfa56ee1440b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 204 len: 0 microversion: 2.1 time: 0.295351 Aug 30 17:45:35.108980 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2159/4091] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:34 2022] DELETE /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:45:35.119952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:35.120981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:35.147801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:35.149093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:35.149542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:35.150272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:35.150724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:35.151147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:35.451041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:35.466924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca9d483f-0c2a-453a-a5c3-576317da93b1 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1607 microversion: 2.1 time: 0.352938 Aug 30 17:45:35.470468 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2160/4092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:35 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1607 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:35.628340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:35.649586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd435306-07f1-4910-92a3-737620c225ad tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.703238 Aug 30 17:45:35.650148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1933/4093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:34 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:35.925591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:35.926344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:35.936553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:35.937039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:35.937477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:35.938183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:35.938637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:35.939058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:36.211132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:36.219688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0278e81-0d57-4f31-90bd-f89751841e85 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 200 len: 1507 microversion: 2.1 time: 0.298719 Aug 30 17:45:36.224841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2161/4094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:35 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:36.383573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adba95-8c84-42d8-a8a2-20a91aa97a7b", "name": "network-vif-deleted", "tag": "51762020-2c1c-411b-90be-07851a7dba6b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:36.413575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:36.418667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:36.420128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:36.457105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] Creating event network-vif-deleted:51762020-2c1c-411b-90be-07851a7dba6b for instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b on n-h1-852771-11 Aug 30 17:45:36.474723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b12c4769-3d8f-4009-9eae-b201a34e0649 req-04bbdd43-a62c-4181-86f5-a4932c93d53e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100140 Aug 30 17:45:36.476593 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1934/4095] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:36.497575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:36.498481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:36.509627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:36.514089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:36.516682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:36.517676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:36.524251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:36.524913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:36.679003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:36.680598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:36.688536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:36.689036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:36.689525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:36.690447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:36.691058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:36.691690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.175432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:37.187465 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2df337c-a413-4d72-9eff-fce1bea54367 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 0.520713 Aug 30 17:45:37.190313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1935/4096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:36 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:37.247045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:37.248395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 36adba95-8c84-42d8-a8a2-20a91aa97a7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:37.260310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.265050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.268115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.269686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.270444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.272144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.291404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b HTTP/1.1 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '36adba95-8c84-42d8-a8a2-20a91aa97a7b'} Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:37.293931 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. Aug 30 17:45:37.298370 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:37.300276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 404 to user: Instance 36adba95-8c84-42d8-a8a2-20a91aa97a7b could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:37.301385 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4a6d37c-753f-4fbd-9a8f-00c61b422e66 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b" status: 404 len: 111 microversion: 2.1 time: 0.059330 Aug 30 17:45:37.302921 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1936/4097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:37 2022] GET /compute/v2.1/servers/36adba95-8c84-42d8-a8a2-20a91aa97a7b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:45:37.311092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:37.312290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:37.323015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.323720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.324317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.325381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.326002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.326590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.384881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:37.530782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f049be98-ac1f-414a-9f31-f83ceb210d4a tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 204 len: 0 microversion: 2.1 time: 0.224107 Aug 30 17:45:37.532869 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1937/4098] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:37 2022] DELETE /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:45:37.543358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:37.544458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:37.551637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.554493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.555185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.556156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:37.557599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:37.558351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:37.664563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:37.674884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7bac82c6-fec7-477f-8b51-bcf3db531fa7 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1607 microversion: 2.1 time: 1.181545 Aug 30 17:45:37.690556 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2162/4099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:36 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1607 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:37.852084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:37.857032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:37.872278 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea1bc717-6ddf-48c2-b727-20a6dbe8d7cd tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1495 microversion: 2.1 time: 0.334625 Aug 30 17:45:37.877299 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1938/4100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:37 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1495 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:38.218299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:38.219277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:38.229310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:38.234180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:38.235751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:38.240311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:38.241083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:38.241757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:38.698464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:38.699252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:38.723472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:38.724865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:38.729735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:38.731717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:38.733045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:38.735392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:39.551419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:39.562648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66bc0cc4-05d7-4a20-92ac-f480e144ddca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1510 microversion: 2.1 time: 1.348498 Aug 30 17:45:39.571014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2163/4101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:38 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1510 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:39.584459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:39.589007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:39.596967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:39.600326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:39.602978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:39.603927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:39.604524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:39.608079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:39.977014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:39.991619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-13293b08-a57d-4215-9744-01348f95f625 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1607 microversion: 2.1 time: 1.296571 Aug 30 17:45:40.008234 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1939/4102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:38 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1607 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:40.327164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:40.354815 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50e80a0b-fdde-41e8-94bb-579debd7a1c2 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1495 microversion: 2.1 time: 0.782404 Aug 30 17:45:40.376051 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2164/4103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:39 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1495 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:40.585398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:40.586009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:40.600501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:40.609974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:40.610594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:40.611362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:40.611868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:40.612298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.023131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:41.023923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:41.037519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.039196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.040441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.043086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.044324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.046338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.563105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:41.575807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:41.600158 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8bd343a4-1655-428e-9b2d-0612fc4bbe8e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1487 microversion: 2.1 time: 1.019190 Aug 30 17:45:41.619574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1940/4104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:40 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1487 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:41.622354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7bac0391-ccd2-4c3f-be76-4249e5a92ece tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1539 microversion: 2.1 time: 0.596292 Aug 30 17:45:41.624767 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2165/4105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:41 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1539 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:41.671003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2067d9-0aee-4f3c-af42-19044e15fc01", "name": "network-vif-deleted", "tag": "0058e789-104d-4d37-8859-48a816dceb0f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:41.676243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:41.682589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:41.710143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.710637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.711077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.718517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.720264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.724671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.725169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.726722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.727350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.731415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:41.769459 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] Creating event network-vif-deleted:0058e789-104d-4d37-8859-48a816dceb0f for instance ac2067d9-0aee-4f3c-af42-19044e15fc01 on n-h2-852771-11 Aug 30 17:45:41.793718 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4a0eb6fe-2e14-45fd-8f55-ecd4ec14b9f0 req-74b9a191-3207-41bf-927d-c76635a526f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163248 Aug 30 17:45:41.794866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1941/4106] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:41.803124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:41.803971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:41.812131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.813004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.813575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.814564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:41.815166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:41.815829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:41.867092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:42.030672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:42.049611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6871419a-ba8a-43d0-834a-b5f3238be682 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 200 len: 1453 microversion: 2.1 time: 0.405805 Aug 30 17:45:42.050781 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2166/4107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:41 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 1453 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:42.113263 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89970fbf-1828-4658-adfc-1543315cfd82 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 204 len: 0 microversion: 2.1 time: 0.316489 Aug 30 17:45:42.113869 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1942/4108] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:41 2022] DELETE /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:45:42.123336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:42.124359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:42.143462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc7f966-c683-4425-ac13-32cfcbd4389f", "name": "network-vif-deleted", "tag": "f78f2d97-3c84-49e7-9c60-58b34bfacfdd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:42.146334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:42.150722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:42.152795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:42.157861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:42.160479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:42.160941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:42.187420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:42.187976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:42.191188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:42.244375 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] Creating event network-vif-deleted:f78f2d97-3c84-49e7-9c60-58b34bfacfdd for instance 6bc7f966-c683-4425-ac13-32cfcbd4389f on n-h2-852771-11 Aug 30 17:45:42.256273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a2a2e684-820c-4682-af7d-5a4fbcd99e97 req-2543daec-8a87-41d9-b4ab-c36c33528d17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126687 Aug 30 17:45:42.258666 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1943/4109] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:45:42.649377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:42.651082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:42.666322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:42.667348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:42.669237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:42.671119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:42.673342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:42.674004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:42.680901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:42.689010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8240685-7b92-4c32-abed-5a44a15193b2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1493 microversion: 2.1 time: 0.570515 Aug 30 17:45:42.693717 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2167/4110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:42 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1493 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:43.074707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:43.076934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 6bc7f966-c683-4425-ac13-32cfcbd4389f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:43.098077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.099440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.100108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.101021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.101676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.102316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.139985 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f HTTP/1.1 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6bc7f966-c683-4425-ac13-32cfcbd4389f'} Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:43.142023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. Aug 30 17:45:43.146114 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:43.149235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 404 to user: Instance 6bc7f966-c683-4425-ac13-32cfcbd4389f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:43.150339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98358d67-3c91-4ae8-849d-535244144558 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f" status: 404 len: 111 microversion: 2.1 time: 0.079816 Aug 30 17:45:43.151145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2168/4111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:43 2022] GET /compute/v2.1/servers/6bc7f966-c683-4425-ac13-32cfcbd4389f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:45:43.162276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:43.164852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:43.183008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.183916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.184820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.185797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.186471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.189594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.260324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:45:43.415087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4127fe9d-0401-4e7f-945b-b6641f858b03 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 204 len: 0 microversion: 2.1 time: 0.254531 Aug 30 17:45:43.417411 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2169/4112] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:45:43 2022] DELETE /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:45:43.431777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:43.432527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:43.465416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.465918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.466358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.469206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.469707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.470148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.800348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:43.816699 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ed16482-a3b4-4e27-b87f-5967325eaffe tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1674 microversion: 2.1 time: 0.394537 Aug 30 17:45:43.822256 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2170/4113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:43 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1674 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:43.839028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:43.840352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:43.849243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.865027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.869579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.870363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:43.871413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:43.872234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:43.948219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:44.052703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:44.207495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:44.219303 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a07df05e-fb0f-418b-9a61-a81c94145589 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1251 microversion: 2.1 time: 1.574608 Aug 30 17:45:44.220297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1944/4114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:42 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1251 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:44.424813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:44.473029 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f02e74f3-82c0-471b-b6eb-db4cbe929613 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1493 microversion: 2.1 time: 0.648772 Aug 30 17:45:44.475129 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2171/4115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:43 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1493 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:44.848307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:44.848951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:44.863761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:44.865407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:44.865947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:44.868064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:44.868530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:44.870582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:44.972259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a309c56c-6ff8-40bc-b302-4de325bb2d84", "name": "network-vif-deleted", "tag": "f795dbf1-e02e-43bc-9955-e2f746a288bf"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:44.994380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:44.994866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:44.996126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.038111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] Creating event network-vif-deleted:f795dbf1-e02e-43bc-9955-e2f746a288bf for instance a309c56c-6ff8-40bc-b302-4de325bb2d84 on n-h1-852771-11 Aug 30 17:45:45.050159 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-071f252d-f426-4294-8cfc-d994d6e32eb3 req-3ddaf5b4-3603-41da-a68b-c33e1e8fdbe1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081748 Aug 30 17:45:45.051833 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2172/4116] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:45:45.243632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:45.244655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:45.270083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.271301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.272080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.273477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.289432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.290096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.402639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:45.412397 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6be8e489-1354-4299-906f-13cea5cd887c tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1674 microversion: 2.1 time: 0.571529 Aug 30 17:45:45.424991 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1945/4117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:44 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1674 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:45.457199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:45.468774 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0dd888d0-ac1b-465d-ab8f-0c357d6dcc41 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1251 microversion: 2.1 time: 0.232824 Aug 30 17:45:45.472261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2173/4118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:45 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1251 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:45.497848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:45.498875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:45.510569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.512061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.514872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.515869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.516520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.518825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.594316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:45.595150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:45.607187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.628840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.629303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.630915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.631417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.641297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.648525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.649021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.649466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.649929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lazy-loading 'fault' on Instance uuid a309c56c-6ff8-40bc-b302-4de325bb2d84 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:45.698601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] HTTP exception thrown: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Request method failure captured: Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 HTTP/1.1 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDksSA4MR5E6ZTHrAOdjaX5Em5unWl6mVFOZpWrQEuYGmwHM081J7zdMZhFSYV8nxWPNBlRE3pUPOq2yJWPaOnZmXsIbQt2VRyA8yzt78ScROSQhN-NvYoaRAMsAudQHveoOqpLnuN-5BAZElcgm5eCWa4B7_CN4HMjEDqyyCfEHY8Eo Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dc892859f18341db86c3a9e931d683a8"}]}] Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 59f53cefb4b9447aa5665fc9b9ef5e1a Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'd29f9666-d9f6-44d9-b2d9-80b65da2c884'} Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:45.701043 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.706023 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.712313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Returning 404 to user: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:45.714363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2cd61207-23ed-4402-b6da-422dc689186b tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 404 len: 111 microversion: 2.42 time: 0.125209 Aug 30 17:45:45.725050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2174/4119] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:45:45 2022] DELETE /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:45:45.736031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:45.737889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] [instance: d29f9666-d9f6-44d9-b2d9-80b65da2c884] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:45.759781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.760551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.768347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.769346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:45.769982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:45.772958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:45.825545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:45.835440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] HTTP exception thrown: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Request method failure captured: Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 HTTP/1.1 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDksSA4MR5E6ZTHrAOdjaX5Em5unWl6mVFOZpWrQEuYGmwHM081J7zdMZhFSYV8nxWPNBlRE3pUPOq2yJWPaOnZmXsIbQt2VRyA8yzt78ScROSQhN-NvYoaRAMsAudQHveoOqpLnuN-5BAZElcgm5eCWa4B7_CN4HMjEDqyyCfEHY8Eo Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dc892859f18341db86c3a9e931d683a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dc892859f18341db86c3a9e931d683a8"}]}] Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: dc892859f18341db86c3a9e931d683a8 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-691800249 Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 59f53cefb4b9447aa5665fc9b9ef5e1a Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TaggedBootDevicesTest_v242-691800249-project Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'd29f9666-d9f6-44d9-b2d9-80b65da2c884'} Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.837300 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. Aug 30 17:45:45.841834 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:45:45.843233 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db8b3730-ffe7-49a8-81ee-205da4733d01 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 200 len: 1304 microversion: 2.1 time: 0.341015 Aug 30 17:45:45.852575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] Returning 404 to user: Instance d29f9666-d9f6-44d9-b2d9-80b65da2c884 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:45.856971 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1946/4120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:45 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 1304 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:45.860487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8007b26-5118-4aaf-a034-564b97bcc679 tempest-TaggedBootDevicesTest_v242-691800249 tempest-TaggedBootDevicesTest_v242-691800249-project] 10.222.0.50 "GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884" status: 404 len: 111 microversion: 2.42 time: 0.128822 Aug 30 17:45:45.867269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2175/4121] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:45:45 2022] GET /compute/v2.1/servers/d29f9666-d9f6-44d9-b2d9-80b65da2c884 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:45:46.447766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:46.448382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:46.466521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:46.467186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:46.467833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:46.468720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:46.469331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:46.469986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:46.503998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:46.505922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:46.522000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:46.523209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:46.523914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:46.524844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:46.525577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:46.526217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:46.960141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:46.974321 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5146e42-793c-41d1-b4b5-858393121b37 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1674 microversion: 2.1 time: 0.531012 Aug 30 17:45:46.992500 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1947/4122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:46 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1674 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:47.011839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:47.015755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:47.045981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:47.047027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:47.048280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:47.049743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:47.050346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:47.051081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:47.070669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 HTTP/1.1 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a309c56c-6ff8-40bc-b302-4de325bb2d84'} Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:47.072802 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:45:47.077540 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:47.078903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:47.080974 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dae2bd3d-15af-4ff9-8813-5c3064d637f6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 404 len: 111 microversion: 2.1 time: 0.086749 Aug 30 17:45:47.081717 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1948/4123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:46 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:45:47.241371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100c6312-01c1-44c8-a98c-b1b04cc96c0e", "name": "network-vif-deleted", "tag": "eba07ae4-7eac-47ec-b742-d7882a9c04c4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:47.255975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:47.256734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:47.257409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:47.294604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] Creating event network-vif-deleted:eba07ae4-7eac-47ec-b742-d7882a9c04c4 for instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e on n-h2-852771-11 Aug 30 17:45:47.300502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:47.309425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d48d61cb-ba55-4969-a03f-c1e2157c52f7 req-ad09083e-e4d3-42ed-b317-5f147b38ef26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074088 Aug 30 17:45:47.310760 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1949/4124] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 17:45:47.317124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2013341329", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "4d6544d8-9a3a-47a9-9910-cb4b42eb8d96"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:47.318293 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ac61daf-7cf6-4ff9-bd25-a593beccec66 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1251 microversion: 2.1 time: 0.818853 Aug 30 17:45:47.322108 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2176/4125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:46 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1251 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:47.490122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] validate_networks() for [('4d6544d8-9a3a-47a9-9910-cb4b42eb8d96', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:45:48.000705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:48.002927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:48.024582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.026415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.028434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.031884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.033991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.039736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.136503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.137324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.138052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.138693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lazy-loading 'fault' on Instance uuid 100c6312-01c1-44c8-a98c-b1b04cc96c0e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:48.232288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6439f09540af4d31a6e60ee1c7aee8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf5f68455814153b89800033ef5a061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:48.246958 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-145cd64f-68c8-452f-ad68-931a957b8627 tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 200 len: 1328 microversion: 2.1 time: 0.250689 Aug 30 17:45:48.250334 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2177/4126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:47 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 1328 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:48.341763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:48.341995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:48.354295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.364584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.365255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.368654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.371074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.372304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.385533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:45:48.386410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:45:48.387054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:45:48.387879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:45:48.388473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:45:48.420418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.437409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.437409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.437409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:48.437409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:48.437409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:48.506862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:45:48.522425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Getting quotas for user 544632145bd8469daf47e1a5c8566402 and project ed4a3709d3d94e2ebd5f1f65fa932c5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:45:48.551248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:48.552463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:45:48.555231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:45:48.574805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-33bc48b1-7c9f-4fbc-9eae-ec1707314941 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1251 microversion: 2.1 time: 0.238420 Aug 30 17:45:48.600871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2178/4127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:48 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1251 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:48.641892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fd00605-c41d-483d-84eb-d882a50689cf tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324283 Aug 30 17:45:48.643092 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1950/4128] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:45:48.662992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2da03419-dd12-4851-8000-991f24d37efd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:48.673366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2da03419-dd12-4851-8000-991f24d37efd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:48.863724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2da03419-dd12-4851-8000-991f24d37efd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:48.872109 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2da03419-dd12-4851-8000-991f24d37efd tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1215 microversion: 2.1 time: 0.221226 Aug 30 17:45:48.873200 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2179/4129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:48 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:49.274597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:49.275278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] [instance: 100c6312-01c1-44c8-a98c-b1b04cc96c0e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:49.299821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.302398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.305965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:49.311209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.314227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.314999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:49.375823 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] HTTP exception thrown: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Request method failure captured: Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e HTTP/1.1 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkrW7GAO-Fp0LURRrMwy32K71mDjKhh82fZKg96mtyuF892j402l-Zlc4LRtt0WcveXct4vpj9bB-_iG0AjpvIY0kOmNXXcydvSfBnsjwm8Ppm6PeRV_93S8YRHv0CnnE7TY4gncULgVBaktaIYLsBSotJSVWC4MKfqs4ojBqzMdACI Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cf5f68455814153b89800033ef5a061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cf5f68455814153b89800033ef5a061"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cf5f68455814153b89800033ef5a061"}]}] Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 5cf5f68455814153b89800033ef5a061 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1819394193 Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6439f09540af4d31a6e60ee1c7aee8ae Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1819394193-project Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '100c6312-01c1-44c8-a98c-b1b04cc96c0e'} Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:49.377867 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. Aug 30 17:45:49.381822 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:49.387462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Returning 404 to user: Instance 100c6312-01c1-44c8-a98c-b1b04cc96c0e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:49.388541 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a417c56-e11f-4883-82e8-b048d817528e tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e" status: 404 len: 111 microversion: 2.1 time: 0.122206 Aug 30 17:45:49.395806 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1951/4130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:49 2022] GET /compute/v2.1/servers/100c6312-01c1-44c8-a98c-b1b04cc96c0e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:45:49.402793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5417c9cf-2478-4d51-9bcb-a8332aa87aef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] Calling method '.version_select at 0x7f2d938099d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:49.458807 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5417c9cf-2478-4d51-9bcb-a8332aa87aef tempest-ServerActionsTestJSON-1819394193 tempest-ServerActionsTestJSON-1819394193-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486761410" status: 202 len: 0 microversion: 2.1 time: 0.058169 Aug 30 17:45:49.460320 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2180/4131] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:45:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486761410 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:49.612209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:49.613159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:49.627970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.629169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.630721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:49.632685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.634750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.635408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:49.842612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:49.858310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4165dc38-1612-49c1-88dd-6a71a4d633ef tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1251 microversion: 2.1 time: 0.254344 Aug 30 17:45:49.859143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1952/4132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:49 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1251 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:49.894566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:49.896552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:49.928778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.929798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.931691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:49.933667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:49.936722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:49.937174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:50.174422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:50.186080 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f968c51-73de-40a4-a989-f031eb036d71 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1211 microversion: 2.1 time: 0.296316 Aug 30 17:45:50.200380 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2181/4133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:49 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:50.881279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:50.881900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:50.914893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:50.915387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:50.915861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:50.916570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:50.917020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:50.917445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:51.063159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:51.063736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:51.069242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:51.069697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lazy-loading 'fault' on Instance uuid ac2067d9-0aee-4f3c-af42-19044e15fc01 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:45:51.212711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:51.213963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:51.237040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:51.237809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:51.238260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:51.239322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:51.240011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:51.240536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:51.259903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed73f24596f749a2a3ec3e86cd35630a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848833b99ee74c5f828a06638a56cb64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:51.279577 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5223bcc5-63a6-448f-8c3b-25e6a524e8f2 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 200 len: 1256 microversion: 2.1 time: 0.399765 Aug 30 17:45:51.281971 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1953/4134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:50 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 1256 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:51.408497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:51.426622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2e28af3-d74b-4cc1-af3e-afa85be7dfb9 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1273 microversion: 2.1 time: 0.216795 Aug 30 17:45:51.431965 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2182/4135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:51 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:45:52.305216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:52.307590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] [instance: ac2067d9-0aee-4f3c-af42-19044e15fc01] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:52.319905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:52.320791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:52.321472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:52.322439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:52.323312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:52.324357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:52.351716 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] HTTP exception thrown: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Request method failure captured: Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 HTTP/1.1 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkxHyxtq19DQh5ZcGQWhFCJ39dVNViBhwy8pbXF5e2x3-b5nsb00zEJfsK9mXZMAEDq47W2boHIfQqrgPcFcR-AljaSYFs5wkUxkWJTUdDUIdkV7UX8v8ymESsc0V1bwByBHYyB8P6jFmO9GGl81Ok3UY6PJ2-duG1FHI_Z3NfSXODI Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 848833b99ee74c5f828a06638a56cb64 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestBootFromVolume-500295214 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/848833b99ee74c5f828a06638a56cb64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/848833b99ee74c5f828a06638a56cb64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/848833b99ee74c5f828a06638a56cb64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_848833b99ee74c5f828a06638a56cb64"}]}] Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestBootFromVolume-500295214 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 848833b99ee74c5f828a06638a56cb64 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestBootFromVolume-500295214 Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestBootFromVolume-500295214-project Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ed73f24596f749a2a3ec3e86cd35630a Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestBootFromVolume-500295214-project Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ac2067d9-0aee-4f3c-af42-19044e15fc01'} Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:45:52.359114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Returning 404 to user: Instance ac2067d9-0aee-4f3c-af42-19044e15fc01 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db32940e-db52-45b0-b0f6-3be47651c9b6 tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01" status: 404 len: 111 microversion: 2.1 time: 0.059613 Aug 30 17:45:52.363244 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1954/4136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:52 2022] GET /compute/v2.1/servers/ac2067d9-0aee-4f3c-af42-19044e15fc01 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:45:52.371766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41abd07f-3231-4592-b8d7-7c11256f5a1b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] Calling method '.version_select at 0x7f2d93f1f670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:52.404134 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41abd07f-3231-4592-b8d7-7c11256f5a1b tempest-ServersTestBootFromVolume-500295214 tempest-ServersTestBootFromVolume-500295214-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764243328" status: 202 len: 0 microversion: 2.1 time: 0.033415 Aug 30 17:45:52.406281 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2183/4137] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764243328 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:45:52.452003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:52.452861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:52.461808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:52.463991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:52.465406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:52.466374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:52.468639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:52.469297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:53.753951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:53.768254 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fb771366-061a-41a8-9113-309c01452f05 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.320315 Aug 30 17:45:53.768866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1955/4138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:52 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:54.792695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:54.793431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:54.816464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:54.817947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:54.821831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:54.823003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:54.825825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:54.838614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:55.541496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95303265-ce3a-4a3b-bcd8-17615e18bfe8", "tag": "2c4557ff-8aa0-4f73-bbf2-065d1de3cafb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:45:55.577204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:55.583212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:55.587322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:55.650855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] Creating event network-changed:2c4557ff-8aa0-4f73-bbf2-065d1de3cafb for instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 on n-h1-852771-11 Aug 30 17:45:55.666736 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-600adf9a-9371-425c-be15-b8035911873d req-9afe1b78-03be-43f5-a47b-d5d33b445440 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128940 Aug 30 17:45:55.667377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1956/4139] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:45:56.439994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:56.460913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-92c2a8a5-cbee-4d29-a0a3-ef465dc618ca tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.672844 Aug 30 17:45:56.465590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2184/4140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:54 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:45:57.486727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:45:57.488373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:45:57.509108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:57.511847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:57.512479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:57.513373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:45:57.513989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:45:57.514756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:45:58.485500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:58.541720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:45:59.431186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:45:59.444112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0cfd932-b54c-4543-a327-e19f27b74e38 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.961169 Aug 30 17:45:59.450503 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1957/4141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:45:57 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:00.477057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:00.477683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:00.492785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:00.501463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:00.522486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:00.523006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:00.523455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:00.530880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:00.531404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:00.532959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:02.359541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:02.386674 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe176a55-d193-4d5c-aa67-e8c042e11e3f tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.914327 Aug 30 17:46:02.395631 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2185/4142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:00 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:03.415123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:03.416623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:03.427684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:03.433120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:03.436776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:03.438181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:03.439417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:03.440695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:03.443833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:03.514578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:04.496259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:04.508826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4915e036-caa4-44cd-bbf3-71b0401bbf7e tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.098209 Aug 30 17:46:04.520339 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1958/4143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:03 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:04.693702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95303265-ce3a-4a3b-bcd8-17615e18bfe8", "name": "network-vif-plugged", "status": "completed", "tag": "2c4557ff-8aa0-4f73-bbf2-065d1de3cafb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:04.723013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:04.731748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:04.733654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:04.798339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] Creating event network-vif-plugged:2c4557ff-8aa0-4f73-bbf2-065d1de3cafb for instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 on n-h1-852771-11 Aug 30 17:46:04.827910 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-215d7a30-b4a9-417a-9435-adf5690a7d30 req-cf76b536-e651-40b7-9b1d-8ea42956159f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135878 Aug 30 17:46:04.832025 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2186/4144] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:46:05.535146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:05.537141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:05.564438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:05.568635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:05.570835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:05.573956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:05.577353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:05.584361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:06.949053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:06.966262 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cabf9cf7-45b5-4079-921b-e2370a87430a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1315 microversion: 2.1 time: 1.437009 Aug 30 17:46:06.973412 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1959/4145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:05 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1315 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:46:08.002007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:08.003743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:08.040802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:08.041330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:08.041781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:08.042553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:08.052861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:08.053447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:08.199092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:09.108155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:09.125306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9058ffb-28f7-47c0-af22-53a313b4d156 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1501 microversion: 2.1 time: 1.131566 Aug 30 17:46:09.141417 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2187/4146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:07 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1501 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:09.153552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:09.154099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:09.164891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:09.175436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:09.176236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:09.177176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:09.177656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:09.178092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:09.305670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lazy-loading 'flavor' on Instance uuid 95303265-ce3a-4a3b-bcd8-17615e18bfe8 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:46:09.557296 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fc7d7bb-3ec3-4c7f-9873-be8a4151a14c tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "POST /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.405315 Aug 30 17:46:09.574734 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1960/4147] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:46:09 2022] POST /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:46:09.588838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:09.589526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:09.617652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:09.629937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:09.630602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:09.634061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:09.634551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:09.635039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:10.583267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:10.597469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ece303fd-226a-48ab-afe9-91b8ea72d379 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1509 microversion: 2.1 time: 1.018004 Aug 30 17:46:10.617816 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2188/4148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:09 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1509 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:11.638803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:11.641418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:11.661939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:11.662896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:11.665121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:11.666152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:11.667281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:11.668696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:11.845627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-65794379", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "6d8a43aa-f1e0-4e59-91de-c289e340fef6"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:11.956318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] validate_networks() for [('6d8a43aa-f1e0-4e59-91de-c289e340fef6', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:46:12.300126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:12.320063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac5d4ec3-6e06-475f-a6e8-8d1c665615ab tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1492 microversion: 2.1 time: 0.694957 Aug 30 17:46:12.320630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2189/4149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:11 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1492 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:46:12.343605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:12.354029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:12.455955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:12.460453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:12.461840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:12.465460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:12.470570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:12.471324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:12.572151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:46:12.820435 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f828b65-1c92-44a8-9c78-9f17bf9fc3e0 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 204 len: 0 microversion: 2.1 time: 0.480408 Aug 30 17:46:12.821648 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2190/4150] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:12 2022] DELETE /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:46:12.831766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:12.835940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:12.851374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:12.853152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:12.853600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:12.854321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:12.858104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:12.858759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:13.120257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:13.130311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b99e3d3c-216e-47fc-8c86-e3a3cc19e7a1 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1498 microversion: 2.1 time: 0.303208 Aug 30 17:46:13.136868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2191/4151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:12 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:13.286309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:46:13.287503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:46:13.288224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:46:13.288854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:46:13.289483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:46:13.299769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:13.300810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:13.313252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:13.318091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:13.319513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:13.320371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:13.349795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Getting quotas for project 4be33548fc5a4bccae337287ab5128d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:46:13.357705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Getting quotas for user aa5c9a55eadd417992214838067780b8 and project 4be33548fc5a4bccae337287ab5128d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:46:13.378259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:46:13.384048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:46:13.460959 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-114074fa-ba2b-4158-a53a-a8d838f3bd42 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408068 Aug 30 17:46:13.462038 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1961/4152] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:46:13.475329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78264f2f-cf55-45ce-9833-0fe3e154ab1b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:13.475985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-78264f2f-cf55-45ce-9833-0fe3e154ab1b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:13.657443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-78264f2f-cf55-45ce-9833-0fe3e154ab1b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:13.668256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78264f2f-cf55-45ce-9833-0fe3e154ab1b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1223 microversion: 2.1 time: 0.199199 Aug 30 17:46:13.674718 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2192/4153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:13 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1223 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:14.156043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:14.156696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:14.171126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:14.171672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:14.172583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:14.175058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:14.177349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:14.180845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:14.694031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:14.695015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:14.734294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:14.736855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:14.736855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:14.742617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:14.744770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:14.747675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:14.791976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:14.819595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87338aac-9dfd-4267-95d1-3828b91a4f1d tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1498 microversion: 2.1 time: 0.667820 Aug 30 17:46:14.835933 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1962/4154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:14 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1498 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:15.627157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:15.638546 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-799c3d1f-cb04-4d50-866e-790fd19f88f4 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1219 microversion: 2.1 time: 0.948202 Aug 30 17:46:15.639055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2193/4155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:14 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1219 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:46:15.848718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:15.849315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:15.865580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:15.867246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:15.868217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:15.870827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:15.871638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:15.873536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:16.665715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:16.666472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:16.696687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:16.697369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:16.697826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:16.703411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:16.704102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:16.707792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:16.897301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:16.908130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-88ffd416-779c-4387-9ed9-4acdafa46537 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1498 microversion: 2.1 time: 1.063385 Aug 30 17:46:16.932977 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1963/4156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:15 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1498 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:17.013049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:17.035284 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfa3380d-fc28-404e-acc7-f0d1fe4be522 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1281 microversion: 2.1 time: 0.373753 Aug 30 17:46:17.045985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2194/4157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:16 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1281 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:17.718382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95303265-ce3a-4a3b-bcd8-17615e18bfe8", "name": "network-vif-deleted", "tag": "2c4557ff-8aa0-4f73-bbf2-065d1de3cafb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:17.777204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:17.780378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:17.781073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:17.830450 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] Creating event network-vif-deleted:2c4557ff-8aa0-4f73-bbf2-065d1de3cafb for instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 on n-h1-852771-11 Aug 30 17:46:17.856418 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-92581617-c245-431d-9e19-93d3f657dfaf req-94a5c226-ffe3-4728-8931-690c07917b26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.794740 Aug 30 17:46:17.878910 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1964/4158] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:46:17.938629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:17.939693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:17.979640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:17.980575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:17.984581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:17.986010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:17.996731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:18.000205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:18.063168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:18.065417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:18.127087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:18.129582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:18.130297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:18.137140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:18.139915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:18.141756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:18.163782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:18.168894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:18.173187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:18.175568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lazy-loading 'fault' on Instance uuid 95303265-ce3a-4a3b-bcd8-17615e18bfe8 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:46:18.436890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544632145bd8469daf47e1a5c8566402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3709d3d94e2ebd5f1f65fa932c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:18.447705 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3cdfd38-de64-47f9-978e-c0e4916a4fac tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 200 len: 1305 microversion: 2.1 time: 0.514838 Aug 30 17:46:18.448154 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2195/4159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:17 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 1305 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:18.502454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:18.511894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d48d6036-f14f-45e8-b956-66ddf9161b3f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1281 microversion: 2.1 time: 0.455441 Aug 30 17:46:18.531032 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1965/4160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:18 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:19.546672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:19.548120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:19.559614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:19.562376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:19.562997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:19.565954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:19.569817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:19.570571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:19.724779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:19.765621 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0702e8d-23a5-4e53-8f82-94d6f3e257d3 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1281 microversion: 2.1 time: 0.219927 Aug 30 17:46:19.774379 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1966/4161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:19 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:20.027130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.028082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.042788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.043361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.044908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.050692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.052782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.052930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.103070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 HTTP/1.1 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '95303265-ce3a-4a3b-bcd8-17615e18bfe8'} Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.104973 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.109423 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.110807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.112023 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8cf9b767-3328-4f50-9eab-0c0c5961186a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 404 len: 111 microversion: 2.1 time: 0.646506 Aug 30 17:46:20.116485 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2196/4162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:19 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 111 bytes in 652 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.129107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.130092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.149810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.153181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.153880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.154663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.158132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.158870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.184980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 HTTP/1.1 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '95303265-ce3a-4a3b-bcd8-17615e18bfe8'} Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.186924 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.190568 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fbd4ef2-db6c-43dd-a196-426f4816692a tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 404 len: 111 microversion: 2.1 time: 0.064609 Aug 30 17:46:20.194259 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1967/4163] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:20 2022] DELETE /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.200220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.201227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 95303265-ce3a-4a3b-bcd8-17615e18bfe8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.214491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.215432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.216149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.218626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.220120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.221545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.264789 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 HTTP/1.1 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '95303265-ce3a-4a3b-bcd8-17615e18bfe8'} Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.267416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. Aug 30 17:46:20.271904 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.281491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 95303265-ce3a-4a3b-bcd8-17615e18bfe8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.282635 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a114aa6c-d079-41ba-a5fd-179ebcd72c47 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8" status: 404 len: 111 microversion: 2.1 time: 0.088317 Aug 30 17:46:20.283925 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2197/4164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/95303265-ce3a-4a3b-bcd8-17615e18bfe8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.302881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.303410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.324577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.329091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.335021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.337285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.339513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.340009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.399161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 HTTP/1.1 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a309c56c-6ff8-40bc-b302-4de325bb2d84'} Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.407271 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.412150 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.413338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.419134 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dfc5a1e3-5564-4550-a7cd-1e165c261ce6 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 404 len: 111 microversion: 2.1 time: 0.126711 Aug 30 17:46:20.422293 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1968/4165] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:20 2022] DELETE /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.430774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.431784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: a309c56c-6ff8-40bc-b302-4de325bb2d84] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.445261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.447179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.447774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.448719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.451606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.452270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.506066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 HTTP/1.1 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a309c56c-6ff8-40bc-b302-4de325bb2d84'} Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.509821 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. Aug 30 17:46:20.514278 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.517670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance a309c56c-6ff8-40bc-b302-4de325bb2d84 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.521169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-588cd9e1-2b52-4b11-921d-14dff6cf20ee tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84" status: 404 len: 111 microversion: 2.1 time: 0.095705 Aug 30 17:46:20.524852 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2198/4166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/a309c56c-6ff8-40bc-b302-4de325bb2d84 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.537242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.537876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.552046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.553245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.555066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.560211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.565030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.565901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.599393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 HTTP/1.1 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '1e6ccca7-8376-4206-ab07-3649442c8f45'} Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.602702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.606442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.611655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.614148 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a25eb262-9874-41ba-b47d-46a84d13ba54 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 404 len: 111 microversion: 2.1 time: 0.087110 Aug 30 17:46:20.615002 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1969/4167] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:20 2022] DELETE /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.624159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.624933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 1e6ccca7-8376-4206-ab07-3649442c8f45] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.637108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.639280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.640953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.641953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.644603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.646990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.687598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 HTTP/1.1 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1e6ccca7-8376-4206-ab07-3649442c8f45'} Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.692850 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. Aug 30 17:46:20.697243 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.701089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 1e6ccca7-8376-4206-ab07-3649442c8f45 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.705362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ceeba4a-3ecd-4ed9-bc70-9c40d74dc991 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45" status: 404 len: 111 microversion: 2.1 time: 0.084056 Aug 30 17:46:20.707192 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2199/4168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/1e6ccca7-8376-4206-ab07-3649442c8f45 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.716415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.717025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.728090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.729569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.730062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.732469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.733838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.737728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.781192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 HTTP/1.1 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '20d804f2-fb42-410b-aad1-bee345bdc880'} Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.785691 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.790456 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a58dd33-a5a1-490b-b264-79cb04812451 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 404 len: 111 microversion: 2.1 time: 0.077999 Aug 30 17:46:20.791662 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1970/4169] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:20 2022] DELETE /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.795418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.796179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.806655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.809383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 20d804f2-fb42-410b-aad1-bee345bdc880] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.813907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.816493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.817420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.820113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.824307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.824928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.828621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.832318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.835159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.836271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:20.837049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:20.837659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:20.874580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 HTTP/1.1 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '20d804f2-fb42-410b-aad1-bee345bdc880'} Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.878158 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. Aug 30 17:46:20.884397 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.885869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 20d804f2-fb42-410b-aad1-bee345bdc880 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.887281 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-017afe2f-9f1e-4caa-a210-df3fc2b40926 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880" status: 404 len: 111 microversion: 2.1 time: 0.090568 Aug 30 17:46:20.888498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1971/4170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/20d804f2-fb42-410b-aad1-bee345bdc880 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:20.898264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.899063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.907542 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 HTTP/1.1 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '70aaf2cf-5306-4e9f-acd1-2de934fd07c6'} Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.912176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.916749 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.919262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:20.920848 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-253edae8-c661-487b-a26e-22761f7c7cde tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6" status: 404 len: 111 microversion: 2.1 time: 0.028152 Aug 30 17:46:20.921796 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1972/4171] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:20 2022] DELETE /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:46:20.947388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:20.951764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 70aaf2cf-5306-4e9f-acd1-2de934fd07c6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:20.985493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 HTTP/1.1 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '70aaf2cf-5306-4e9f-acd1-2de934fd07c6'} Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:20.991708 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:20.996450 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:20.996450 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:20.996450 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:20.996450 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. Aug 30 17:46:20.996450 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:21.009790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 70aaf2cf-5306-4e9f-acd1-2de934fd07c6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:21.012988 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98b2f518-3d64-4619-9460-9026dc016477 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6" status: 404 len: 111 microversion: 2.1 time: 0.082864 Aug 30 17:46:21.020743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1973/4172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/70aaf2cf-5306-4e9f-acd1-2de934fd07c6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:21.672008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:21.695809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09af2fd5-084d-457b-8801-fc8daccb1e44 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1323 microversion: 2.1 time: 0.912274 Aug 30 17:46:21.697536 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2200/4173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:20 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1323 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:22.192290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1d4ea2-3cb0-4ede-9f3f-644c5f821696", "tag": "fc22319b-68d0-4360-8d29-6614606821a3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:22.224407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:22.227082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:22.227516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:22.265164 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] Creating event network-changed:fc22319b-68d0-4360-8d29-6614606821a3 for instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 on n-h2-852771-11 Aug 30 17:46:22.280829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e9032920-0217-4743-8b58-d6745d4c4bd1 req-4538e545-2edf-4b7a-bb3c-6da2c963d82b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093424 Aug 30 17:46:22.283746 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1974/4174] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:46:22.722481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:22.723717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:22.735212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:22.738188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:22.740756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:22.742763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:22.743903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:22.745452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:23.665928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:23.777848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:23.785968 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3b26f1a-7074-4d21-b8d0-44544dc1e02f tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1323 microversion: 2.1 time: 1.068050 Aug 30 17:46:23.799375 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2201/4175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:22 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1323 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:24.804946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:24.806871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:24.812805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:24.813805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:24.850298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:24.854331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:24.857052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:24.859229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:24.860545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:24.865020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:27.040269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:27.053895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4408fb06-8b30-47d2-a3f1-001aad99c33b tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1323 microversion: 2.1 time: 2.250617 Aug 30 17:46:27.060021 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1975/4176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:24 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1323 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:28.099558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:28.100865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:28.119446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:28.124041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:28.133051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:28.134077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:28.134764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:28.135430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.056318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:29.065321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3743949f-feb9-4186-9331-7c101641df0d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1323 microversion: 2.1 time: 0.970742 Aug 30 17:46:29.083521 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2202/4177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:28 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1323 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:29.177474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:29.178030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:29.202184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.209076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.209844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.210600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.211066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.211785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.258430 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e HTTP/1.1 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0f403e41-6656-4a5d-8478-36f7dd58518e'} Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:29.263808 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:29.267546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e2c9736-a2af-4445-a17e-e0a319d6c891 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 404 len: 111 microversion: 2.1 time: 0.091730 Aug 30 17:46:29.271212 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1976/4178] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:29 2022] DELETE /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:29.275841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:29.277329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: 0f403e41-6656-4a5d-8478-36f7dd58518e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:29.298707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.301495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.302197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.304924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.306595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.307264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.363250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1d4ea2-3cb0-4ede-9f3f-644c5f821696", "name": "network-vif-plugged", "status": "completed", "tag": "fc22319b-68d0-4360-8d29-6614606821a3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:29.389216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.390366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.390962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.402355 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e HTTP/1.1 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '0f403e41-6656-4a5d-8478-36f7dd58518e'} Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.419933 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. Aug 30 17:46:29.423932 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.424334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] Creating event network-vif-plugged:fc22319b-68d0-4360-8d29-6614606821a3 for instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 on n-h2-852771-11 Aug 30 17:46:29.426760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance 0f403e41-6656-4a5d-8478-36f7dd58518e could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:29.429445 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0036ed54-3c59-4b7d-a2b1-69ca25096c68 req-546188c7-bb25-4b71-9f3d-71c9928b85af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070903 Aug 30 17:46:29.430062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1977/4179] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:46:29.430468 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-584f6653-91b3-4df1-ad73-b5e419e46814 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e" status: 404 len: 111 microversion: 2.1 time: 0.158245 Aug 30 17:46:29.432961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2203/4180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:29 2022] GET /compute/v2.1/servers/0f403e41-6656-4a5d-8478-36f7dd58518e => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:29.446347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:29.446926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:29.500247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.502952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.510927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.511890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.516403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.517003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.572881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb HTTP/1.1 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb'} Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:29.574597 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26b1af25-bd86-47b6-8d46-1f6c1ae01f86 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 404 len: 111 microversion: 2.1 time: 0.135285 Aug 30 17:46:29.579062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1978/4181] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:29 2022] DELETE /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:46:29.585300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:29.585900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] [instance: b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:29.599703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.600185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.600614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.601306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:29.610291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:29.610984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:29.631197 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] HTTP exception thrown: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Request method failure captured: Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb HTTP/1.1 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDku9NcJqnfVsJ1-HTcyFdlU4U2FJTbzQWJZPZF_nkxldRzeZYHq1FeS8ZGRCevPJHTOPSV8pmmk4AoqyvCcleGSD7Q0ZvKZ4cP9QKE4jcrFM9T-fD_IJUyqgpPliMR6U6vDlUlpd33sHrztLaq3YbdtwTUBEWOk2IpvivhknLd-V984 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed4a3709d3d94e2ebd5f1f65fa932c5a"}]}] Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ed4a3709d3d94e2ebd5f1f65fa932c5a Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632254 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 544632145bd8469daf47e1a5c8566402 Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-1602632254-project Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb'} Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:29.640989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. Aug 30 17:46:29.646231 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:29.647545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] Returning 404 to user: Instance b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:29.652022 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3143b2b9-47ae-426d-a2b0-7d437ed758f2 tempest-DeleteServersTestJSON-1602632254 tempest-DeleteServersTestJSON-1602632254-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb" status: 404 len: 111 microversion: 2.1 time: 0.069765 Aug 30 17:46:29.653225 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1979/4182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:29 2022] GET /compute/v2.1/servers/b9d7bce4-b5c7-475a-a40c-754a9cc6e8fb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:46:29.885285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1765578818", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "a28d7c2b-7c11-4f8e-84f6-7e547af0ccaf"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:30.024230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] validate_networks() for [('a28d7c2b-7c11-4f8e-84f6-7e547af0ccaf', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:46:30.098087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:30.099087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:30.113257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:30.118815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:30.119624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:30.123204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:30.124853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:30.127578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:30.871310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:30.881945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e477b36d-37ad-4652-a278-19f504ffe8da tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1323 microversion: 2.1 time: 0.788276 Aug 30 17:46:30.893917 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1980/4183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:30 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1323 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:31.914397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:31.915719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:31.934559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:31.938372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:31.938979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:31.944463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:31.945131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:31.947536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:32.586014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:32.598884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d7029d7-7d76-4d51-a1e5-d850f00a309d tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1520 microversion: 2.1 time: 0.689009 Aug 30 17:46:32.599526 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1981/4184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:31 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1520 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:46:32.627239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:32.627965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:32.661325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:32.664048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:32.664734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:32.665783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:32.669135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:32.671767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:32.777317 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] HTTP exception thrown: Instance is not a member of specified network Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Request method failure captured: Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696/ips/invalid HTTP/1.1 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkziI6FkS3ppRniYXqfIgdW1zGRH5cCfss4_4-pZblEEtIXbf1YTD2u-QlylyXw9vg5miewoSGcX9G2n4jyLH7ZpmcXQCKPZWj2mYKQdQHaQvPkxVKCL3sUqIr20NvjOF_M5a8fD6bT1qInfb91ZfGyQqykBWq4jqr_oEpDzXQ9kzS8 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4be33548fc5a4bccae337287ab5128d7"}]}] Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa5c9a55eadd417992214838067780b8 Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance is not a member of specified network Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': 'cf1d4ea2-3cb0-4ede-9f3f-644c5f821696', 'id': 'invalid'} Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 30 17:46:32.787248 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.793257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:32.794519 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2796a20a-f0dd-4bf8-b85e-c84a81dde8ed tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.174245 Aug 30 17:46:32.799243 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1982/4185] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 17:46:32 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696/ips/invalid => generated 91 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:46:32.817113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:32.817880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Failed to fetch instance by id 999 {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 17:46:32.819892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] HTTP exception thrown: Instance 999 could not be found. Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Request method failure captured: Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkziI6FkS3ppRniYXqfIgdW1zGRH5cCfss4_4-pZblEEtIXbf1YTD2u-QlylyXw9vg5miewoSGcX9G2n4jyLH7ZpmcXQCKPZWj2mYKQdQHaQvPkxVKCL3sUqIr20NvjOF_M5a8fD6bT1qInfb91ZfGyQqykBWq4jqr_oEpDzXQ9kzS8 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4be33548fc5a4bccae337287ab5128d7"}]}] Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa5c9a55eadd417992214838067780b8 Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 999 could not be found. Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '999'} Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 17:46:32.823626 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:46:32.829226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:32.833183 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d064be59-4303-4a18-8770-02076465adc8 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.027080 Aug 30 17:46:32.834948 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1983/4186] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:46:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:46:32.845760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:32.849362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:32.870137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:32.871005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:32.871868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:32.874603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:32.878003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:32.878643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:32.946877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:46:32.963440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:33.007806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:46:33.008854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:46:33.009499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:46:33.010157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:46:33.010808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:46:33.020135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:33.044695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:33.051830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:33.053487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:33.060626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:33.061541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:33.063263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:33.157606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Getting quotas for project 9851196371ea4d129d2c052cdd63db02. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:46:33.183672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Getting quotas for user 40d56359724047b88e338599f169706c and project 9851196371ea4d129d2c052cdd63db02. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:46:33.202219 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff1f0ac5-e8de-4539-9817-28fbe8947788 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 204 len: 0 microversion: 2.1 time: 0.361927 Aug 30 17:46:33.206989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1984/4187] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:46:32 2022] DELETE /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:46:33.211778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:46:33.212844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:33.213671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:33.215288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:46:33.220354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:33.220961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:33.221486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:33.223061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:33.223626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:33.224117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:33.293945 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc56bca9-6a0d-467c-baaf-250721b028ab tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.723806 Aug 30 17:46:33.295651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2204/4188] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:46:33.321945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:33.323361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:33.807201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:33.817400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:33.820418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:33.825371 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8c44255-0c4d-4228-be30-4573a15ae153 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1262 microversion: 2.26 time: 0.517745 Aug 30 17:46:33.826453 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2205/4189] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:33 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1262 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:34.853572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:34.855140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:34.867681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:34.868346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:34.869001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:34.870424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:34.871072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:34.871698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:35.185954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:35.230980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:35.233728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:35.234127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:35.236139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4fdf5208-075c-4381-afc1-4a299913cc98 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1266 microversion: 2.26 time: 0.390663 Aug 30 17:46:35.236928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2206/4190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:34 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:35.250302 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-112f63eb-22cc-4bf3-b18f-4c0541527c72 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1526 microversion: 2.1 time: 2.041998 Aug 30 17:46:35.251237 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1985/4191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:33 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1526 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:36.291903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:36.292522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:36.294521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:36.295223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:36.312313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:36.324187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:36.329363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:36.329875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:36.330647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:36.338970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:36.339507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:36.361210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:36.363116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:36.366289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:36.367378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:36.368032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:36.368633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:37.466338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:37.479587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:37.488574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:37.496719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:37.497932 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6929ea4-b646-4411-b9a1-4d7601138768 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1320 microversion: 2.26 time: 1.215690 Aug 30 17:46:37.498507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2207/4192] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:36 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1320 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:37.535786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1d4ea2-3cb0-4ede-9f3f-644c5f821696", "name": "network-vif-deleted", "tag": "fc22319b-68d0-4360-8d29-6614606821a3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:37.559847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:37.567531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:37.567987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:37.599893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9a55eadd417992214838067780b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be33548fc5a4bccae337287ab5128d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:37.621229 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19736479-4e99-4f6c-a795-7b22a41bb052 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 200 len: 1526 microversion: 2.1 time: 1.335270 Aug 30 17:46:37.629275 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] Creating event network-vif-deleted:fc22319b-68d0-4360-8d29-6614606821a3 for instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 on n-h2-852771-11 Aug 30 17:46:37.629408 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1986/4193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:36 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 1526 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:37.638894 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-22cdf574-ea43-4cb9-a94e-2a73a2a1bee7 req-81e51508-20d1-44ae-a4b6-0329b7cdb7f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133179 Aug 30 17:46:37.639730 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2208/4194] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:46:38.523068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:38.525206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:38.543587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:38.544139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:38.544582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:38.545310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:38.551787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:38.552399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:38.647031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:38.649481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] [instance: cf1d4ea2-3cb0-4ede-9f3f-644c5f821696] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:38.662598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:38.663977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:38.663977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:38.664653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:38.665319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:38.665911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:38.702353 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] HTTP exception thrown: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Request method failure captured: Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 HTTP/1.1 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkziI6FkS3ppRniYXqfIgdW1zGRH5cCfss4_4-pZblEEtIXbf1YTD2u-QlylyXw9vg5miewoSGcX9G2n4jyLH7ZpmcXQCKPZWj2mYKQdQHaQvPkxVKCL3sUqIr20NvjOF_M5a8fD6bT1qInfb91ZfGyQqykBWq4jqr_oEpDzXQ9kzS8 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4be33548fc5a4bccae337287ab5128d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4be33548fc5a4bccae337287ab5128d7"}]}] Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4be33548fc5a4bccae337287ab5128d7 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1199503014 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa5c9a55eadd417992214838067780b8 Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1199503014-project Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'cf1d4ea2-3cb0-4ede-9f3f-644c5f821696'} Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:38.708349 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] Returning 404 to user: Instance cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a82b4244-e40c-4661-907c-91d8aa51e609 tempest-ServerAddressesNegativeTestJSON-1199503014 tempest-ServerAddressesNegativeTestJSON-1199503014-project] 10.222.0.50 "GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696" status: 404 len: 111 microversion: 2.1 time: 0.067588 Aug 30 17:46:38.713875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2209/4195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:38 2022] GET /compute/v2.1/servers/cf1d4ea2-3cb0-4ede-9f3f-644c5f821696 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:46:39.018851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:39.032792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:39.039781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:39.041450 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4357415c-a78e-4e66-a2a5-d9fc1ffb51c3 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.522713 Aug 30 17:46:39.042611 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1987/4196] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:38 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:40.066549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:40.068961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:40.092695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:40.100785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:40.101840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:40.110757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:40.114314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:40.116575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:41.703781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:41.714177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:41.718918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:41.725228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b73e472-690e-41fc-80aa-b55cf8aed103 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 1.663484 Aug 30 17:46:41.726220 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2210/4197] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:40 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:42.605843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d3de2f-f6af-4414-b6a7-269e9b1c6724", "tag": "489f2f4c-9b11-40e6-91f1-631ece02356e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:42.628251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:42.637053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:42.637897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:42.676199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] Creating event network-changed:489f2f4c-9b11-40e6-91f1-631ece02356e for instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 on n-h1-852771-11 Aug 30 17:46:42.696275 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0acfd153-3874-45aa-9644-6f3fe521bcdb req-83c6ed15-a285-43e5-9830-53b52455a979 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095395 Aug 30 17:46:42.697229 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2211/4198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 17:46:42.754626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:42.756089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:42.771744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:42.774655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:42.776468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:42.783133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:42.784563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:42.786716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:42.816979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1393605489", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "6ef2e77b-3521-44f2-b4dd-d1fc16cf273e"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:42.937232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] validate_networks() for [('6ef2e77b-3521-44f2-b4dd-d1fc16cf273e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:46:43.096374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:43.361335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:43.375103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:43.381044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:43.389591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39a26fdf-e176-4661-bd7d-a057f616c4b0 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.640064 Aug 30 17:46:43.390718 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2212/4199] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:42 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:46:44.422932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:44.448546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:44.489229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:44.503199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:44.508637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:44.513075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:44.515202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:44.517498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:44.519352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:45.662738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:45.682391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:45.690624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:45.694223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f01ba89-d694-4194-b6cd-f55dacfdb3a6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 1.276640 Aug 30 17:46:45.698459 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2213/4200] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:44 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:46:45.725210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1083693438", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "44598711-ee68-4af0-809b-74bb998fb42f"}, {"uuid": "51b344b5-a3f1-4a74-843b-fc0c75ad0e76"}, {"uuid": "44598711-ee68-4af0-809b-74bb998fb42f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:45.830170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] validate_networks() for [('44598711-ee68-4af0-809b-74bb998fb42f', None, None, None, None, None), ('51b344b5-a3f1-4a74-843b-fc0c75ad0e76', None, None, None, None, None), ('44598711-ee68-4af0-809b-74bb998fb42f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:46:45.900939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:46:45.901401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:46:45.901821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:46:45.902229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:46:45.902638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:46:45.928347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:45.929959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:45.930088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:45.931731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:45.934586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:45.936878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:45.988750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Getting quotas for project e6d084c74f4e46d5a34f0bb24ae87138. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:46:46.004995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Getting quotas for user 8d0f1fe242cc4821af3a419728fc27ba and project e6d084c74f4e46d5a34f0bb24ae87138. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:46:46.042623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:46:46.049673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:46:46.180059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f54fbb95-14f8-4bac-b72a-360229342ae7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.705455 Aug 30 17:46:46.187659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1988/4201] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:46:46.205063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1efba438-4263-41ad-b7d2-5949a032906e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:46.208226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1efba438-4263-41ad-b7d2-5949a032906e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:46.690542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1efba438-4263-41ad-b7d2-5949a032906e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:46.708112 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1efba438-4263-41ad-b7d2-5949a032906e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1214 microversion: 2.1 time: 0.513019 Aug 30 17:46:46.730289 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1989/4202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:46 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1214 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:46.755605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:46.757868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:46.786701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:46.791344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:46.792556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:46.795956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:46.796719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:46.797969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:47.203057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:47.225455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:47.227339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:47.230085 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92d11488-f90e-432a-a7ac-999b2c5bc578 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.496590 Aug 30 17:46:47.231157 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1990/4203] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:46 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:47.743329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:47.744221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:47.763857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:47.768558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:47.773988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:47.777137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:47.778281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:47.780566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:48.245199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:48.285671 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb88dd35-00d7-41a0-9a7a-abf96f72222e tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1266 microversion: 2.1 time: 0.552813 Aug 30 17:46:48.290068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1991/4204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:47 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1266 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:48.310402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:48.311913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:48.335220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:48.339164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:48.341394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:48.345759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:48.349808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:48.351637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:49.870455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:46:49.871084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:46:49.871582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:46:49.872179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:46:49.872603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:46:49.902774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:49.903279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:49.906328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:49.911135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:49.911963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:49.913881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:49.990443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Getting quotas for project 13b32040f7264823b51522286868d313. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:46:50.014769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Getting quotas for user d463e623a89a4fab91673219aeaec3af and project 13b32040f7264823b51522286868d313. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:46:50.043407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:46:50.052426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:46:50.180485 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b124119c-7d4b-470b-83fb-73613660f42b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.478703 Aug 30 17:46:50.187111 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2214/4205] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:46:50.198621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:50.205869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:50.217885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:50.222054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:50.223471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:50.228854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:50.229520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:50.230111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:50.497276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:50.512445 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36696a47-e7a5-4b7c-9fcf-e2a553796062 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1272 microversion: 2.1 time: 0.324161 Aug 30 17:46:50.513046 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2215/4206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:50 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:50.529234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea6c4976-9c58-4a57-a205-20322ce918ee tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:50.535981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea6c4976-9c58-4a57-a205-20322ce918ee tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:50.771795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea6c4976-9c58-4a57-a205-20322ce918ee tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:50.779931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea6c4976-9c58-4a57-a205-20322ce918ee tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1213 microversion: 2.1 time: 0.261915 Aug 30 17:46:50.787249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2216/4207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:50 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:51.534830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:51.535494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:51.550935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:51.562412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:51.562893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:51.563711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:51.564183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:51.565180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:51.732670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:51.754283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:51.758066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:51.759501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02ba0dab-8318-43df-885f-d84d7fc810ef tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 3.466138 Aug 30 17:46:51.784567 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1992/4208] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:48 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 3493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:51.812963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fd3d6e85-6c0a-4b71-b757-6436f4091e84 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:51.813680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd3d6e85-6c0a-4b71-b757-6436f4091e84 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:51.925379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:51.939427 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93d67e90-257c-4a39-a1ae-31a64c2808a1 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1272 microversion: 2.1 time: 0.409860 Aug 30 17:46:51.957454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2217/4209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:51 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:52.129102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd3d6e85-6c0a-4b71-b757-6436f4091e84 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:52.139646 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fd3d6e85-6c0a-4b71-b757-6436f4091e84 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1213 microversion: 2.1 time: 0.334019 Aug 30 17:46:52.140235 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1993/4210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:51 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1213 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:52.803293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:52.804780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:52.853470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:52.879114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:52.884294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:52.887367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:52.894212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:52.900116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:52.971068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:52.973098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:52.995458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:53.000795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:53.005050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:53.009668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:53.012209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:53.015684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:53.372543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:53.398457 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd697a31-970f-4474-a0a1-13dfe78be41a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1272 microversion: 2.1 time: 0.432243 Aug 30 17:46:53.400156 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1994/4211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:52 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:53.415879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:53.417228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:53.426137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:53.427452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:53.428151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:53.429096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:53.429929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:53.430577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:53.721534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:53.767190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:53.774363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:53.774363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7ed68e4-297d-4b86-a332-250f3d42fb34 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.973826 Aug 30 17:46:53.774363 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2218/4212] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:52 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:53.855859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:53.873513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7611f4fb-4cdd-40f4-b183-3c2be5d5fa5b tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1273 microversion: 2.1 time: 0.471942 Aug 30 17:46:53.874064 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1995/4213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:53 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1273 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:54.456431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:54.457384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:54.523669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.524530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.534351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:54.537114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.537896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.538576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:54.797259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:54.798594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:54.816536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.817538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.818199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:54.819905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.822232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.824416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:54.938622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:54.947958 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66c67cbb-fde2-4a2e-b1cd-462c66d19368 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 0.506323 Aug 30 17:46:54.960375 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2219/4214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:54 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:54.965500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:54.966318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:54.981920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.982685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.984221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:54.985153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:54.985814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:54.986574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:55.196528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:55.207363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b47a406d-22ac-4c3f-89ff-69ca96fd9d60 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1271 microversion: 2.1 time: 0.245551 Aug 30 17:46:55.227513 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2220/4215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:54 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:55.534357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:55.570794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:55.575375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:55.579169 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4154bf66-da11-46d8-8524-5c2df8642ebb tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.785604 Aug 30 17:46:55.591514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1996/4216] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:54 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:46:56.001863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:56.004188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:56.078733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:56.092083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:56.094192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:56.104071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:56.106494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:56.112313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:56.237321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:56.238166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:56.252560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:46:56.288028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:56.290816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:56.293583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:56.300807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:56.305966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:56.314060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:56.715933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:56.736050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c10e7a9f-7287-4514-8ba6-2a106bb3d36e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1271 microversion: 2.1 time: 0.501936 Aug 30 17:46:56.760197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1997/4217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:56 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1271 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:56.954644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:56.966580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc28635f-f9b2-4a55-bb87-688fa952c62c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 0.980390 Aug 30 17:46:56.967396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2221/4218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:55 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:56.979207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:56.980600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:57.000482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.001274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.002898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.004702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.005368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.006125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.339793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d3de2f-f6af-4414-b6a7-269e9b1c6724", "name": "network-vif-plugged", "status": "completed", "tag": "489f2f4c-9b11-40e6-91f1-631ece02356e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:57.372861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.376100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.403134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.466447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] Creating event network-vif-plugged:489f2f4c-9b11-40e6-91f1-631ece02356e for instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 on n-h1-852771-11 Aug 30 17:46:57.480892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1422b701-4942-4287-8246-914eeece1176 req-b01da243-90c6-44db-ad80-2e8d163ad2f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.717379 Aug 30 17:46:57.484122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1998/4219] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:46:57.661020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:57.680763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:57.689068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:57.690824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b4c452a-7539-4aff-bf4e-40a115919846 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.721689 Aug 30 17:46:57.696002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2222/4220] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:56 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:57.765426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a6a992-6a11-40d4-8b5e-0fa8a98f673d", "tag": "4353c73c-5a33-4abc-9f33-c793b6a2ba1b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:46:57.765576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:57.766240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:57.788176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.789023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.790016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.792887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.797173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:57.797801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.798428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.800021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:57.800664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:57.838886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] Creating event network-changed:4353c73c-5a33-4abc-9f33-c793b6a2ba1b for instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d on n-h2-852771-11 Aug 30 17:46:57.857410 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5a7586d2-320b-4ae9-aebb-1548b1b6c130 req-5ff09f15-8a27-46fa-8750-3a045ab5b49a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108436 Aug 30 17:46:57.862401 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 1999/4221] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:46:57.994893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:57.995563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:58.005476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:58.005965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:58.006402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:58.010796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:58.013743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:58.014348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:58.383965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:58.396029 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bab7034b-d013-407e-899f-9f381896a7ca tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1313 microversion: 2.1 time: 0.637310 Aug 30 17:46:58.396631 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2223/4222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:57 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:58.643789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:58.660206 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-927508b7-8372-4207-8bd6-c64a5b9bece7 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 0.671243 Aug 30 17:46:58.660951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2000/4223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:57 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:46:58.723500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:58.727201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:58.753897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:58.754634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:58.755279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:58.756923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:58.759916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:58.760900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:59.173091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:59.197296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:59.200332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:46:59.202218 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9df05212-de27-46ef-92be-019896fc1f53 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1362 microversion: 2.26 time: 0.484002 Aug 30 17:46:59.232076 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2224/4224] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:46:58 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:46:59.418958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:59.419593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:59.449395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:59.450804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:59.452361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:59.453215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:59.460816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:59.461463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:59.682807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:46:59.684219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:46:59.697428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:59.718838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:59.720369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:59.728549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:46:59.735735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:46:59.736778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:46:59.956206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:00.053108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:00.080287 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dc41802a-a4d3-4586-aa2f-aab6ba18a035 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1334 microversion: 2.1 time: 0.666413 Aug 30 17:47:00.082566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2001/4225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:59 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1334 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:00.237196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:00.238065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:00.261212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:00.264920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:00.266544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:00.270113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:00.270810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:00.276205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:00.363993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:00.374979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06ec5b98-9711-40ba-b6b2-150b7aebd431 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 0.696371 Aug 30 17:47:00.388143 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2225/4226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:46:59 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:00.856337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:00.898416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:00.905271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:00.906525 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5bd6f2f1-77aa-4f61-bd50-1010026b2e21 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1546 microversion: 2.26 time: 0.674278 Aug 30 17:47:00.907140 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2002/4227] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:00 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1546 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:00.940268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d93fa9ee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:00.944129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:00.966438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:00.966932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:00.967373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:00.977902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:01.003336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.004124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.004754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.005750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.006356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.011295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.077872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.082663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.084264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.102259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.102880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:01.112797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.113290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.123565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.124502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.125136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.125714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.136533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.144834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.145563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.203988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:01.214369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:01.240776 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ae238ba-6436-4440-95c0-2aa44049686c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-783110706" status: 201 len: 0 microversion: 2.26 time: 0.305277 Aug 30 17:47:01.242328 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2226/4228] 10.222.0.50 () {62 vars in 1377 bytes} [Tue Aug 30 17:47:00 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-783110706 => generated 0 bytes in 307 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 17:47:01.255628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1d0c3f6-71e5-4523-b034-334b6bda541b tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9368cf70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.283902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1d0c3f6-71e5-4523-b034-334b6bda541b tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.284646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1d0c3f6-71e5-4523-b034-334b6bda541b tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.285159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1d0c3f6-71e5-4523-b034-334b6bda541b tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.297888 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1d0c3f6-71e5-4523-b034-334b6bda541b tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-783110706" status: 204 len: 0 microversion: 2.26 time: 0.049762 Aug 30 17:47:01.298879 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2227/4229] 10.222.0.50 () {60 vars in 1358 bytes} [Tue Aug 30 17:47:01 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-783110706 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:47:01.323152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9368c790>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.347112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.347465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.347994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.348681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:01.366172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.372206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.372957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.373860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.374470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.375458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.437884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.438387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.439636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.469381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:01.520033 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bededb52-0eb6-4dde-aea3-553576c860fe tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 204 len: 0 microversion: 2.26 time: 0.213018 Aug 30 17:47:01.521240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2228/4230] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 30 17:47:01 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:47:01.543846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.543846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:01.551441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.553132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.553630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.560205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.569729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.570533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.734823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:01.737740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:01.745250 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4bdc0704-32cb-4d1e-9daa-84045985bb80 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1334 microversion: 2.1 time: 0.646787 Aug 30 17:47:01.746571 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2003/4231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:01 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1334 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:01.752226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09f8d68c-fb82-41b2-83dd-251fe8c82dc8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d991e5160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.770748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09f8d68c-fb82-41b2-83dd-251fe8c82dc8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.771521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09f8d68c-fb82-41b2-83dd-251fe8c82dc8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.772166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09f8d68c-fb82-41b2-83dd-251fe8c82dc8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.791728 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09f8d68c-fb82-41b2-83dd-251fe8c82dc8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 12 microversion: 2.26 time: 0.043737 Aug 30 17:47:01.793200 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2004/4232] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:47:01 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:01.804542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cb9d820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:01.817798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.818688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.819394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.820127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:01.831071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.831884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.832524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.833736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.834394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.838906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.935722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.937219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.938228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:01.962543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:01.965491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:01.967280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.039529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:02.093236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14eb8b2b-a673-4e0a-aaee-070f62466418 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1578454069" status: 201 len: 0 microversion: 2.26 time: 0.290031 Aug 30 17:47:02.094985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2005/4233] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 30 17:47:01 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1578454069 => generated 0 bytes in 296 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 30 17:47:02.126212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0741bb7a-3c34-490a-80ab-1f97395e931e tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cd80b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.144543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:02.150403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0741bb7a-3c34-490a-80ab-1f97395e931e tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.154530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0741bb7a-3c34-490a-80ab-1f97395e931e tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.154990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0741bb7a-3c34-490a-80ab-1f97395e931e tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.197263 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0741bb7a-3c34-490a-80ab-1f97395e931e tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 36 microversion: 2.26 time: 0.093124 Aug 30 17:47:02.198575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2006/4234] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:47:02 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 36 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:02.212955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9873e1f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.224946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.225782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.226420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.227085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:02.233734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.234527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.235153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.244999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.246814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.247465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.282178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.283167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.284177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.322625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:02.349783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b093e504-d11e-4588-ab5d-4ed578919b59 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1578454069" status: 204 len: 0 microversion: 2.26 time: 0.143476 Aug 30 17:47:02.351997 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2007/4235] 10.222.0.50 () {60 vars in 1364 bytes} [Tue Aug 30 17:47:02 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1578454069 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:47:02.368084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dcff37c2-6735-47de-b73c-835ce98df63c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cb6f550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.386009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcff37c2-6735-47de-b73c-835ce98df63c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.386517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcff37c2-6735-47de-b73c-835ce98df63c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.386962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcff37c2-6735-47de-b73c-835ce98df63c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.414981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dcff37c2-6735-47de-b73c-835ce98df63c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 12 microversion: 2.26 time: 0.058123 Aug 30 17:47:02.415655 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2008/4236] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:47:02 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:02.426535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cd800d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.438150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.438637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.439740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.440405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:02.460294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.460606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.461197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.461744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.462209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.462633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.527400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.528355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.529141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.545171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:02.590084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a09118d-05e7-49aa-aae8-ec7c22182bfd tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 204 len: 0 microversion: 2.26 time: 0.168132 Aug 30 17:47:02.599312 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2009/4237] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 30 17:47:02 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:47:02.615858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d982720d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.645850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.648610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.649474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.653095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:02.682824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.682824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.682824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.682824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.682824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.685083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.754397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.755012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.755454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.772414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.772911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.773354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.801503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:02.828130 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-224af30a-ad1a-4b07-bad3-cfb06f9eb252 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 1.305750 Aug 30 17:47:02.833118 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2229/4238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:01 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:02.835087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:02.852476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:02.853128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:02.870809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.874132 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be8854a9-c90c-4c54-858b-179988c24456 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1479486934" status: 201 len: 0 microversion: 2.26 time: 0.272425 Aug 30 17:47:02.874481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.875138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.876324 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2010/4239] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 30 17:47:02 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-1479486934 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 30 17:47:02.882299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.883007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.883652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.890521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a6a992-6a11-40d4-8b5e-0fa8a98f673d", "name": "network-vif-plugged", "status": "completed", "tag": "4353c73c-5a33-4abc-9f33-c793b6a2ba1b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:02.921166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:02.922076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:02.923729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:02.977453 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] Creating event network-vif-plugged:4353c73c-5a33-4abc-9f33-c793b6a2ba1b for instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d on n-h2-852771-11 Aug 30 17:47:02.985184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0135a570-a843-4b7a-9134-57ded530e7d4 req-9db0a26c-d33d-4de8-9c78-aff2fe933de4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105189 Aug 30 17:47:02.989670 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2011/4240] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:03.023025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cb6f550>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.054851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.055555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.057061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.061164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:03.080559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.081286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.081830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.082670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.089513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.090195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.159580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.161004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.163406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.210029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.212033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.213020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.326226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:03.363494 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00731c08-ebc1-4401-9b4f-34b266624120 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-2022614415" status: 201 len: 0 microversion: 2.26 time: 0.372354 Aug 30 17:47:03.369157 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2012/4241] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 30 17:47:02 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-2022614415 => generated 0 bytes in 379 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 17:47:03.381170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d98d02b80>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.406342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.406342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.406342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.406342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:03.425119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.425713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.426368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.427496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.428084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.428647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.478299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.479002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.479677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.518064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:03.532106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:03.539638 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49999ad0-909c-4433-86d6-bd23c8801c2c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 204 len: 0 microversion: 2.26 time: 0.161526 Aug 30 17:47:03.543788 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2013/4242] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 30 17:47:03 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:47:03.546826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f82cd2c-7171-4a87-a36f-d2af7fdf0bbd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.710442 Aug 30 17:47:03.561324 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2230/4243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:02 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:03.562045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3496aba7-6f84-4e8c-8adf-01a5ec64e500 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9cd07280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.573082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3496aba7-6f84-4e8c-8adf-01a5ec64e500 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.573877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3496aba7-6f84-4e8c-8adf-01a5ec64e500 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.575163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3496aba7-6f84-4e8c-8adf-01a5ec64e500 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.594399 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3496aba7-6f84-4e8c-8adf-01a5ec64e500 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 12 microversion: 2.26 time: 0.048934 Aug 30 17:47:03.601544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2014/4244] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:47:03 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:03.609557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d938095e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.618308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:03.634015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.634784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.635419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.636084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:03.644024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.656476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.657175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.658744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.659692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.660443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.735349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.736740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.738979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.783153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:03.839187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ac3c9b4-4b9f-4f56-aad7-7ef7598fddd5 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 204 len: 0 microversion: 2.26 time: 0.232331 Aug 30 17:47:03.848010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2231/4245] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 30 17:47:03 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:47:03.853145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.853907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d936475e0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:03.854230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:03.865436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.866169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.866768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.867714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.868620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.870173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.886223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.887030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.887745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.889336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:03.904392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.906640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.907366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.909800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:03.911939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:03.912711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:03.920419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:04.011295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.012176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.013533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.034126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.034631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.035182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.107756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:04.153123 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa066bf1-e7e7-42f5-816f-d20b8eefcf83 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-2055423853" status: 201 len: 0 microversion: 2.26 time: 0.303579 Aug 30 17:47:04.162319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2232/4246] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 30 17:47:03 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-2055423853 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 17:47:04.184628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9368c430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:04.214932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.223077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.228965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.231793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:04.247674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.248518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.249170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.250089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.250769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.251838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.354021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.355817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.356390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.390043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.396895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.396895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.431138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:04.443260 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-935be171-293e-4caf-ad8a-54c04a1d2e4a tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1314 microversion: 2.1 time: 0.593698 Aug 30 17:47:04.445757 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2015/4247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:03 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:04.453264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:04.486442 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3c21fb9-31b3-4886-9fa9-c3991406b086 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-191703888" status: 201 len: 0 microversion: 2.26 time: 0.321737 Aug 30 17:47:04.492442 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2233/4248] 10.222.0.50 () {62 vars in 1377 bytes} [Tue Aug 30 17:47:04 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags/tempest-tag-191703888 => generated 0 bytes in 329 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 17:47:04.505884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Action: 'update_all', calling method: .version_select at 0x7f2d9873e040>, body: {"tags": ["tempest-tag-909949894", "tempest-tag-1104532531"]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:04.521688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.539259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.540167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.541221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:04.552965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.553593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.557915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.558771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.559349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.559919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.569475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:04.571518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:04.581083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.581603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.582046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.582757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.583206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.583660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.630454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.631060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.631629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.709314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:04.742915 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6133d57-7471-48af-bed8-720307fb1db6 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 61 microversion: 2.26 time: 0.244698 Aug 30 17:47:04.748738 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2016/4249] 10.222.0.50 () {62 vars in 1312 bytes} [Tue Aug 30 17:47:04 2022] PUT /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 61 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:04.764274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ec2e784-0afa-4d9c-b1ab-a889ae43c333 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9873ec10>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:04.793955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec2e784-0afa-4d9c-b1ab-a889ae43c333 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.795515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec2e784-0afa-4d9c-b1ab-a889ae43c333 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.795978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ec2e784-0afa-4d9c-b1ab-a889ae43c333 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.822611 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ec2e784-0afa-4d9c-b1ab-a889ae43c333 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 200 len: 61 microversion: 2.26 time: 0.070564 Aug 30 17:47:04.823247 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2017/4250] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 17:47:04 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 61 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:04.843303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '.version_select at 0x7f2d9386d1f0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:04.868960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.874000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.875671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.878043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:04.890217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.890702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.896851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.897915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.898555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.899175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.949493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:04.949982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:04.950434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:04.979081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'flavor' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:05.008995 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c0c3efef-b039-4e04-b6af-96427be6547c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags" status: 204 len: 0 microversion: 2.26 time: 0.179320 Aug 30 17:47:05.010115 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2018/4251] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 30 17:47:04 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724/tags => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:47:05.019740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:05.020579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:05.023059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:05.055984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.056851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.057497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.059610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.060243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.060834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.115941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:05.132708 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-448ed5b6-3448-43a7-b7e6-9beb73d9df98 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.567052 Aug 30 17:47:05.137044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:05.137204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2234/4252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:04 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:05.325655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "tag": "63475ec6-8546-4e01-a468-a039a40fb55a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:05.352313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8179fb4-78a5-4576-b012-012f86d852ca tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 204 len: 0 microversion: 2.26 time: 0.336997 Aug 30 17:47:05.353509 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2019/4253] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:47:05 2022] DELETE /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 17:47:05.358563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.362684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:05.363281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.363853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.368485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:05.387064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.387898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.388556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.389607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.390394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.391630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] Creating event network-changed:63475ec6-8546-4e01-a468-a039a40fb55a for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:05.391880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.415625 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-dc34364e-5cf5-4cc8-a85f-f9265c32a980 req-8dae42b1-f770-41ec-8590-e11b8779f532 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096027 Aug 30 17:47:05.421435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2235/4254] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:05.465028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:05.465725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:05.479168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.487804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.488331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.489194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:05.489747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:05.490241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:05.971344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:05.985895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:05.988247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:05.990160 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8557f1e-19b8-4669-aa8e-93e3c976a0d8 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1552 microversion: 2.26 time: 0.632586 Aug 30 17:47:05.993126 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2020/4255] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:05 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1552 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:47:06.161745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:06.163251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:06.177630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:06.178259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:06.179722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:06.180617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:06.182637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:06.183178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:06.251260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:06.271181 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7a09691-07b7-477c-85d0-43d451554b6c tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1497 microversion: 2.1 time: 0.809172 Aug 30 17:47:06.273559 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2236/4256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:05 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1497 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:07.020893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:07.021820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:07.046036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:07.047320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:07.047687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:07.050807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:07.055673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:07.056333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:07.961799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:07.975800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48ffd9fa-9e11-4f1c-a754-e1ccf4ff21ce tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.819402 Aug 30 17:47:07.978198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2021/4257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:06 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:08.423033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:08.446263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:08.452288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:08.460272 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd93b8a9-2af2-4db5-98cd-aaa4c45f91ac tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1552 microversion: 2.26 time: 1.445637 Aug 30 17:47:08.469034 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2237/4258] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:07 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1552 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:08.998446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:09.001000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:09.023505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:09.028335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:09.028913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:09.036180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:09.037900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:09.038990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:09.490775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:09.491669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:09.513520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:09.514039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:09.514486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:09.515213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:09.515706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:09.522966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:10.655227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:10.669159 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-197c510e-d4e5-4588-8733-2a2d40c89c89 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.673419 Aug 30 17:47:10.671496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2022/4259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:08 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:10.686526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "tag": "6b9d4e0a-ddac-4ea2-afdf-f244759ebdae"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:10.715771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:10.717664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:10.719577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:10.746178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] Creating event network-changed:6b9d4e0a-ddac-4ea2-afdf-f244759ebdae for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:10.756312 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c1b5adb0-c8ee-411e-9205-e0968f929391 req-8e4da396-3846-444d-a9c3-4a11301379ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083284 Aug 30 17:47:10.757576 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2023/4260] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:10.785367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:10.796957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:10.818192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:10.823033 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-037c6f3c-acb3-4620-95c3-ea591bd8269c tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1552 microversion: 2.26 time: 1.336638 Aug 30 17:47:10.828227 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2238/4261] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:09 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1552 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:47:11.677699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:11.678936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:11.692432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:11.693345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:11.700449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:11.704363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:11.710753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:11.711388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:11.711826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:11.712447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:11.714916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:11.715712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:11.716380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:11.721402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:11.722172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:11.722837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:11.790754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:11.817032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:11.975049 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7f756db-7c17-4006-8ce8-d3e1a4ef02bb tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 204 len: 0 microversion: 2.1 time: 0.302212 Aug 30 17:47:11.981755 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2024/4262] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:47:11 2022] DELETE /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:47:11.991637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:11.993776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:12.006677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.013710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.014349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.015295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.015918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.018423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.120793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.121280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.121714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.122165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lazy-loading 'fault' on Instance uuid d3d3de2f-f6af-4414-b6a7-269e9b1c6724 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:12.210547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:12.223692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:12.225423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40d56359724047b88e338599f169706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9851196371ea4d129d2c052cdd63db02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:12.228790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a49f1534-4f3e-4311-b29c-2af685c5bdb7 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 200 len: 1352 microversion: 2.26 time: 0.248594 Aug 30 17:47:12.230778 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2025/4263] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:11 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 1352 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:12.238560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d3de2f-f6af-4414-b6a7-269e9b1c6724", "name": "network-vif-deleted", "tag": "489f2f4c-9b11-40e6-91f1-631ece02356e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:12.268155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.268827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.271744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.304819 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] Creating event network-vif-deleted:489f2f4c-9b11-40e6-91f1-631ece02356e for instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 on n-h1-852771-11 Aug 30 17:47:12.314406 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-631eda91-0953-4a19-ab08-b095bec2b0a8 req-f5658619-3d16-4ba4-a68a-e30845c5e04c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080300 Aug 30 17:47:12.315601 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2026/4264] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:12.323020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:12.328299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:12.345785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.346644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.348034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.349660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.352422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.353051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.528496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:12.543055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-40def52d-f88b-436d-a738-4bdf6ed442fb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.853680 Aug 30 17:47:12.544211 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2239/4265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:11 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:12.828245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:12.831718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "tag": "b1f38d63-62c9-4759-bfa0-1573c5c08378"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:12.836902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6f3bbcf-06a3-44c3-9bc0-43658b63c14f tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1503 microversion: 2.1 time: 0.519949 Aug 30 17:47:12.840386 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2027/4266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:12 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1503 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:12.870820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:12.880367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:12.881146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:12.901741 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] Creating event network-changed:b1f38d63-62c9-4759-bfa0-1573c5c08378 for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:12.914124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-64673897-b09e-40e9-924f-959bf7fd49a6 req-59fc0d31-5300-4a41-8b01-fce5c9720815 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088708 Aug 30 17:47:12.914744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2240/4267] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:13.259035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:13.259977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] [instance: d3d3de2f-f6af-4414-b6a7-269e9b1c6724] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:13.269100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.279142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.279854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.280774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.281379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.281957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.309698 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] HTTP exception thrown: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Request method failure captured: Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 HTTP/1.1 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkz1hCMwgruPQBgqLQflkTzUpY8RXGHbKJDgizEeLpiaanvZO0XgIX9BzuoxaNhWjGjyKiW1xrBLmLOZKrfk6l90p2wsf2V2XjL3iqtbnUBmf_aKtwSpZJKQZQMn49cIAa_C7xtJwvDllGGoMlutbIPGNjRs9qfGsjTNxT5SQrw8pM4 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.26 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9851196371ea4d129d2c052cdd63db02 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerTagsTestJSON-1043117542 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9851196371ea4d129d2c052cdd63db02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9851196371ea4d129d2c052cdd63db02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9851196371ea4d129d2c052cdd63db02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9851196371ea4d129d2c052cdd63db02"}]}] Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerTagsTestJSON-1043117542 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9851196371ea4d129d2c052cdd63db02 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerTagsTestJSON-1043117542 Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerTagsTestJSON-1043117542-project Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 40d56359724047b88e338599f169706c Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerTagsTestJSON-1043117542-project Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd3d3de2f-f6af-4414-b6a7-269e9b1c6724'} Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:13.311685 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. Aug 30 17:47:13.317218 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:13.318417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] Returning 404 to user: Instance d3d3de2f-f6af-4414-b6a7-269e9b1c6724 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:13.323687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15d25590-575b-467e-ae14-864595e6e642 tempest-ServerTagsTestJSON-1043117542 tempest-ServerTagsTestJSON-1043117542-project] 10.222.0.50 "GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724" status: 404 len: 111 microversion: 2.26 time: 0.068481 Aug 30 17:47:13.324768 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2028/4268] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:13 2022] GET /compute/v2.1/servers/d3d3de2f-f6af-4414-b6a7-269e9b1c6724 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:47:13.572724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:13.576202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:13.602083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.603325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.603990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.604910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.605608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.606644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.862016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:13.863277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:13.880905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.881690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.882311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.883194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:13.883848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:13.884486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:13.938282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:14.979387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:14.989638 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a04effd-f611-4c64-9cb5-fc514bc03884 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.422318 Aug 30 17:47:15.006323 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2241/4269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:13 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:15.088508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:15.106343 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b46f4a5a-cee3-4d25-b100-ee9b40d9b514 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1503 microversion: 2.1 time: 1.249404 Aug 30 17:47:15.118949 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2029/4270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:13 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1503 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:16.030357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:16.033158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:16.077074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:16.078090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:16.086113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:16.087364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:16.088085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:16.099537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:16.167408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:16.182107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:16.256806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:16.259199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:16.259976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:16.265408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:16.268217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:16.271118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:16.785056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:16.793889 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4b7e623-41a8-46dd-9400-0dc3a929f014 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1461 microversion: 2.1 time: 0.647555 Aug 30 17:47:16.805074 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2030/4271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:16 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1461 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:16.979778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a6a992-6a11-40d4-8b5e-0fa8a98f673d", "name": "network-vif-deleted", "tag": "4353c73c-5a33-4abc-9f33-c793b6a2ba1b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:17.014861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:17.020316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:17.029207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:17.065217 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] Creating event network-vif-deleted:4353c73c-5a33-4abc-9f33-c793b6a2ba1b for instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d on n-h2-852771-11 Aug 30 17:47:17.089151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-db8f2107-7e0c-4d43-bade-51d8b623a1fb req-2d10138b-ff4e-4354-9415-6e9e23b3b158 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112876 Aug 30 17:47:17.092549 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2031/4272] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:17.533070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:17.570084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b66aaa36-7096-4959-bd1f-7b57a4f2b624 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.559968 Aug 30 17:47:17.571285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2242/4273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:16 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:17.821833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:17.822609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:17.830203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:17.841660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:17.842504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:17.843207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:17.843687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:17.844116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:17.957653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:17.957949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:17.958396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:17.958851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lazy-loading 'fault' on Instance uuid 60a6a992-6a11-40d4-8b5e-0fa8a98f673d {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:18.607215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:18.608135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:18.613541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0f1fe242cc4821af3a419728fc27ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d084c74f4e46d5a34f0bb24ae87138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:18.641378 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30f0b658-767b-4452-aca8-ebfa79aa7bb0 tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 200 len: 1304 microversion: 2.1 time: 0.809019 Aug 30 17:47:18.648339 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2032/4274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:17 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 1304 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:18.659019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:18.662464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:18.664395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:18.676344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:18.680155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:18.681805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:19.670855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:19.670855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] [instance: 60a6a992-6a11-40d4-8b5e-0fa8a98f673d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:19.687408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:19.695075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:19.695547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:19.696496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:19.696929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:19.697558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:19.726118 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] HTTP exception thrown: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Request method failure captured: Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d HTTP/1.1 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkz4tI5RizU4aQESZQt4dOAQ-MyX3qhoJtTvusPk5urhWzwYHFZHzlIQoROArHVr9BGNQGud5whDIkgnsV8fZSKyEtOrA8iPDhfRHWttTTgPwz97rvihPh0Nc_QyxwvuCpctGAHViUy5W_q3k5d5JNDCCmsQSW00WzXv0hg7w2BpDBs Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: e6d084c74f4e46d5a34f0bb24ae87138 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesActionsTest-1859252543 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6d084c74f4e46d5a34f0bb24ae87138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6d084c74f4e46d5a34f0bb24ae87138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6d084c74f4e46d5a34f0bb24ae87138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6d084c74f4e46d5a34f0bb24ae87138"}]}] Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesActionsTest-1859252543 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: e6d084c74f4e46d5a34f0bb24ae87138 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesActionsTest-1859252543 Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesActionsTest-1859252543-project Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8d0f1fe242cc4821af3a419728fc27ba Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesActionsTest-1859252543-project Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '60a6a992-6a11-40d4-8b5e-0fa8a98f673d'} Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:19.734979 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. Aug 30 17:47:19.743204 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:19.745982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] Returning 404 to user: Instance 60a6a992-6a11-40d4-8b5e-0fa8a98f673d could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:19.747194 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ca288c4b-78bb-4bf0-9420-6c53b82a452b tempest-VolumesActionsTest-1859252543 tempest-VolumesActionsTest-1859252543-project] 10.222.0.50 "GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d" status: 404 len: 111 microversion: 2.1 time: 0.080868 Aug 30 17:47:19.748025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2033/4275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:19 2022] GET /compute/v2.1/servers/60a6a992-6a11-40d4-8b5e-0fa8a98f673d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:47:20.002216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:20.015552 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce5b0db3-d56c-47af-b88e-7d61c2d03977 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.428406 Aug 30 17:47:20.016334 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2243/4276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:18 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:21.036761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:21.038153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:21.046661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:21.047651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:21.049822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:21.052151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:21.053801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:21.056501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:22.341875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:22.373078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f07e46b-d1f0-4c61-8d5f-90bb27ac65f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.340653 Aug 30 17:47:22.394393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2034/4277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:21 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:23.410421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:23.410421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:23.414522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:23.415024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:23.415492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:23.419231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:23.423904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:23.424429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:24.353176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-441608719", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "2a1be670-9ea6-48b8-8649-8457c79da09e"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:24.468881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] validate_networks() for [('2a1be670-9ea6-48b8-8649-8457c79da09e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:47:24.639501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:24.650110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c4665414-5bea-42b9-9f36-06fa1c5408f9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.253527 Aug 30 17:47:24.655612 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2244/4278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:23 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:25.233750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:25.234177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:25.234709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:25.235198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:25.236896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:25.259941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:25.260581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:25.261029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:25.261823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:25.262340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:25.262774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:25.329743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Getting quotas for project df117d62dda2430d9b92e637eb6f4b48. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:25.356575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Getting quotas for user 4ef90d7b9c274a9095ffac59d031b31e and project df117d62dda2430d9b92e637eb6f4b48. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:25.419833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:47:25.432922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:47:25.667710 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92dadbb7-ea97-4bca-b412-0bd35c577375 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610819 Aug 30 17:47:25.675331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:25.676828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:25.684203 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2035/4279] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:47:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:47:25.695225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:25.697028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:25.698783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0d3a9ba-237a-477b-951d-62c887f14d3d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:25.701991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:25.703101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:25.704755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0d3a9ba-237a-477b-951d-62c887f14d3d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:25.707607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:25.709865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:25.872817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0d3a9ba-237a-477b-951d-62c887f14d3d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:25.884669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0d3a9ba-237a-477b-951d-62c887f14d3d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1216 microversion: 2.1 time: 0.193385 Aug 30 17:47:25.888294 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2036/4280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:25 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:26.130793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2072504029", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "80fa596a-6ff8-4c80-9f03-4d6b0f428423"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:26.256169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] validate_networks() for [('80fa596a-6ff8-4c80-9f03-4d6b0f428423', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:47:26.848365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:26.877457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1340d8d-e701-4be9-ab1d-6eea10b440c0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.203982 Aug 30 17:47:26.880387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2245/4281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:25 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:26.909968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:26.910835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:26.931052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:26.934996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:26.936125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:26.940115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:26.940748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:26.945671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:27.306135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:27.325561 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcf53d36-2d33-4a03-ad5e-6a1c67c24197 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1220 microversion: 2.1 time: 0.419890 Aug 30 17:47:27.345757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2246/4282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:26 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1220 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:27.901233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:27.907462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:27.916807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:27.925000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:27.943217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:27.943865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:27.944339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:27.944769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:28.526215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:28.536734 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-667142cd-0fa9-4d1d-a0d2-1b1658c2d183 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.639640 Aug 30 17:47:28.552234 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2247/4283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:27 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:28.625675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:28.626310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:28.626972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:28.627440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:28.628313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:28.659321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:28.660568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:28.666620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:28.667522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:28.668000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:28.674001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:28.740155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1076966356", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:28.755951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Getting quotas for project 2ae9f674d66648f6b1e80872a418f9c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:28.787817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Getting quotas for user 6f8b967570a14b2ca709e76c0a7461b3 and project 2ae9f674d66648f6b1e80872a418f9c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:28.845882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:47:28.855653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:47:28.904566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:47:29.075204 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-94ac5368-6854-4534-a000-2bd984e3bd43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.184233 Aug 30 17:47:29.077553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2037/4284] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:47:29.100262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:29.105308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:29.120525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:29.122012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:29.122704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:29.124077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:29.125940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:29.135702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:29.322691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:29.333998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35f38437-fd4d-47cf-85ac-61f168d99c3c tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1274 microversion: 2.1 time: 0.251673 Aug 30 17:47:29.354283 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2038/4285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:29 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:29.361003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7549db85-e1d2-4628-b5d1-05c15f7dcdd1 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:29.372068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7549db85-e1d2-4628-b5d1-05c15f7dcdd1 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:29.561632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7549db85-e1d2-4628-b5d1-05c15f7dcdd1 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:29.604564 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7549db85-e1d2-4628-b5d1-05c15f7dcdd1 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1225 microversion: 2.1 time: 0.246507 Aug 30 17:47:29.606358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2039/4286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:29 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:29.624865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:29.632318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:29.668076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:29.668614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:29.669018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:29.669739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:29.670193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:29.681116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:30.605789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:30.624547 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15add9b6-abb6-4c52-924d-e710fb3572e4 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.011975 Aug 30 17:47:30.625177 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2040/4287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:29 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:30.639169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:30.647184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:30.671963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:30.673773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:30.677092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:30.678101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:30.678749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:30.679372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:30.923930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:30.949107 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c386d66c-3303-4549-96c0-ffe84cf1a315 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1274 microversion: 2.1 time: 0.316045 Aug 30 17:47:30.949728 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2041/4288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:30 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:30.971288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:30.975799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:31.020294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:31.023145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:31.025376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:31.041720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:31.042231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:31.042680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:31.452186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:31.466152 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dde5c019-4a2b-4e74-aaaa-ea4b7c657727 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1221 microversion: 2.1 time: 0.515323 Aug 30 17:47:31.470608 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2042/4289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:30 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1221 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:31.663055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:31.664671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:31.686749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:31.687253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:31.687745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:31.700961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:31.708547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:31.714346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:32.640080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:32.653615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a4e6b91-22cb-41d7-86ab-b15132172d21 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.993651 Aug 30 17:47:32.673312 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2043/4290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:31 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:32.689323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:32.689955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:32.718160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:32.720956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:32.721441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:32.726543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:32.727056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:32.727513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.188505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:33.204166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9b2e165-64f4-4c6a-a0e1-869d1611df91 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.529551 Aug 30 17:47:33.217954 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2044/4291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:32 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:33.224083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:33.228571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:33.239799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:33.241540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.244205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.245993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.246896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.248287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.251439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.374323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:33.389723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03fffcaa-6fbf-4754-a949-040f9bb8ae71 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1283 microversion: 2.1 time: 0.165865 Aug 30 17:47:33.391900 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2045/4292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:33 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:33.603068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:33.603928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:33.604399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:33.604818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:33.605596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:33.640604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.648822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.649329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.650705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.651233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.651748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.727882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:33.728633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:33.729160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=44 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:33.737527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.738023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.738465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.739182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:33.743785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:33.744392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:33.757097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:33.775469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:33.837001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:47:33.839230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:47:34.053724 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e85d40aa-0e95-42a4-8916-d672092df151 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.499825 Aug 30 17:47:34.058871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2248/4293] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:47:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:47:34.067574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4be4a9a1-c690-49e0-88c0-d4f78fc4c732 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:34.080930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4be4a9a1-c690-49e0-88c0-d4f78fc4c732 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:34.293211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4be4a9a1-c690-49e0-88c0-d4f78fc4c732 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:34.305063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4be4a9a1-c690-49e0-88c0-d4f78fc4c732 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1193 microversion: 2.1 time: 0.240277 Aug 30 17:47:34.309025 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2249/4294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:34 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1193 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:34.335846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:34.338088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:34.364857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:34.374607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:34.375083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:34.376441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:34.376884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:34.395292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:34.636811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:34.651044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ef852853-30ad-4a7d-bdd0-67014e27af1f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.969856 Aug 30 17:47:34.656059 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2046/4295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:33 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:34.697775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:34.701913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:34.733429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:34.735332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:34.737499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:34.738693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:34.743266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:34.744167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:35.066694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:35.100334 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-850f216d-d1a4-4b9e-bce3-52ba872761c7 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.789980 Aug 30 17:47:35.115058 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2250/4296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:34 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:35.200536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:35.227316 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c75a8f8-0e25-4772-b60d-adbe207d6b7f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1283 microversion: 2.1 time: 0.561864 Aug 30 17:47:35.235063 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2047/4297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:34 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1283 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:35.330802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c96dc245-9306-43cd-b2ac-03fa2a8ae4cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:35.331872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c96dc245-9306-43cd-b2ac-03fa2a8ae4cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:35.622141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f58767a-9d9e-4b9f-b51c-60ceb4b683b4", "tag": "9d2d7b06-bd6f-4d03-ae04-15c24c218010"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:35.655030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:35.657694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:35.659156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:35.700013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c96dc245-9306-43cd-b2ac-03fa2a8ae4cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:35.715220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c96dc245-9306-43cd-b2ac-03fa2a8ae4cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1193 microversion: 2.1 time: 0.388854 Aug 30 17:47:35.731932 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2251/4298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:35 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1193 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:35.741270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] Creating event network-changed:9d2d7b06-bd6f-4d03-ae04-15c24c218010 for instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 on n-h1-852771-11 Aug 30 17:47:35.757707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:35.765202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:35.772560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b0a64c55-34c4-4e84-8c1a-13f39d5914eb req-40eb088f-18df-454f-b020-3535059840a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147173 Aug 30 17:47:35.773481 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2048/4299] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:35.803541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:35.804088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:35.804530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:35.805247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:35.805812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:35.806111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:36.140982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:36.142144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:36.179559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:36.180057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:36.180492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:36.181198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:36.181642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:36.194826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:36.629403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:36.676346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c237599d-fb3d-4d17-ad18-b2836640c31d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.943125 Aug 30 17:47:36.689415 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2252/4300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:35 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:36.717647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:36.722206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:36.742904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:36.744015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:36.747594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:36.750755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:36.751578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:36.752787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:37.125528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:37.136330 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b2fe15a-73b8-431a-802b-eedb58b7334d tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 0.440336 Aug 30 17:47:37.137997 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2253/4301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:36 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:37.473601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-407987365", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:37.658535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:37.659168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:37.659511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:37.659935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:37.660350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:37.697335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:37.698407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:37.699109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:37.700743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:37.701449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:37.702114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:37.786616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Getting quotas for project 0179a3127af64f769f16133637bf620c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:37.821983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Getting quotas for user 8fb7d6104778450281583d56f7f19dd5 and project 0179a3127af64f769f16133637bf620c. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:37.841628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:47:37.851832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:47:37.958695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2107e071-0f68-42ff-8644-06609c6316e7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.819042 Aug 30 17:47:37.967942 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2254/4302] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:47:37.973485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:37.974092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:38.029100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:38.044187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:38.044803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:38.045730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:38.060482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:38.061206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:38.502660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:38.528680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:38.531564 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-352b51cc-4032-4274-b408-3da86a03ed45 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 2.395323 Aug 30 17:47:38.543506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2fccacb2-ca94-4e2e-a979-edd301ec69fd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1251 microversion: 2.1 time: 0.569105 Aug 30 17:47:38.546702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2255/4303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:37 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1251 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:38.547993 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2049/4304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:36 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:38.567000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:38.569045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:38.576815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a0f051-6037-4d2c-92d7-539ae801c770", "tag": "1f32f616-f185-435d-831f-3090555a479c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:38.591995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:38.595657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:38.599031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:38.599833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:38.600320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:38.603953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:38.610137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:38.612476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:38.613189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:38.675219 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] Creating event network-changed:1f32f616-f185-435d-831f-3090555a479c for instance 09a0f051-6037-4d2c-92d7-539ae801c770 on n-h2-852771-11 Aug 30 17:47:38.708577 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5cd844db-cc98-4a21-ac2e-fd9e7733d321 req-d394e35c-7f75-407a-b406-5b6ebda76128 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149677 Aug 30 17:47:38.714415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2050/4305] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:38.716869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:38.737097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:38.745279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:39.097135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:39.110688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:39.112702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:39.125718 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c64882f-1c9e-4265-9242-77b4a7a5ef60 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1277 microversion: 2.54 time: 0.397956 Aug 30 17:47:39.128281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2051/4306] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:38 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1277 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:39.146003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:39.149495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:39.176758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:39.177247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:39.177676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:39.186565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:39.187305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:39.188596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:39.240103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:39.279919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69fe1c51-2f3a-4308-aac1-d02adf686635 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.729178 Aug 30 17:47:39.281307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2256/4307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:38 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:39.557261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:39.558086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:39.575319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:39.576891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:39.581445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:39.584911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:39.585699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:39.587726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.042506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.053826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-47a5bfda-b7d8-49e4-b19e-db69a85d20bd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.503666 Aug 30 17:47:40.075999 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2257/4308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:39 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:40.093311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:40.094498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:40.117804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.118315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.118877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.119705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.120345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.120945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.192536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.196164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:40.201205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9dfb257-1997-4878-979d-0eb7e79c8b89 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 1.071838 Aug 30 17:47:40.216163 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2052/4309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:39 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:40.231687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-plugged", "status": "completed", "tag": "b1f38d63-62c9-4759-bfa0-1573c5c08378"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:40.287607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.289789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.291749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.292523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.309460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15c207ba-e587-42ce-b8c2-6c8feaf4b5fe tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1251 microversion: 2.1 time: 0.232221 Aug 30 17:47:40.314450 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2258/4310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:40 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1251 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:40.322622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] Creating event network-vif-plugged:b1f38d63-62c9-4759-bfa0-1573c5c08378 for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:40.333424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:40.335682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:40.353952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.354565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9adf5024-6dfd-4417-a223-a0a8200fce28 req-c49fa163-ffd7-484a-9394-c8753f94853b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136595 Aug 30 17:47:40.357392 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2053/4311] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:40.360478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.362183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.363822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.370679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.371160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:40.371403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.372333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:40.389043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.389794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.390427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.391987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:40.392616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:40.393203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:40.805446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.825707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.831302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:40.836237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ed534f4-e38a-47fd-a982-0fc069cc4f35 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1273 microversion: 2.54 time: 0.517808 Aug 30 17:47:40.838152 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2259/4312] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:40 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:41.119977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:41.121389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:41.136695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.137600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.138901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:41.141420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.144195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.145149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:41.251818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:41.555993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:41.567974 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66f7f4d1-7bd1-4aea-8f04-8302bbfe1738 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.467315 Aug 30 17:47:41.571007 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2260/4313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:41 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:41.588912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:41.594899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:41.614399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:41.623775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.624873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.625546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:41.626641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.629212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.630167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:41.633430 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-236f5ca3-8bc4-4909-bc1c-3fbf193e8e27 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 1.273701 Aug 30 17:47:41.638649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2054/4314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:40 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:41.655011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:41.666391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:41.695615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.703966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.705668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:41.708590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:41.709067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:41.714245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.173883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:42.188669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44ab94d1-e4aa-4c5c-a17e-481afa54f686 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 0.616333 Aug 30 17:47:42.200278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2261/4315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:41 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:42.219456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:42.227657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:42.245188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.245685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.246116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.246931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.247381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.264695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.401730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:42.415383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:42.418058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:42.419744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f69b61a2-3594-4f5b-92fc-1918c66e4db2 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1335 microversion: 2.54 time: 0.218401 Aug 30 17:47:42.425770 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2262/4316] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:42 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:42.513047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:42.526008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c1532bb-5f2e-4327-93e7-cdfb8d6f4557 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.880164 Aug 30 17:47:42.527986 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2055/4317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:41 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:42.554090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-plugged", "status": "completed", "tag": "63475ec6-8546-4e01-a468-a039a40fb55a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:42.576379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.577080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.579863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.593961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:42.594641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:42.607272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.612026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.615339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.616358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.616897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.617397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.631766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] Creating event network-vif-plugged:63475ec6-8546-4e01-a468-a039a40fb55a for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:42.648872 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ebcdeafc-0f4e-4db5-8d52-0c1d4fc6e257 req-cb1bd16b-2190-4a7e-8781-e0d7d5e6ee1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104686 Aug 30 17:47:42.651997 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2263/4318] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:42.673809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:42.675376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:42.701259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.703664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.705795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:42.707141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:42.710067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:42.713153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.307583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.318074 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37ca1c9f-af91-4f96-b0bc-bfce021503a1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.658213 Aug 30 17:47:43.323372 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2264/4319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:42 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:43.346286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:43.348590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:43.367438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.373439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.374214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.376292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.380136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.380830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.612131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.634955 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e17d524-835d-46af-a2d6-3a2f00604279 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 1.042459 Aug 30 17:47:43.639820 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2056/4320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:42 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:43.664711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:43.667878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:43.698875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.699784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.702745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.705411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.708600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.713081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.782594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.795649 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f09eb566-758f-40a4-b381-050d041a15fb tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 0.470555 Aug 30 17:47:43.798164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2265/4321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:43 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:43.810551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:43.811196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:43.825842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.826353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.826802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.833143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:43.833827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:43.834294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:43.967285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.976358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.982696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:43.988387 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a64a873d-9023-411d-83ac-14d32ebe8859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1335 microversion: 2.54 time: 0.341135 Aug 30 17:47:43.990421 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2057/4322] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:43 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1335 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:44.244313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:44.284451 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-95e3b6a1-e772-44eb-9db5-6bf469c2e9e2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.473575 Aug 30 17:47:44.284451 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2266/4323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:43 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:44.344716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:44.345323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:44.357211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.357701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.358135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:44.358841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.359891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.368292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:44.667904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:44.668671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:44.682089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.682584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.685053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:44.685838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.686304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.686736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:44.787085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:44.797161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19291ff5-f500-4d06-9612-f8858988276d tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.456496 Aug 30 17:47:44.815305 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2058/4324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:44 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:44.820706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:44.822353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:44.829838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.830620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.831354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:44.832293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:44.832932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:44.834533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.071374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.086413 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e3319b7-7642-4499-88aa-9e13dfe4e757 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.430097 Aug 30 17:47:45.101370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2267/4325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:44 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:45.115329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-plugged", "status": "completed", "tag": "6b9d4e0a-ddac-4ea2-afdf-f244759ebdae"}, {"server_uuid": "09a0f051-6037-4d2c-92d7-539ae801c770", "name": "network-vif-plugged", "status": "completed", "tag": "1f32f616-f185-435d-831f-3090555a479c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:45.142627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.143131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.143626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.176639 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Creating event network-vif-plugged:6b9d4e0a-ddac-4ea2-afdf-f244759ebdae for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:45.179355 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] Creating event network-vif-plugged:1f32f616-f185-435d-831f-3090555a479c for instance 09a0f051-6037-4d2c-92d7-539ae801c770 on n-h2-852771-11 Aug 30 17:47:45.190181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.199109 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-39905e0d-234b-4752-a9d4-aba95fab233e tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 0.382439 Aug 30 17:47:45.202062 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-461d4536-5c4d-4161-9a07-4fc855f1eea6 req-175ede26-a027-4c6c-8e74-839099d40728 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098388 Aug 30 17:47:45.203927 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2268/4326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:45.208146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2059/4327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:44 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:45.212915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:45.213708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:45.224622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.226077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.229169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.231143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.232020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.232630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.307614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:45.308227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:45.320246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.320941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.321560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.322436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.323062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.323718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.451908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.466667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.468010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.471628 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3c3980a-c708-4e61-9568-68ad238c68da tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1356 microversion: 2.54 time: 0.265585 Aug 30 17:47:45.472290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2269/4328] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:45 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1356 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:45.485606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099dbd08-b3b7-440a-bc93-c6dedaf2c06e", "tag": "9c8db8ab-d118-436b-b20f-9db7ee8c3eea"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:45.507601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.508084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.509127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.537303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] Creating event network-changed:9c8db8ab-d118-436b-b20f-9db7ee8c3eea for instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e on n-h1-852771-11 Aug 30 17:47:45.542694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f23aeab9-1ecd-403b-a7f5-32f494bc3c3f req-da643f2c-85ee-45b9-bf6a-af0d2d4bdacf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068854 Aug 30 17:47:45.543112 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2270/4329] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:45.548679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-695e7cb8-f996-461a-818d-0f1d2fb60ebb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Action: 'create', calling method: .version_select at 0x7f2d936471f0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-94178303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ7Niy50I8fcrCt5B3LQh9FtjMWxDT/epf4T4+/bfkRxJgUUh2Uz3ig3OKDf4jyYLEwK3dwRG2N9pe2MEy7JktJ7HMgLPNiYe5wB0d5UIfILTeMOiCFZj8Cx6YBNc6O7w=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:45.569380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-695e7cb8-f996-461a-818d-0f1d2fb60ebb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Getting quotas for project 0179a3127af64f769f16133637bf620c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:45.576908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-695e7cb8-f996-461a-818d-0f1d2fb60ebb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Getting quotas for user 8fb7d6104778450281583d56f7f19dd5 and project 0179a3127af64f769f16133637bf620c. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:45.612133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-695e7cb8-f996-461a-818d-0f1d2fb60ebb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.066908 Aug 30 17:47:45.613135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2271/4330] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:47:45 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:47:45.626113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-94178303", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:45.629305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:45.637237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.637727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.638179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.638968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.639432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.639897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.686084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:45.694993 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f56ee38-3e39-458e-80db-fdb9580a5b5d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.391070 Aug 30 17:47:45.706635 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2060/4331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:45 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:45.758079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:45.759018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:45.765751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:45.766380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:45.767583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:45.850446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:45.851817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:45.893395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.894021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.894456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.895377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.895994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.896659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.924547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:45.933159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.933650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.934112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.941310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:45.941799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:45.942289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:45.972940 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0a74f77-77fd-409d-a3d6-f82183089d39 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "POST /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc/action" status: 202 len: 1137 microversion: 2.54 time: 0.351496 Aug 30 17:47:45.989080 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2272/4332] 10.222.0.50 () {62 vars in 1320 bytes} [Tue Aug 30 17:47:45 2022] POST /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc/action => generated 1137 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 17:47:46.001561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:46.002119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:46.019196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.020321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.021233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.022191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.023685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.024346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.120691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.129949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.132835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.134063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f0cfe38b-d898-4d66-b9d6-241aa0567fb6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.142961 Aug 30 17:47:46.134963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2273/4333] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:45 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:46.139566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:46.140143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:46.158444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.158967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.159650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.162702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.163183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.163648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.283000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.299356 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e987842-7cbf-4628-8700-9d3a79e61ff3 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1355 microversion: 2.1 time: 0.452899 Aug 30 17:47:46.301940 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2061/4334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:45 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1355 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:46.313492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:46.316653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:46.332947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.333784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.334467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.335427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.336136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.337218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.413984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.423568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10730285-d9e7-4128-b3f0-5af0e1fed577 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.287402 Aug 30 17:47:46.424298 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2274/4335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:46 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:46.589255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.598618 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57b2b4d2-da0d-45f8-b11d-aad55d6e0b96 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1325 microversion: 2.1 time: 0.294976 Aug 30 17:47:46.599217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2062/4336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:46 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:46.717657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:46.718284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:46.725996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.726484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.736156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.738492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:46.741777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:46.742432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:46.918828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:46.928204 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d5c80cc-f069-4d86-8eff-932a7c17d752 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.214834 Aug 30 17:47:46.929473 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2275/4337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:46 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:47.159187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.159809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.181776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.184552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.185268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.191208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.192101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.192711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.221586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f58767a-9d9e-4b9f-b51c-60ceb4b683b4", "name": "network-vif-plugged", "status": "completed", "tag": "9d2d7b06-bd6f-4d03-ae04-15c24c218010"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:47.234746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:47.247369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.248119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.250186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.291451 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] Creating event network-vif-plugged:9d2d7b06-bd6f-4d03-ae04-15c24c218010 for instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 on n-h1-852771-11 Aug 30 17:47:47.300673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9f2aec67-4251-48a8-a999-b34b6e472075 req-549af010-ff6e-4ee7-8339-3e63791e25f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082785 Aug 30 17:47:47.302095 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2276/4338] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:47.333782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.334501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.350905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.351451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.351945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.352699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.353162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.353625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.378301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.397788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.402810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.404065 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2203df03-6ac7-43ce-a4de-027440052095 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.249594 Aug 30 17:47:47.411343 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2063/4339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:47.454078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.459995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.476532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.477027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.483876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.485985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.486714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.487159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.634879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.645700 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d628d9dc-5a72-4f83-b773-05f108b07116 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1805 microversion: 2.1 time: 0.328079 Aug 30 17:47:47.646962 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2277/4340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1805 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:47.653118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.653912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.663864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.664776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.666316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.667578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.668530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.669440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.677168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:47.744912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:47.851275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.860923 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1423766-394c-456e-b052-003617969173 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1316 microversion: 2.1 time: 0.420067 Aug 30 17:47:47.862464 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2064/4341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:47.867773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.868517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.875525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.876234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.876838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.877744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.878361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.878948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.919951 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-057114ff-c81b-4c65-9e54-d1d6714c0749 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343/ips" status: 200 len: 218 microversion: 2.1 time: 0.056049 Aug 30 17:47:47.920882 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2065/4342] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343/ips => generated 218 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:47.933883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:47.934397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:47.941380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.942109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.945927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.947003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:47.947795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:47.948534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:47.980685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:47.993988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:47.994734 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a04d7bcc-38f0-4b6d-87c6-aa4b19486d43 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1521 microversion: 2.1 time: 0.343146 Aug 30 17:47:47.995742 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2278/4343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:48.023902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.024824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.044814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.045881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.047170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.048246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.048939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.051353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.157524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8862f41d-746f-412f-a2ea-53958d999742 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 204 len: 0 microversion: 2.1 time: 0.227195 Aug 30 17:47:48.159403 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2066/4344] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:47:47 2022] DELETE /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:47:48.179075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.184924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.198381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.198866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.203741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.204881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.205356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.205790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.278382 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] HTTP exception thrown: Action 999 not found Aug 30 17:47:48.287787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Request method failure captured: Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770/os-instance-actions/999 HTTP/1.1 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0tyfete6YmP3axC-4eyXJSAd48VwNiJOk9uaw9w-9lYPvYuGXL1LJvjtwYPSHxuRK9Al-xh5-JKyeG9R6VGczpqGm3ScrTHCpbhpOOqhtL9NE03gGEsCNqno5P-Oymx9n7meaeeW5u1q9Z3gtqIuo_zADkf3nw5hQ1QvyN8uiBSoM Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ae9f674d66648f6b1e80872a418f9c4"}]}] Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6f8b967570a14b2ca709e76c0a7461b3 Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: exception: Action 999 not found Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '09a0f051-6037-4d2c-92d7-539ae801c770', 'id': '999'} Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 30 17:47:48.292128 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.296413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Returning 404 to user: Action 999 not found {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:48.296413 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f7c618e-0323-47d3-af47-f7b6d7496f98 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.130613 Aug 30 17:47:48.296413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2067/4345] 10.222.0.50 () {58 vars in 1308 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770/os-instance-actions/999 => generated 66 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:47:48.302889 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4c14e35-cb19-436a-b5bb-f97fb46a863b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.301867 Aug 30 17:47:48.315600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.315600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.317728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2279/4346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:47 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:48.320515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.320515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.320816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.321520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.321973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.322395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.325144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '.version_select at 0x7f2d935f5700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.325936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 87270144-8f7e-415c-9304-40e723bae7ba] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.333989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] HTTP exception thrown: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Request method failure captured: Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/87270144-8f7e-415c-9304-40e723bae7ba/os-instance-actions HTTP/1.1 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0tyfete6YmP3axC-4eyXJSAd48VwNiJOk9uaw9w-9lYPvYuGXL1LJvjtwYPSHxuRK9Al-xh5-JKyeG9R6VGczpqGm3ScrTHCpbhpOOqhtL9NE03gGEsCNqno5P-Oymx9n7meaeeW5u1q9Z3gtqIuo_zADkf3nw5hQ1QvyN8uiBSoM Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ae9f674d66648f6b1e80872a418f9c4"}]}] Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6f8b967570a14b2ca709e76c0a7461b3 Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '87270144-8f7e-415c-9304-40e723bae7ba'} Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:48.336226 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. Aug 30 17:47:48.340377 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:48.342287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Returning 404 to user: Instance 87270144-8f7e-415c-9304-40e723bae7ba could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:48.343979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c217a903-8f03-433e-981d-1aee3b75b9a2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/87270144-8f7e-415c-9304-40e723bae7ba/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024392 Aug 30 17:47:48.345050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2280/4347] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/87270144-8f7e-415c-9304-40e723bae7ba/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:47:48.357313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.360263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.401416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.402410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.402948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.406750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.406891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.411588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.475404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:48.631025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c92e5f97-c86b-4bc1-80f2-bc0e62a83af9 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "DELETE /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 204 len: 0 microversion: 2.1 time: 0.280889 Aug 30 17:47:48.632026 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2281/4348] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:47:48 2022] DELETE /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:47:48.636222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.640894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:48.641121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.641601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.648473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.648961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.649396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.650105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.650556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.650976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.651765 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a510f7f-401f-44b3-9561-834166eaec46 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1811 microversion: 2.1 time: 0.355806 Aug 30 17:47:48.654030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2068/4349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1811 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:48.662914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.664029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.670412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.671468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.677594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.678935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.679620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.680236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.732092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.743941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.745657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.746879 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-faddcbd0-e87f-4de4-bc5d-a8dfcd2bd653 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.110974 Aug 30 17:47:48.748872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2282/4350] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:48.895616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:48.896476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:48.916717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.917216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.917661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.918380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:48.918839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:48.919275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:48.944956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:48.953989 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0b69c71b-1fde-47f3-b76e-a82a3e5e0e6f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1527 microversion: 2.1 time: 0.298254 Aug 30 17:47:48.969266 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2069/4351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:49.088205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.097211 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-64e2b94e-0641-40ad-a831-6f759d29d59e tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1506 microversion: 2.1 time: 0.206654 Aug 30 17:47:49.097797 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2283/4352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:48 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:49.120065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.120607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.122978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=18 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:49.129522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.130017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.130454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.131158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.131648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.132068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.166059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.167784 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fd74b348-cea3-478e-8a1e-f83f0c484b37 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/os-instance-actions/req-92dadbb7-ea97-4bca-b412-0bd35c577375" status: 200 len: 313 microversion: 2.1 time: 0.052820 Aug 30 17:47:49.176788 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2070/4353] 10.222.0.50 () {58 vars in 1419 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/os-instance-actions/req-92dadbb7-ea97-4bca-b412-0bd35c577375 => generated 313 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:49.182992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:49.190318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.199663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.200242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.200748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.201521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.202044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.202530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.307541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b32927a9-af4e-4424-9553-c23fcf40b1c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "POST /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/action" status: 202 len: 0 microversion: 2.1 time: 0.129109 Aug 30 17:47:49.311588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2284/4354] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:47:49 2022] POST /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:47:49.325567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.326451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.329725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.330628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.340456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.344684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.345368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.346930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.347728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.348564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.355516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.356966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.357724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.363095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.363848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.366768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.630756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.639318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c352481d-2d30-4d01-8095-f502171cf823 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.314757 Aug 30 17:47:49.640799 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2285/4355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:49.675743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.676607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.686843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.689029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.689608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.693015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.693755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.694292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.697878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.706520 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a67d64e-567e-4f32-be01-a0cd14716d96 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1508 microversion: 2.1 time: 0.393302 Aug 30 17:47:49.714261 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2071/4356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:49.777071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.777689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.793871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.794394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.794824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.795568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.796020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.797308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.903925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.911179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.917216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.922162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:49.923382 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-268cf8b0-8722-4191-abe1-7b332f8a79e5 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.154372 Aug 30 17:47:49.930925 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2072/4357] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:47:49.935367 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-63c51636-e943-47c4-99c2-e9eaf6f17ef6 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1811 microversion: 2.1 time: 0.264612 Aug 30 17:47:49.951692 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2286/4358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1811 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:49.977125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:49.977339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:49.987791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.989368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.989820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:49.990611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:49.990977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:49.991403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:50.661888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:50.663047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:50.669845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:50.670567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:50.671372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:50.672470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:50.673119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:50.673712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.249686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.259244 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f95bc2ab-d7d5-44fa-957d-effde72d1b29 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.601845 Aug 30 17:47:51.277796 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2287/4359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:50 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:51.286253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:51.286867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:51.303810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.307562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.308304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.309217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.314258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.314899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.508538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.519286 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad1f0c8a-6f55-42f7-af07-17d623a604ea tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1527 microversion: 2.1 time: 1.547456 Aug 30 17:47:51.531465 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2073/4360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:49 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1527 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:51.536319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:51.536930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:51.582374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.588052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.588692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.591249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.595006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.595719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.816963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.829491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.830951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.836436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70b4376c-3990-4a0e-aa22-d0cfcf730590 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.303765 Aug 30 17:47:51.837038 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2074/4361] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:51 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:51.847253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:51.847905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:51.863141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.866845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.868074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.869163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:51.869794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:51.871206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:51.974006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:51.982285 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9a029e4-90e2-402f-b8c1-8313624fe621 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1508 microversion: 2.1 time: 0.703329 Aug 30 17:47:51.987598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2288/4362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:51 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1508 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:52.290674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:52.291458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:52.312821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:52.318334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:52.318820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:52.319612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:52.320079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:52.320506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:52.718820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:52.732337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a4e85758-3d75-43d4-b39b-de9e1f02b14f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1811 microversion: 2.1 time: 0.893214 Aug 30 17:47:52.734596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2075/4363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:51 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1811 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:52.749156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:52.752421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:52.777612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:52.779076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:52.782972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:52.784968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:52.789083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:52.789731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:52.844983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:52.862783 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81dbf074-6a90-4140-9cca-c98000dd611d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.575933 Aug 30 17:47:52.870403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2289/4364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:52 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:47:52.881974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099dbd08-b3b7-440a-bc93-c6dedaf2c06e", "name": "network-vif-plugged", "status": "completed", "tag": "9c8db8ab-d118-436b-b20f-9db7ee8c3eea"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:52.924701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:52.925241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:52.925696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:52.980653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] Creating event network-vif-plugged:9c8db8ab-d118-436b-b20f-9db7ee8c3eea for instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e on n-h1-852771-11 Aug 30 17:47:53.007370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-99be6ab9-5947-496a-b629-423859184329 req-b7aedd4d-a590-4bf7-a83c-beb348f5530f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128969 Aug 30 17:47:53.011568 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2290/4365] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:53.026144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:53.027206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-deleted", "tag": "6b9d4e0a-ddac-4ea2-afdf-f244759ebdae"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:53.047264 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19ffa58f-f9ba-44ef-b405-7a6216e47036 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1485 microversion: 2.1 time: 0.306117 Aug 30 17:47:53.052608 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2076/4366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:52 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1485 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:53.058873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.060853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.062875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.064791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:53.065879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:53.088392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.089074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.090146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.092105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.094646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.095174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.096613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] Creating event network-vif-deleted:6b9d4e0a-ddac-4ea2-afdf-f244759ebdae for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:53.119910 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ed1d8d6a-914a-4fd6-ab77-fba3971df446 req-bc6a035c-aba4-4696-aefd-c0a282ff189a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104650 Aug 30 17:47:53.123920 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2291/4367] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:53.145168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:53.146203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:53.164543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.168300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.168983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.175353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.176767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.177615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.272969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:53.295746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:53.301657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:53.303256 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43e25584-a3d9-43c3-a76f-e8e382de6878 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.249221 Aug 30 17:47:53.312949 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2077/4368] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:53 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:53.468958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a0f051-6037-4d2c-92d7-539ae801c770", "name": "network-vif-deleted", "tag": "1f32f616-f185-435d-831f-3090555a479c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:53.511400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.511929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.512364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.527663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] Creating event network-vif-deleted:1f32f616-f185-435d-831f-3090555a479c for instance 09a0f051-6037-4d2c-92d7-539ae801c770 on n-h2-852771-11 Aug 30 17:47:53.541877 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b2c2b4f2-c7a0-457d-abe6-13030874fd98 req-a03cb721-770f-4316-abf4-64101c09c1d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077427 Aug 30 17:47:53.559639 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2078/4369] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:53.745547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:53.760649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:53.761352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:53.761676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73a44495-645d-447b-bb9c-415a5ebff986 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1506 microversion: 2.1 time: 0.628822 Aug 30 17:47:53.763682 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2292/4370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:53 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:53.771234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.771760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.772197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.772935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.773382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.773806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.786317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '.version_select at 0x7f2d93540670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:53.787841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:53.828157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.834726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.835739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.838461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.839088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.840701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.927408 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0514c68c-8b45-455a-8000-f6ef9139306f tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.146785 Aug 30 17:47:53.930928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2293/4371] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 30 17:47:53 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4/os-instance-actions => generated 611 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:53.942441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:53.943277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:53.955268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.955849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.956485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.957611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:53.958272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:53.959618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:53.979700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:53.993512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.013066 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9935df47-02d2-4b4d-9582-21fdf88a7d08 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1633 microversion: 2.1 time: 0.256769 Aug 30 17:47:54.016720 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2079/4372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:53 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1633 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:54.023085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:54.025166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:54.033135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.033789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.034278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.035405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.035897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.036322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.072891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:54.189268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ea1dc06d-66fc-474a-97f5-02dcb635df25 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 204 len: 0 microversion: 2.1 time: 0.170741 Aug 30 17:47:54.190750 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2080/4373] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:47:54 2022] DELETE /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:47:54.199245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:54.200968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:54.203220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.210323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.211178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.211944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.213112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.213756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.214339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4617a95-ec82-4ec3-b6cb-aea9c76c273e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.282010 Aug 30 17:47:54.214553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.215267 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2294/4374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:53 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:54.226496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:54.229662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:54.267763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.269855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.270496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.272336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.273235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.282590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.325385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.326374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.340327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.341257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lazy-loading 'fault' on Instance uuid 09a0f051-6037-4d2c-92d7-539ae801c770 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:54.446754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b967570a14b2ca709e76c0a7461b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae9f674d66648f6b1e80872a418f9c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.464097 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c903ba6e-e665-4356-92a1-d471fe2bd80f tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 200 len: 1315 microversion: 2.1 time: 0.271454 Aug 30 17:47:54.467162 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2081/4375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:54 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:54.478281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:54.480534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:54.502428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.504314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.505111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.506430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:54.508519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:54.509212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:54.637531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.653963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.656475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.658370 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d9112a43-ec07-4c3e-a997-d0cc82f0dfe6 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.189735 Aug 30 17:47:54.659629 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2082/4376] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:54 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:54.741214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:54.750368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0df464f3-c15a-4e9f-a847-20d83ce7d5c8 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1512 microversion: 2.1 time: 0.533186 Aug 30 17:47:54.751399 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2295/4377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:54 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:55.039856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:55.042105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:55.056366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.056998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.057417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.065356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.065839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.066291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.163861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-deleted", "tag": "63475ec6-8546-4e01-a468-a039a40fb55a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:55.183963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.188502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.191145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.218591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:55.228983 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3489712d-8dbe-4f43-b4df-7892aa569dc8 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1570 microversion: 2.1 time: 0.192494 Aug 30 17:47:55.231042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2083/4378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:55 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:55.238825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:55.239564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] Creating event network-vif-deleted:63475ec6-8546-4e01-a468-a039a40fb55a for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:55.240100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:55.246813 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4ac2ca17-7e90-43ec-83a3-0bf7ddc5626a req-ac2880db-8999-4231-98b9-0259efac60b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091290 Aug 30 17:47:55.247842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2296/4379] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:47:55.253924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.255349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.256275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.257927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.259075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.260029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.267828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:55.493276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:55.494522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] [instance: 09a0f051-6037-4d2c-92d7-539ae801c770] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:55.508202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.511901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:55.513806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.516435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.518942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.519974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.522790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21f0470f-dcfb-4f46-93b3-ec0a6634f326 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1293 microversion: 2.1 time: 0.290655 Aug 30 17:47:55.523987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2084/4380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:55 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1293 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:55.524743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.573048 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] HTTP exception thrown: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Request method failure captured: Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 HTTP/1.1 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0tyfete6YmP3axC-4eyXJSAd48VwNiJOk9uaw9w-9lYPvYuGXL1LJvjtwYPSHxuRK9Al-xh5-JKyeG9R6VGczpqGm3ScrTHCpbhpOOqhtL9NE03gGEsCNqno5P-Oymx9n7meaeeW5u1q9Z3gtqIuo_zADkf3nw5hQ1QvyN8uiBSoM Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ae9f674d66648f6b1e80872a418f9c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ae9f674d66648f6b1e80872a418f9c4"}]}] Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ae9f674d66648f6b1e80872a418f9c4 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1648394038 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 6f8b967570a14b2ca709e76c0a7461b3 Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1648394038-project Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '09a0f051-6037-4d2c-92d7-539ae801c770'} Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:55.588954 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] Returning 404 to user: Instance 09a0f051-6037-4d2c-92d7-539ae801c770 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-825ee6ad-81a0-462b-b795-74ec09da2ba2 tempest-InstanceActionsNegativeTestJSON-1648394038 tempest-InstanceActionsNegativeTestJSON-1648394038-project] 10.222.0.50 "GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770" status: 404 len: 111 microversion: 2.1 time: 0.098072 Aug 30 17:47:55.594917 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2297/4381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:55 2022] GET /compute/v2.1/servers/09a0f051-6037-4d2c-92d7-539ae801c770 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:47:55.683811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:55.684744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:55.691923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.696835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.697558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.698481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.699129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.700165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.772412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:55.773152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:55.781097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=20 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:55.793215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.796135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.796765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.800341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:55.800936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:55.801461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:55.963425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:55.976074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:55.983179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:55.985369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e29c9402-8eac-4843-8fae-c90f704ff993 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.305520 Aug 30 17:47:56.001486 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2085/4382] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:55 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:56.139411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:56.159180 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-70037531-6084-407d-90fa-99bfdae06e1d tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1512 microversion: 2.1 time: 0.390710 Aug 30 17:47:56.165112 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2298/4383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:55 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:56.256628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:56.257849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:56.270888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:56.271542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:56.271972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:56.272702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:56.273148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:56.274016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:56.390463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:47:56.412832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:56.414735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:56.415609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:56.421963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lazy-loading 'fault' on Instance uuid e1a1d641-4cb9-4dd6-8aec-43f03eede343 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:56.523154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:56.532078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6734d86e-83f1-4fe1-97f4-aa514eaeddcd tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 200 len: 1303 microversion: 2.1 time: 0.279299 Aug 30 17:47:56.532707 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2086/4384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:56 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:56.545504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:56.547935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:56.561714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:56.563179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:56.563861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:56.564919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:56.565711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:56.566434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:56.801990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:56.821915 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb6b4d6e-05a4-47ce-aa80-4eff361495c3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1473 microversion: 2.1 time: 0.280347 Aug 30 17:47:56.842232 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2299/4385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:56 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:56.994101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1784532480", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:57.025748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:57.026430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:57.039037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.039555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.040007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.043012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.043544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.044155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.094459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:47:57.179215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:57.205206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:57.207010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:57.213901 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06ab4c13-89b6-4c19-8a0a-617beca0128a tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.208054 Aug 30 17:47:57.215169 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2300/4386] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:57 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:57.224768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f58767a-9d9e-4b9f-b51c-60ceb4b683b4", "name": "network-vif-deleted", "tag": "9d2d7b06-bd6f-4d03-ae04-15c24c218010"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:57.250011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.250868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.252867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.276283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] Creating event network-vif-deleted:9d2d7b06-bd6f-4d03-ae04-15c24c218010 for instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 on n-h1-852771-11 Aug 30 17:47:57.283053 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ef5404c3-a491-4b82-9f66-1f1edf52567e req-bb9c414d-3706-4647-92bb-82506638b1d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066296 Aug 30 17:47:57.284503 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2301/4387] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:57.291182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:57.293882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:57.306386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.308933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.309636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.315695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.316474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.317363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.388446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.391089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.392426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.393150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lazy-loading 'fault' on Instance uuid 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:47:57.457085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef90d7b9c274a9095ffac59d031b31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df117d62dda2430d9b92e637eb6f4b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:57.469795 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8394b992-a6c8-4351-a388-9cedff51a317 tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 200 len: 1306 microversion: 2.1 time: 0.181997 Aug 30 17:47:57.471004 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2302/4388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:57 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 1306 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:47:57.556116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:57.556778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:57.565988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.567123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.567898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.568956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.569769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.570532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.598170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 HTTP/1.1 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e1a1d641-4cb9-4dd6-8aec-43f03eede343'} Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:57.601645 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:47:57.605723 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:57.614405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:57.616322 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e208504-8a7e-42fa-bf6b-0dc01d6f473e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 404 len: 111 microversion: 2.1 time: 0.063666 Aug 30 17:47:57.618256 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2303/4389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:57 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:47:57.904309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1d641-4cb9-4dd6-8aec-43f03eede343", "name": "network-vif-deleted", "tag": "b1f38d63-62c9-4759-bfa0-1573c5c08378"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:57.916217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:57.916695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:57.917444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:57.933823 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] Creating event network-vif-deleted:b1f38d63-62c9-4759-bfa0-1573c5c08378 for instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 on n-h2-852771-11 Aug 30 17:47:57.940754 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3f017dac-21df-40d7-b34a-cdda9db8f822 req-7722d3f8-bca8-4c13-ab63-8cb55b23b0ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041743 Aug 30 17:47:57.941525 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2304/4390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:47:58.219212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:47:58.219763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:47:58.220147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:47:58.220793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:47:58.221378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:47:58.242838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.243261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.243730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.244479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.244921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.245248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:58.246221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:58.248403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.258577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.259457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.260143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.261316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.262478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.272467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.309005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:47:58.345810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:47:58.420189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:47:58.431886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:47:58.543336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1c209f2f-03dc-4d38-9689-15f4186c58d2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554653 Aug 30 17:47:58.550478 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2087/4391] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:47:58.557183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:58.557969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] [instance: 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:58.567322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.568046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.568675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.569571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:58.570182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:58.570920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:58.641113 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] HTTP exception thrown: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Request method failure captured: Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 HTTP/1.1 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0rknik7a8h4TrLHTnQlVOlzKAeS0BpITBmb0-c1Worb3aVo5QZDtP02SVaAVo1l5tbzjOiWwzGHpp7Vi-EFQt3MS2sdxKRUOmmc5F4QeWGfrCExmo1n4v2--__I5mjE8bxOnB9dYDIIqZ88Qh4A3S8mmkJobPnQkNDyvINWw1eoYo Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: df117d62dda2430d9b92e637eb6f4b48 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-InstanceActionsTestJSON-2139353259 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df117d62dda2430d9b92e637eb6f4b48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df117d62dda2430d9b92e637eb6f4b48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/df117d62dda2430d9b92e637eb6f4b48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_df117d62dda2430d9b92e637eb6f4b48"}]}] Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-InstanceActionsTestJSON-2139353259 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: df117d62dda2430d9b92e637eb6f4b48 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2139353259 Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-InstanceActionsTestJSON-2139353259-project Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4ef90d7b9c274a9095ffac59d031b31e Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-InstanceActionsTestJSON-2139353259-project Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5f58767a-9d9e-4b9f-b51c-60ceb4b683b4'} Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:58.646488 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] Returning 404 to user: Instance 5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:58.652627 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-93642855-5fbb-4332-8177-e16c383e4cbd tempest-InstanceActionsTestJSON-2139353259 tempest-InstanceActionsTestJSON-2139353259-project] 10.222.0.50 "GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4" status: 404 len: 111 microversion: 2.1 time: 0.096011 Aug 30 17:47:58.666514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2088/4392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:58 2022] GET /compute/v2.1/servers/5f58767a-9d9e-4b9f-b51c-60ceb4b683b4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:47:58.669584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:58.680892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:58.694764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:47:58.696052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7575a7d-8329-4b0f-be3a-0a81f54606d1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.458649 Aug 30 17:47:58.696628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2305/4393] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:58 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:47:58.734701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9494a21-c797-48a2-8ac4-0c6fe20191ce tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:58.735376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9494a21-c797-48a2-8ac4-0c6fe20191ce tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:58.784276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9494a21-c797-48a2-8ac4-0c6fe20191ce tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:47:59.309635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9494a21-c797-48a2-8ac4-0c6fe20191ce tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493" status: 204 len: 0 microversion: 2.1 time: 0.632580 Aug 30 17:47:59.313442 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2089/4394] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:47:58 2022] DELETE /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:47:59.321865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:59.322486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:59.351649 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 HTTP/1.1 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '896259ae-e867-4062-9c5b-5e696556a493'} Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 896259ae-e867-4062-9c5b-5e696556a493 Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:59.365228 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:47:59.369285 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:47:59.375698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:47:59.376933 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f641a01-64da-4506-bcec-a6997287daab tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493" status: 404 len: 111 microversion: 2.1 time: 0.059295 Aug 30 17:47:59.379651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2306/4395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:47:59 2022] GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:47:59.490312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1139760964", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:47:59.670340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:47:59.725943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:47:59.726695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:47:59.745919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:59.749392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:59.750374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:47:59.752027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:47:59.753762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:47:59.754307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:00.122857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:00.134394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:00.137707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:00.143899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8518b489-8f3b-474c-9cd9-f351ed7c8e4e tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.421994 Aug 30 17:48:00.144883 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2307/4396] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:47:59 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:01.184050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:01.187212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:01.214186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:01.217473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:01.219789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:01.220836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:01.222993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:01.226440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:02.417533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:02.449987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:02.454960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:02.487839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-393d209d-5b17-48a4-bd1e-e21b9b9e4539 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 1.319859 Aug 30 17:48:02.493853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2308/4397] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:01 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:03.154891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:03.155649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:03.155931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:03.156382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:03.156833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:03.180951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:03.183699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:03.184539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:03.186235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:03.187845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:03.188301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:03.226239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:03.237501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:03.264896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:03.268838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:03.347993 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f9f8a5d-9bd8-49cf-951f-456eab915436 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.860916 Aug 30 17:48:03.349460 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2090/4398] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:48:03.360517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cd0f671f-e82d-4e7c-a160-7a0ae411efac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:03.361768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cd0f671f-e82d-4e7c-a160-7a0ae411efac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:03.523982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cd0f671f-e82d-4e7c-a160-7a0ae411efac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:03.524532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:03.524750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:03.533407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:03.533580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cd0f671f-e82d-4e7c-a160-7a0ae411efac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1221 microversion: 2.1 time: 0.177247 Aug 30 17:48:03.536129 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2309/4399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:03 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:03.539933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:03.540543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:03.541948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:03.544399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:03.545201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:03.834735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:03.849320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:03.855923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:03.859105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c1d3a5a3-ae2a-48b8-b223-579b8ad2a0b1 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.339189 Aug 30 17:48:03.884648 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2091/4400] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:03 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:04.558039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:04.558579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:04.568257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:04.568757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:04.578454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:04.579421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:04.585965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:04.586664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:04.847903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:04.858514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa9ed413-49bc-49e1-b744-eb0f297eb179 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1225 microversion: 2.1 time: 0.304369 Aug 30 17:48:04.859109 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2310/4401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:04 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1225 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:04.892316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:04.893061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:04.910372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:04.911633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:04.913790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:04.916649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:04.917322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:04.918374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:05.154030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:05.166103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:05.170489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:05.177462 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b95c71e-eea8-4dcb-b7f8-cbb889eae316 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.289722 Aug 30 17:48:05.181403 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2092/4402] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:04 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:05.883961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:05.884630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:05.898002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:05.898498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:05.898937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:05.899686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:05.900140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:05.900567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:06.215232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:06.215889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:06.231395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:06.233227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:06.236554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:06.237821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:06.239968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:06.240863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:06.282535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:06.292835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a0c1f73-60fc-46ee-847a-3030a8f1b108 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1291 microversion: 2.1 time: 0.412707 Aug 30 17:48:06.298660 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2311/4403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:05 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1291 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:06.480408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:06.494750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:06.500465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:06.505326 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c90dec2-45d4-48f7-b593-7bac8a5fb2cc tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.299969 Aug 30 17:48:06.506258 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2093/4404] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:06 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:07.321548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:07.327673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:07.370940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:07.384694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:07.385325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:07.398087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:07.401632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:07.402472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:07.535524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:07.537382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:07.550561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:07.554424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:07.555965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:07.558746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:07.559901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:07.563249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:07.760324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:07.780764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:07.783116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:07.786469 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89fd37c7-3c42-492e-af86-fb4d8dda5f87 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.256707 Aug 30 17:48:07.788916 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2094/4405] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:07 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:07.884451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:07.898669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d9ea255-2fb9-442c-a08f-285dfeaff455 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1279 microversion: 2.1 time: 0.586588 Aug 30 17:48:07.903493 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2312/4406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:07 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1279 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:08.449062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1275472859", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "52b8679c-614d-49a3-8076-8041a1141c27"}, {"uuid": "828e4831-badf-461f-a6c7-687d9637f45c"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:08.590406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] validate_networks() for [('52b8679c-614d-49a3-8076-8041a1141c27', None, None, None, None, None), ('828e4831-badf-461f-a6c7-687d9637f45c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:48:08.816894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:08.817862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:08.835053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:08.837872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:08.838356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:08.840702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:08.846784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:08.847664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:10.231947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:10.245716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:10.250248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:10.251397 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-926e0ded-d29f-4318-b33c-a03080eac859 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 1.439133 Aug 30 17:48:10.260825 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2313/4407] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:08 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:10.277533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:10.281161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:10.293064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:10.293976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:10.297084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:10.300182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:10.302041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:10.304795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:11.030548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:11.045742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35f74af3-e01a-4407-bccc-8ff20fd3fc3b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 0.774618 Aug 30 17:48:11.047686 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2314/4408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:10 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:11.263216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:11.263216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:11.263216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:11.263216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:11.263216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:11.284548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:11.288140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:11.290110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:11.291039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:11.291734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:11.298505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:11.299750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:11.302188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:11.302907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:11.309168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:11.310120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:11.311796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:11.335081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:11.335807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:11.425599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Getting quotas for project 13b32040f7264823b51522286868d313. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:11.453147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Getting quotas for user d463e623a89a4fab91673219aeaec3af and project 13b32040f7264823b51522286868d313. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:11.508476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:11.510660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:11.743393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9cd861be-6a78-4626-a620-140460637733 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.299550 Aug 30 17:48:11.752210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:11.754974 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2095/4409] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:48:11.769645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:11.771881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:11.778084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17e630bd-0d90-4137-a01e-efef6c4426a0 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.491939 Aug 30 17:48:11.786083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-046624f0-4b6a-440e-aae7-db9d7b1af311 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:11.789619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2315/4410] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:11 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:11.807848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-046624f0-4b6a-440e-aae7-db9d7b1af311 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:12.069321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:12.070561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:12.081527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:12.085227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-046624f0-4b6a-440e-aae7-db9d7b1af311 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:12.093910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:12.094700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:12.099006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:12.099531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:12.099987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:12.102011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-046624f0-4b6a-440e-aae7-db9d7b1af311 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1213 microversion: 2.1 time: 0.337206 Aug 30 17:48:12.104808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:12.108481 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2096/4411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:11 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1213 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:12.815783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:12.817735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:12.835711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:12.836502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:12.839772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:12.843142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:12.844110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:12.844893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:13.107273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:13.128409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:13.137937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:13.142086 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fb150913-1c87-4840-87fb-398796f44646 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1406 microversion: 2.54 time: 0.332322 Aug 30 17:48:13.157541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:13.162598 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2097/4412] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:12 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:13.173880 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-863b84d8-e7d4-4739-a517-ec8d23a8075d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 1.104420 Aug 30 17:48:13.177016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-326b28aa-7114-40c0-bb96-fb9ce6f9d788 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:13.177633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-326b28aa-7114-40c0-bb96-fb9ce6f9d788 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:13.194849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2316/4413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:12 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:48:13.483678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-326b28aa-7114-40c0-bb96-fb9ce6f9d788 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:13.493756 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-326b28aa-7114-40c0-bb96-fb9ce6f9d788 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1213 microversion: 2.1 time: 0.329990 Aug 30 17:48:13.494885 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2098/4414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:13 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1213 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:13.894980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7989980b-d124-4aea-a8ac-c2e0dec65057", "tag": "2017327c-53c7-4132-85f2-2920a8a4451c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:13.922195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:13.929112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:13.929868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:13.931051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.002839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] Creating event network-changed:2017327c-53c7-4132-85f2-2920a8a4451c for instance 7989980b-d124-4aea-a8ac-c2e0dec65057 on n-h2-852771-11 Aug 30 17:48:14.030779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e0502896-c966-40ed-bcfc-fe37aa5a6f5f req-01410eb8-d010-44d5-84c0-c06f9afb75d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139364 Aug 30 17:48:14.037635 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2317/4415] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:48:14.174394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:14.180529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:14.203969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:14.205472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:14.223785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.224439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.231690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.232193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.232633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.244505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.244873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.245995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.246650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.247352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.248026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.253828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.491136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:14.510925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:14.512784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:14.520521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b1478aa-cf1c-4ddd-b461-51b4ab497ee8 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1412 microversion: 2.54 time: 0.354620 Aug 30 17:48:14.522120 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2099/4416] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:14 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1412 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:14.533287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:14.537730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:14.569248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.570032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.570869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.572189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:14.572950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:14.574516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:14.698821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:14.747501 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50762c7b-e348-4a3f-95bc-412f93a407cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 0.550162 Aug 30 17:48:14.762778 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2318/4417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:14 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:14.821868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:14.858385 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3aa9c2d3-26d9-4740-8b40-187bfaa01cff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1273 microversion: 2.1 time: 0.333875 Aug 30 17:48:14.859208 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2100/4418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:14 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:15.549741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:15.550378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:15.564128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:15.568705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.570928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.572324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:15.577172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.578360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.581411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:15.739783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:15.758414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:15.765921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:15.767194 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0046946d-0c8e-4afc-9060-94dc09c18e4d tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1412 microversion: 2.54 time: 0.222761 Aug 30 17:48:15.782396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2319/4419] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:15 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1412 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:15.792122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:15.792738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:15.822350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.822954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.826443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:15.827497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.828070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.828783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:15.897349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:15.897977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:15.914499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.915000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.915455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:15.919911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:15.921123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:15.921642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:16.295036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:16.309458 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56cef20c-7f68-4e1f-861b-26e785efae63 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1271 microversion: 2.1 time: 0.415899 Aug 30 17:48:16.327988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2320/4420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:15 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1271 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:16.544620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:16.570819 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6660c7b-2dfd-4505-a1bd-8f0a9275e87b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 0.782529 Aug 30 17:48:16.573885 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2101/4421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:15 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:16.809993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:16.811314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:16.829398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:16.830785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:16.832899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:16.836919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:16.839533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:16.840157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:16.954920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fe00660-55d5-41a2-a20b-823bba7f35a3 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1342487716", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:16.961292 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1fe00660-55d5-41a2-a20b-823bba7f35a3 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] HTTP exception thrown: min_count must be <= max_count Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fe00660-55d5-41a2-a20b-823bba7f35a3 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Request method failure captured: Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 184 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1g3kq6CvUe-5sqiPKfA8aeaFOBp2S3AxF3EaQ4mrEsWrhFyg2p8X7tSW3FttcvKSB-BAdJf7PiodzpVXX9at1QvbXGG8xSDRhrd1KpklhIy12_bAwYE4E3ZS245fEzIQdKdrIPsi2HKSH9LKhgNBkE_3-MBpUI0E12AroaWBfSWg4 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b091541002245a78eaa43893bc0bb5f"}]}] Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efbc2f2f8fef4deb98adb3c0af58b78f Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1342487716", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: exception: min_count must be <= max_count Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1342487716', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 30 17:48:16.963171 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:16.968611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fe00660-55d5-41a2-a20b-823bba7f35a3 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Returning 400 to user: min_count must be <= max_count {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:16.969778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fe00660-55d5-41a2-a20b-823bba7f35a3 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.275111 Aug 30 17:48:16.971292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2321/4422] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:16 2022] POST /compute/v2.1/servers => generated 74 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 17:48:17.056785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5be1e41a-ddc6-4e5f-a68b-dcf83f1b2da8 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-648100706", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "max_count": 0}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5be1e41a-ddc6-4e5f-a68b-dcf83f1b2da8 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Request method failure captured: Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 167 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1g3kq6CvUe-5sqiPKfA8aeaFOBp2S3AxF3EaQ4mrEsWrhFyg2p8X7tSW3FttcvKSB-BAdJf7PiodzpVXX9at1QvbXGG8xSDRhrd1KpklhIy12_bAwYE4E3ZS245fEzIQdKdrIPsi2HKSH9LKhgNBkE_3-MBpUI0E12AroaWBfSWg4 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b091541002245a78eaa43893bc0bb5f"}]}] Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efbc2f2f8fef4deb98adb3c0af58b78f Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-648100706", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "max_count": 0}} Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-648100706', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'max_count': 0}}} Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 0 Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:48:17.063605 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.067919 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.071700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5be1e41a-ddc6-4e5f-a68b-dcf83f1b2da8 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:17.073324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5be1e41a-ddc6-4e5f-a68b-dcf83f1b2da8 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025503 Aug 30 17:48:17.074544 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2322/4423] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:17.166808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faa51746-312e-496a-936e-fb8b148fff9a tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-31708699", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "max_count": 2.5}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:17.167717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faa51746-312e-496a-936e-fb8b148fff9a tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Request method failure captured: Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 168 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1g3kq6CvUe-5sqiPKfA8aeaFOBp2S3AxF3EaQ4mrEsWrhFyg2p8X7tSW3FttcvKSB-BAdJf7PiodzpVXX9at1QvbXGG8xSDRhrd1KpklhIy12_bAwYE4E3ZS245fEzIQdKdrIPsi2HKSH9LKhgNBkE_3-MBpUI0E12AroaWBfSWg4 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b091541002245a78eaa43893bc0bb5f"}]}] Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efbc2f2f8fef4deb98adb3c0af58b78f Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-31708699", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "max_count": 2.5}} Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-31708699', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'max_count': 2.5}}} Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:48:17.174991 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.179420 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.184374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:17.185397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:17.186969 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d006502a-2409-444d-89d2-89b08851559c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1397 microversion: 2.54 time: 0.379807 Aug 30 17:48:17.190075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faa51746-312e-496a-936e-fb8b148fff9a tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:17.191446 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-faa51746-312e-496a-936e-fb8b148fff9a tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032178 Aug 30 17:48:17.193513 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2323/4424] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:17.201687 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2102/4425] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:16 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1397 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:17.240146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16004e3f-5f5a-433e-b6c8-f41def8bf166 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '.version_select at 0x7f2d9368c310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:17.323545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16004e3f-5f5a-433e-b6c8-f41def8bf166 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-94178303" status: 204 len: 0 microversion: 2.54 time: 0.090710 Aug 30 17:48:17.337712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:17.338952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:17.370313 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2324/4426] 10.222.0.50 () {60 vars in 1313 bytes} [Tue Aug 30 17:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-94178303 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:48:17.390250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.391212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.392008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.398876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.400764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.403746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.414600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fe69352-5b37-4665-9b88-d4d3374309c9 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1583931619", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 0}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fe69352-5b37-4665-9b88-d4d3374309c9 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Request method failure captured: Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 168 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1g3kq6CvUe-5sqiPKfA8aeaFOBp2S3AxF3EaQ4mrEsWrhFyg2p8X7tSW3FttcvKSB-BAdJf7PiodzpVXX9at1QvbXGG8xSDRhrd1KpklhIy12_bAwYE4E3ZS245fEzIQdKdrIPsi2HKSH9LKhgNBkE_3-MBpUI0E12AroaWBfSWg4 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b091541002245a78eaa43893bc0bb5f"}]}] Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efbc2f2f8fef4deb98adb3c0af58b78f Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1583931619", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 0}} Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1583931619', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'min_count': 0}}} Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 0 Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:48:17.439041 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.445527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fe69352-5b37-4665-9b88-d4d3374309c9 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:17.449174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fe69352-5b37-4665-9b88-d4d3374309c9 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.074179 Aug 30 17:48:17.449830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2325/4427] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:17.492428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:17.501599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:17.518615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.532118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.534829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.539226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.541275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.542497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.608069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:48:17.785797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97230572-8db5-4f8b-bacd-f16b66878aeb tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 204 len: 0 microversion: 2.54 time: 0.326142 Aug 30 17:48:17.789537 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2326/4428] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:48:17 2022] DELETE /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:48:17.794550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52d228dd-31f9-44c9-a1e4-246bfc692b21 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1701637106", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 2.5}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52d228dd-31f9-44c9-a1e4-246bfc692b21 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Request method failure captured: Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 170 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1g3kq6CvUe-5sqiPKfA8aeaFOBp2S3AxF3EaQ4mrEsWrhFyg2p8X7tSW3FttcvKSB-BAdJf7PiodzpVXX9at1QvbXGG8xSDRhrd1KpklhIy12_bAwYE4E3ZS245fEzIQdKdrIPsi2HKSH9LKhgNBkE_3-MBpUI0E12AroaWBfSWg4 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b091541002245a78eaa43893bc0bb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b091541002245a78eaa43893bc0bb5f"}]}] Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6b091541002245a78eaa43893bc0bb5f Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-802346782 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: efbc2f2f8fef4deb98adb3c0af58b78f Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-802346782-project Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1701637106", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 2.5}} Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1701637106', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'min_count': 2.5}}} Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:48:17.803651 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 17:48:17.811180 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:17.814463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52d228dd-31f9-44c9-a1e4-246bfc692b21 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:17.815679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52d228dd-31f9-44c9-a1e4-246bfc692b21 tempest-MultipleCreateNegativeTestJSON-802346782 tempest-MultipleCreateNegativeTestJSON-802346782-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027248 Aug 30 17:48:17.817752 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2327/4429] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:17.824800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:17.826779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:17.834780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.835557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.836210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.837129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:17.837743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:17.838377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:17.950658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:17.963941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c69ff97-0fba-401a-8337-75c72a8c872f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1313 microversion: 2.1 time: 0.633002 Aug 30 17:48:17.965064 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2103/4430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:17 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:17.970408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:17.983223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:18.002150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:18.013005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:18.013456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:18.014812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:18.015262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:18.015713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:18.383551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:18.399127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:18.410625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:18.428346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65e78e91-af99-4149-9bac-9099bc1258f7 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1403 microversion: 2.54 time: 0.456882 Aug 30 17:48:18.429326 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2104/4431] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:17 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1403 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:18.900005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:18.908913 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f6ffd51-e42d-45d1-b8bc-41e17fbf2c41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 1.089727 Aug 30 17:48:18.923338 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2328/4432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:17 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:18.991692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:18.992326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:19.012048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.012549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.012990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.013705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.014202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.014629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.462773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:19.464156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:19.470155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:19.486599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.488289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.488445 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2aa4c6b0-e23a-4390-98a6-e574403ed496 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1313 microversion: 2.1 time: 0.499110 Aug 30 17:48:19.490881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.494083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.496163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.498707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.503360 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2105/4433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:18 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:19.652748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:19.669816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:19.677501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:19.679352 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b3c29f6-2674-4abd-9a5f-e386e7b3adcf tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1403 microversion: 2.54 time: 0.222589 Aug 30 17:48:19.691906 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2329/4434] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:19 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:19.930512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:19.931390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:19.936779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:19.961328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.962178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.963302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.964223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:19.964836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:19.965618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:19.980307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:20.519252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:20.520067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:20.539431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:20.556207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:20.556667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:20.561927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:20.567785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:20.568452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:20.629130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:20.640043 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2df7884e-f5c9-438d-b2b3-762ea827be12 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 0.712435 Aug 30 17:48:20.644810 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2106/4435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:19 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:20.706915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:20.708004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:20.719813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:20.722151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:20.724237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:20.727460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:20.728243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:20.728956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:20.840507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:20.843389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:20.845355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:20.846471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lazy-loading 'fault' on Instance uuid 42bef681-209a-45e7-b02c-3b0c22d100dc {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:48:21.365260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:21.371306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:21.374613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:21.381185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:21.382695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb7d6104778450281583d56f7f19dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0179a3127af64f769f16133637bf620c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:21.388169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6c173b5c-b2f4-4ef5-898c-4c6ce27bf148 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.875613 Aug 30 17:48:21.389303 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2330/4436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:20 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:21.392827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-763e14c6-f5f7-4ff7-a42a-2dd8eac48f3c tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 200 len: 1408 microversion: 2.54 time: 0.690181 Aug 30 17:48:21.396130 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2107/4437] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:20 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 1408 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:48:21.666621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:21.669112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:21.691088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:21.693755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:21.694226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:21.694963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:21.695431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:21.695924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.413878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:22.414478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:22.434113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:22.444359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:22.444843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:22.445273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.445972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:22.447563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42f2d379-2ebc-4ddb-af91-bc088a0d3acd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 0.785841 Aug 30 17:48:22.481865 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2331/4438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:21 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:22.490988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:22.491551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.518041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:22.518680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] [instance: 42bef681-209a-45e7-b02c-3b0c22d100dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:22.536363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:22.538770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:22.547404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.548738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:22.549402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:22.550088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.671541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] HTTP exception thrown: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Request method failure captured: Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc HTTP/1.1 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk04uCS1JMAHGFjkiU-H3-AV3CU6TJUyDrd9GCoFzfuSJqgt6CfzCiMR5JQRCLUGGsA2kc9dNsWC08Auu1bTOy5y0J4TSwCLWkoy3mmCLb0WP6gEkjojQgVLyUYMlZ3nNLPoRDcZChPsCtjaSD2ukD4EtzDdnpW5xoDBoNfo2vK1O4I Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.54 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 0179a3127af64f769f16133637bf620c Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerShowV254Test-575518066 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0179a3127af64f769f16133637bf620c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0179a3127af64f769f16133637bf620c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0179a3127af64f769f16133637bf620c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0179a3127af64f769f16133637bf620c"}]}] Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerShowV254Test-575518066 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 0179a3127af64f769f16133637bf620c Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerShowV254Test-575518066 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerShowV254Test-575518066-project Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8fb7d6104778450281583d56f7f19dd5 Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerShowV254Test-575518066-project Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '42bef681-209a-45e7-b02c-3b0c22d100dc'} Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:22.675865 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. Aug 30 17:48:22.682135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:48:22.688129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] Returning 404 to user: Instance 42bef681-209a-45e7-b02c-3b0c22d100dc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:22.692576 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f97a505-587d-4fb1-96fd-b95f7bb59059 tempest-ServerShowV254Test-575518066 tempest-ServerShowV254Test-575518066-project] 10.222.0.50 "GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc" status: 404 len: 111 microversion: 2.54 time: 0.208816 Aug 30 17:48:22.693290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2332/4439] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:22 2022] GET /compute/v2.1/servers/42bef681-209a-45e7-b02c-3b0c22d100dc => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:22.707937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "tag": "e317613e-8378-4a44-a6ae-715890b1420a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:22.742393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:22.743414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:22.745473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:22.787050 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] Creating event network-changed:e317613e-8378-4a44-a6ae-715890b1420a for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:48:22.809030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c5cc47c3-80f5-4644-83de-3c671a3c3ea3 req-5b8bba36-61b9-40f0-a806-1503106aa7b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114358 Aug 30 17:48:22.817233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2333/4440] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:23.488644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=24 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:23.933223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2029144991", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": "none"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:24.014308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:24.027960 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ae1c6d8-2f59-46c3-a350-cd95033f5c74 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 1.613933 Aug 30 17:48:24.030240 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2108/4441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:22 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:24.044442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7989980b-d124-4aea-a8ac-c2e0dec65057", "name": "network-vif-plugged", "status": "completed", "tag": "2017327c-53c7-4132-85f2-2920a8a4451c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:24.079234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:24.079710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:24.080280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:24.080698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:24.081316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:24.096958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:24.097933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:24.102198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:24.140170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:24.141291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:24.142136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:24.143375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:24.144175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:24.144632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:24.168010 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] Creating event network-vif-plugged:2017327c-53c7-4132-85f2-2920a8a4451c for instance 7989980b-d124-4aea-a8ac-c2e0dec65057 on n-h2-852771-11 Aug 30 17:48:24.193388 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ced79934-5256-402c-ad6a-d11fa5332db3 req-3aa84d34-118d-4bc1-88e0-51a6cce451a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156651 Aug 30 17:48:24.195960 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2109/4442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:24.211098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:24.212448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:24.240516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Getting quotas for project 19ef85204a4245458eb83b92b69c0a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:24.254684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:24.258664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:24.260731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:24.262318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:24.264695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:24.265891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:24.266758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Getting quotas for user 8bbbf4e8fd1043e29fe6a55c221927e7 and project 19ef85204a4245458eb83b92b69c0a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:24.351949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:24.368536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:24.530993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4059b928-66c2-4598-af17-53fa38ced0ad tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.433466 Aug 30 17:48:24.532728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2334/4443] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 17:48:24.549236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:24.551084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:25.061842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:25.074487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:25.078615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:25.081130 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05001fa4-6c0d-496b-90f5-8604c02e932d tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1281 microversion: 2.47 time: 0.541502 Aug 30 17:48:25.095553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2335/4444] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:24 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1281 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:25.095553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:25.098169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:25.110124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:25.110633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:25.115795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:25.116625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:25.117115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:25.117566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:25.625439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:25.643346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-22dcdf96-eac6-4410-bd0a-59883a829ad9 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.558237 Aug 30 17:48:25.647792 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2336/4445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:25 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:25.854379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:25.869619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dcbb7621-0766-4633-acdd-ca20cb13872e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1321 microversion: 2.1 time: 1.669501 Aug 30 17:48:25.890401 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2110/4446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:24 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1321 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:26.118916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:26.119579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:26.138861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.141836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.142874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:26.143887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.145183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.145871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:26.563391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:26.575810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:26.579687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:26.590309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8c792aa-b302-445c-8813-cf9f7a443276 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1333 microversion: 2.47 time: 0.483643 Aug 30 17:48:26.604054 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2337/4447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:26 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1333 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:26.674706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:26.676867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:26.724986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.725769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.741877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:26.744509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.746896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.755576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:26.898403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:26.898966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:26.930829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.931600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.932522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:26.933735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:26.934206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:26.935032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:27.609284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:27.618774 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e4e8fce-05e7-40bd-87f4-800757701f4f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1501 microversion: 2.1 time: 0.727638 Aug 30 17:48:27.651460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2338/4448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:26 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1501 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:27.684127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:27.686768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:27.711562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:27.712475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:27.713089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:27.715991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:27.719171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:27.719886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:27.940896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:27.959170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06e6a424-a3e9-4104-b01e-8f9b143a20e1 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 1.289785 Aug 30 17:48:27.971018 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2111/4449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:26 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:27.985294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:27.986994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:28.005021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.005937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.007755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.008549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.012955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.014050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.218238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:28.242634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:28.249633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:28.250874 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cdf9f5b1-0ae9-49fe-aeb5-f4521081e875 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1339 microversion: 2.47 time: 0.598208 Aug 30 17:48:28.258436 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2339/4450] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:27 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1339 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:28.458359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "tag": "12e2793c-4e30-447c-b5cd-6abfcab9ed7c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:28.460338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:28.470750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbeacca0-22b8-4604-a5d7-71f657d4721f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1501 microversion: 2.1 time: 0.498514 Aug 30 17:48:28.480384 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2112/4451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:27 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:28.483940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.485032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.485611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.502161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:28.502915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:28.517623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.518866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.520785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.522815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.523886 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] Creating event network-changed:12e2793c-4e30-447c-b5cd-6abfcab9ed7c for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:48:28.524159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.525252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.530577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-939cce8c-aa7f-4b20-9a1c-eeda1ffd22df req-7065cdd8-7bff-4d52-87e7-f9675c48bc22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076604 Aug 30 17:48:28.531719 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2340/4452] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:48:28.583975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:48:28.818992 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6043fafd-fa08-469c-9d76-68c02cadc157 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 204 len: 0 microversion: 2.1 time: 0.323773 Aug 30 17:48:28.822214 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2113/4453] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:48:28 2022] DELETE /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:48:28.836217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:28.837590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:28.862793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.863695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.866000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.869998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:28.870779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:28.872296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:28.955573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:28.987981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:28.996056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:29.009668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:29.014187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:29.017062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:29.018114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:29.018745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:29.023573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:29.690162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:29.700077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-728fee62-2526-4db1-bc6a-bbe362c45828 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1507 microversion: 2.1 time: 0.872571 Aug 30 17:48:29.706565 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2341/4454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:28 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1507 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:29.724587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:29.727309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:29.740080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:29.749279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:29.755456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:29.755724 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c2438a8-0086-4f71-a269-f1aa197cccc5 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.773969 Aug 30 17:48:29.756229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:29.759701 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2114/4455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:28 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:29.761424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:29.764291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:29.764772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:29.983009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:29.999890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:30.006872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:30.008174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da3ae7bb-3c95-4382-a8cc-968b82203275 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1339 microversion: 2.47 time: 0.300295 Aug 30 17:48:30.023868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2342/4456] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:29 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:30.722913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:30.723860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:30.739377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:30.740782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:30.742657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:30.745370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:30.750160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:30.751731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:30.932572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1932313554", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "98f2de37-0a0d-474f-b5bc-bccdc5de9eac"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:31.077240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] validate_networks() for [('98f2de37-0a0d-474f-b5bc-bccdc5de9eac', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:48:31.640297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:31.654223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83904c49-f7c0-40ec-89bf-85a8cd7369c6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1507 microversion: 2.1 time: 0.936142 Aug 30 17:48:31.671522 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2343/4457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:30 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1507 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:31.671522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:31.671522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:31.705480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:31.706342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:31.706954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:31.709541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:31.710255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:31.711116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.420586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:32.421568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:32.422239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:32.422815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:32.423391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:32.437024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:32.447274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7f2aee4-11b1-4bfd-9314-e93be6c28c1c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.787265 Aug 30 17:48:32.447786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.452176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.453537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.453856 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2344/4458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:31 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:32.455145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.455810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.457148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.473494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:32.492349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:32.501172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.502108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.502794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.504791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.505486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.506167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.512085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Getting quotas for project 13ffe9c2af074cbf9bd155965e0e25fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:32.528304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Getting quotas for user d802a95a947c44c38772ebf0deb363ac and project 13ffe9c2af074cbf9bd155965e0e25fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:32.557782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Going to run 3 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:32.561033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:32.643807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=3f890a6b-1ad8-4ac2-828e-72f3f002fdc2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:32.734506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=ae86a761-09da-422b-a0d4-a0e85576cfc0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:32.813265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:32.826011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:32.832486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:32.834561 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed1f6296-e018-4fea-b191-ef4fd4c50e51 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1360 microversion: 2.47 time: 0.365032 Aug 30 17:48:32.839488 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2345/4459] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:32 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1360 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:32.849003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:32.852381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:32.887622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.910647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.914482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.916230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:32.920883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:32.923005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:32.923760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f52c875d-510d-4826-9b46-bf8b5488b319 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501322 Aug 30 17:48:32.927128 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2115/4460] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:48:32.957945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-397108755"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:32.965306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:33.008210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.020732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.028633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.030651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.031358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.034550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.398519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:33.437339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93e2bc97-57ab-409f-9554-84f58a8ecb7c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1465 microversion: 2.1 time: 0.595508 Aug 30 17:48:33.443412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2346/4461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:32 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1465 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:33.477868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:33.537007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:33.539372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:48:33.660229 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f36a649-fd00-4361-a273-8c8b7003c5d6 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "POST /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403/action" status: 202 len: 52 microversion: 2.47 time: 0.726722 Aug 30 17:48:33.664230 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2116/4462] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:48:32 2022] POST /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403/action => generated 52 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:48:33.686883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:33.693120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:33.705533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.710509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.712508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.714294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.717479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.717955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.720209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.725250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.725738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.726544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.734445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.734912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.809875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e5397e3-f834-4812-8fe3-a1352426318a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.362139 Aug 30 17:48:33.812102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2347/4463] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:48:33 2022] GET /compute/v2.1/servers => generated 1018 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:33.846105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7989980b-d124-4aea-a8ac-c2e0dec65057", "name": "network-vif-deleted", "tag": "2017327c-53c7-4132-85f2-2920a8a4451c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:33.913974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:33.916150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:33.916846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:33.961671 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] Creating event network-vif-deleted:2017327c-53c7-4132-85f2-2920a8a4451c for instance 7989980b-d124-4aea-a8ac-c2e0dec65057 on n-h2-852771-11 Aug 30 17:48:33.972633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ca0dd995-e03d-4afe-ba31-309aec769b14 req-6ad58cc7-b191-4d50-851f-1e320be86d4d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151222 Aug 30 17:48:33.978229 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2348/4464] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:33.993636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:33.994832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:34.020149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.034635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.035120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.040346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.041538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.044104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.182703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:48:34.460170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6c5e800-01d5-4f39-82f2-13b9cb13e1b2 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 204 len: 0 microversion: 2.47 time: 0.476639 Aug 30 17:48:34.461861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2349/4465] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:48:33 2022] DELETE /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:48:34.478152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e6ce7eb9-0848-44ad-bbfc-5dff484728dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:34.479366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:34.480524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e6ce7eb9-0848-44ad-bbfc-5dff484728dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:34.491814 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9423f86e-ebfb-4634-8bd7-5384a2cbdc6f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.817630 Aug 30 17:48:34.506290 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2117/4466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:33 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:34.512964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:34.515735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:34.523605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.524308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.525038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.526097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.526704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.527284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.640859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.644063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.644710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.645343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lazy-loading 'fault' on Instance uuid 7989980b-d124-4aea-a8ac-c2e0dec65057 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:48:34.805129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:34.820644 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c69483e-2bd6-41c3-b173-d41d6ef5f0c7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 200 len: 1311 microversion: 2.1 time: 0.312147 Aug 30 17:48:34.826967 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2118/4467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:34 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:34.833376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:34.834252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:34.852681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.853427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.866933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.868689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:34.870914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:34.874165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:34.994851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e6ce7eb9-0848-44ad-bbfc-5dff484728dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:35.009187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e6ce7eb9-0848-44ad-bbfc-5dff484728dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1223 microversion: 2.1 time: 0.545410 Aug 30 17:48:35.014746 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2350/4468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:34 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1223 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:35.137899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:35.155330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:35.164343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:35.167530 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1eede165-aac4-4413-aaf1-24862401c883 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1366 microversion: 2.47 time: 0.339198 Aug 30 17:48:35.181840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2119/4469] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:34 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:35.517045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:35.517679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:35.527786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:35.528290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:35.528783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:35.529528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:35.529984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:35.530421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:35.849639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:35.850962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:35.888155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:35.891070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:35.893208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:35.894454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:35.895262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:35.897426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:35.960255 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 HTTP/1.1 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '7989980b-d124-4aea-a8ac-c2e0dec65057'} Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:35.961964 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:48:35.967537 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:35.969925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:35.971011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d152755-80d1-414a-8ad4-c309b68ffb07 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 404 len: 111 microversion: 2.1 time: 0.127651 Aug 30 17:48:35.974322 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2120/4470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:35 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:48:36.000836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c22dd14-7702-47a7-8e6c-a00916c31ddc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: .version_select at 0x7f2d936d73a0>, body: {"keypair": {"name": "tempest-key-569084014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpaUV/8An1u5B68PZBRvYz55sCND9TYYWsN7eOH1m0AYZxKXSj4OXYKybEDKNVazccPZxbw7eWT9Cjs4zGrEuNY9ddxGppD5BdPAdNrE4JFAeeSjwn7pR0LgGfQT6Fezw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:36.062249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5c22dd14-7702-47a7-8e6c-a00916c31ddc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:36.085305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5c22dd14-7702-47a7-8e6c-a00916c31ddc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:36.229029 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c22dd14-7702-47a7-8e6c-a00916c31ddc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.244501 Aug 30 17:48:36.238687 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2121/4471] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:48:35 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:48:36.262779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:36.314721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:36.339706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:36.348303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:36.352340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:36.355749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:36.359426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:36.360016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:36.377650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:36.702399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:36.702584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:36.715828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b75ee337-35fd-4686-8fe8-2b19581d3fe0 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 1.202600 Aug 30 17:48:36.717905 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-81d10abd-089a-4a0e-b098-3ce20f9f125f tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1275 microversion: 2.1 time: 0.476004 Aug 30 17:48:36.719846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2122/4472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:36 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1275 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:36.722910 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2351/4473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:35 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:36.735592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:36.737809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:36.753019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6dc7aed0-3912-4bbf-91df-01bd199d8b63 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '.version_select at 0x7f2d9363d700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:36.754417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:36.754926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:36.769244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:36.772832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:36.773355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:36.778557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:36.784216 n-d-852771-11 devstack@n-api.service[122124]: WARNING oslo_db.sqlalchemy.utils [None req-6dc7aed0-3912-4bbf-91df-01bd199d8b63 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 17:48:36.806515 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6dc7aed0-3912-4bbf-91df-01bd199d8b63 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.081875 Aug 30 17:48:36.815308 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2352/4474] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:48:36 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:37.195383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1513397379", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-key-569084014", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:37.285478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:37.299970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:37.313403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bbbf4e8fd1043e29fe6a55c221927e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ef85204a4245458eb83b92b69c0a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:37.316725 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9dd8f8e4-0b4d-4674-adfa-6346a6353f93 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 200 len: 1366 microversion: 2.47 time: 0.594246 Aug 30 17:48:37.321503 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2123/4475] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:36 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:48:37.339392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:48:37.739329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:37.740056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:37.763073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:37.767104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:37.767666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:37.768428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:37.768900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:37.772629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:37.990125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:38.003998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a60d314-f31e-4f14-8237-6eb253c953aa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1283 microversion: 2.1 time: 0.266268 Aug 30 17:48:38.005011 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2124/4476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:37 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:38.017608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-824595583", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:38.130545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] validate_networks() for None {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:48:39.040583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:39.041733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:39.042376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:39.042953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:39.043564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:39.079129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.079689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.080957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.081356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.082699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.083839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.109375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Getting quotas for project a9eb9a3be3ca4f148b527b01cd17f4b7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:39.116500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Getting quotas for user eb9986f6d72a4df08e6827293684ca33 and project a9eb9a3be3ca4f148b527b01cd17f4b7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:39.138695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:39.143196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:39.261566 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-567e7fb1-62b9-4a49-9918-2e9bc3a4df16 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254339 Aug 30 17:48:39.277642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2125/4477] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:48:39.288356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:39.289292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:39.298646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.299369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.300011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.301642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.302284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.302871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.741146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:39.777162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a993363-84a4-493f-901f-5d17511d010c tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.498053 Aug 30 17:48:39.780262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2126/4478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:39 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:39.791429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:39.793246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] [instance: 5d8f4898-7f24-49ef-acd8-1ddcfdb85403] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:39.807903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.808400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.808831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.831153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.831520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.831971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.873794 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] HTTP exception thrown: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Request method failure captured: Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 HTTP/1.1 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1mnhVbcNMbvLfvXOp7iYxClEPDWVH1k1MP1Mydq163rND717mLpJPHmkFvGe45LdN3rBjD44K141WAucYwm2iPoeYm9tTMK_2VG5fNihzE_a4zSf4-TCQe9wBuDyPztTh7-fJxHSt4wNbNyUK4M-6v2CVtka0xbG0-eqKI1XoE6ZA Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 19ef85204a4245458eb83b92b69c0a33 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAaction247Test-18046565 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19ef85204a4245458eb83b92b69c0a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19ef85204a4245458eb83b92b69c0a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19ef85204a4245458eb83b92b69c0a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19ef85204a4245458eb83b92b69c0a33"}]}] Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAaction247Test-18046565 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 19ef85204a4245458eb83b92b69c0a33 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAaction247Test-18046565 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAaction247Test-18046565-project Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8bbbf4e8fd1043e29fe6a55c221927e7 Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAaction247Test-18046565-project Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5d8f4898-7f24-49ef-acd8-1ddcfdb85403'} Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:48:39.876210 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. Aug 30 17:48:39.881168 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:48:39.885847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] Returning 404 to user: Instance 5d8f4898-7f24-49ef-acd8-1ddcfdb85403 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:48:39.886932 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-13cf872b-fb61-4bd8-a06f-b8a884223442 tempest-ServersAaction247Test-18046565 tempest-ServersAaction247Test-18046565-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403" status: 404 len: 111 microversion: 2.47 time: 0.104950 Aug 30 17:48:39.893268 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2127/4479] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:48:39 2022] GET /compute/v2.1/servers/5d8f4898-7f24-49ef-acd8-1ddcfdb85403 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:48:39.898154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:39.908434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:39.925529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=13 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:39.932123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.932856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.933472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:39.935957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:39.936606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:39.946545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:40.443290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:48:40.443892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:48:40.444210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:48:40.444626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:48:40.445045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:48:40.481284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:40.482820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:40.483191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:40.485382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:40.486125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:40.486567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:40.577865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:40.602447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:40.612875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:40.659106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:48:40.661542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:48:40.837429 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-acec39f3-b15a-47da-97eb-280fe4a9966b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.642430 Aug 30 17:48:40.842737 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2353/4480] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:48:40.854173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:40.861156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:40.896419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:40.900232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:40.900909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:40.911688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:40.915308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:40.916780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:40.996443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:41.007992 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-852c07a9-b89c-4f9d-9b96-661e6d15cc1e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1281 microversion: 2.1 time: 1.113703 Aug 30 17:48:41.022368 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2128/4481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:39 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1281 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:41.043868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:41.044718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:41.068635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:41.069342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:41.069862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:41.070579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:41.071028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:41.071451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:41.366966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:41.383697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e969e099-9efd-4cc6-ba26-7db50e6244a5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1266 microversion: 2.1 time: 0.536412 Aug 30 17:48:41.385540 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2354/4482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:40 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1266 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:41.436953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0f99faab-ec93-4166-8113-7b1bf0f0d142 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:41.437746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0f99faab-ec93-4166-8113-7b1bf0f0d142 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:41.689244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f99faab-ec93-4166-8113-7b1bf0f0d142 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:41.701750 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0f99faab-ec93-4166-8113-7b1bf0f0d142 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1228 microversion: 2.1 time: 0.307639 Aug 30 17:48:41.702998 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2355/4483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:41 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1228 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:41.719800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "name": "network-vif-plugged", "status": "completed", "tag": "12e2793c-4e30-447c-b5cd-6abfcab9ed7c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:41.755445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:41.756506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:41.758639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:41.793854 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] Creating event network-vif-plugged:12e2793c-4e30-447c-b5cd-6abfcab9ed7c for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:48:41.823099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bd335181-0097-4b0c-8648-79c2a7172168 req-f06e3f90-bd51-4316-bd6d-b35d5d59c947 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101133 Aug 30 17:48:41.832242 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2356/4484] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:42.043851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:42.045125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:42.064893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:42.084447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:42.084843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:42.085610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:42.092520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:42.096832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:42.690387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:42.712215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35379756-bab4-49a9-a501-7053cf6ad70b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1281 microversion: 2.1 time: 0.674994 Aug 30 17:48:42.712819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2357/4485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:42 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1281 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:42.748917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:42.749574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:42.768231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:42.768744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:42.769171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:42.774286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:42.779660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:42.795655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:42.955861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:42.964337 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-495f7cf7-b252-4993-95ec-846bb47bd382 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1272 microversion: 2.1 time: 0.228801 Aug 30 17:48:42.981274 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2358/4486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:42 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:42.987340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:42.994747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:43.013997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:43.014888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:43.015640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:43.017116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:43.017753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:43.019765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:43.172735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:43.182604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-890feff1-a501-4198-8d22-325ad215a628 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 2.158874 Aug 30 17:48:43.188050 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2129/4487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:41 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:43.373686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:43.415657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-473b76ec-8eb1-4f4f-b011-62bed0fbedfc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1280 microversion: 2.1 time: 0.432308 Aug 30 17:48:43.420490 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2359/4488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:42 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1280 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:43.738790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:43.739725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:43.752852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:43.753335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:43.753768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:43.754474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:43.754917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:43.755333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.002651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "name": "network-vif-plugged", "status": "completed", "tag": "e317613e-8378-4a44-a6ae-715890b1420a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:44.063909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.067348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.069711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.149652 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] Creating event network-vif-plugged:e317613e-8378-4a44-a6ae-715890b1420a for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:48:44.172934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a97b70e9-0b61-4ba7-a48e-e2777ce54452 req-852bc440-d1ee-4096-b995-d2754a279920 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186070 Aug 30 17:48:44.175254 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2360/4489] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:44.205835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:44.207063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:44.230571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.232004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.244747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.245814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.250081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.252236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.606658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:44.618688 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e361165-abb5-4723-8990-48cb72b39db5 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.884162 Aug 30 17:48:44.636438 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2130/4490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:43 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:44.643012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:44.648445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:44.671178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.672694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.675042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.675982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.677815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.678520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.697117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:44.708061 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-677a3521-37b3-4b4a-8ac6-e7050633cfc1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1272 microversion: 2.1 time: 0.521122 Aug 30 17:48:44.712591 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2361/4491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:44 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:44.731554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:44.733955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:44.746752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.755162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.761134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:44.762566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:44.774857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:44.779304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:45.247887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:45.254729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:45.257858 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45d4ccd3-44ee-4c7c-a3b6-27853109476c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1286 microversion: 2.1 time: 0.541750 Aug 30 17:48:45.264171 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2362/4492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:44 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1286 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:45.313718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:45.333172 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3bf1a65c-192b-4c71-88db-726e41a76658 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.695397 Aug 30 17:48:45.354916 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2131/4493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:44 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:45.644205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:45.644921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:45.659265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:45.659858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:45.662457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:45.663291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:45.663871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:45.668432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:45.753875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:45.755884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:45.770181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:45.774395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:45.776008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:45.777508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:45.779054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:45.782127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:46.032344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:46.050370 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96df0a83-6a85-4d79-807e-1263426550b1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1272 microversion: 2.1 time: 0.315840 Aug 30 17:48:46.051901 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2132/4494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:45 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:46.296505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:46.308416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:46.323552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:46.339176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d806f8e-90c4-4793-9221-9d51243717dc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.700055 Aug 30 17:48:46.347848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:46.349537 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2363/4495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:45 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:46.349827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:46.350347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:46.355752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:46.359176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:46.359816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:46.360321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:46.361269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:46.385237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:46.386023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:46.388738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:46.394194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:46.395333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:46.395959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:46.800640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:46.830227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1c7054a-a129-447a-b84f-15fcce2ff1d7 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1334 microversion: 2.1 time: 0.478666 Aug 30 17:48:46.831638 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2364/4496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:46 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1334 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:46.853211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:46.895731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b10e685c-1a3f-444f-932f-f3b8db5e2fec tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1286 microversion: 2.1 time: 0.598598 Aug 30 17:48:46.898094 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2133/4497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:46 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1286 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:47.073079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:47.073768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:47.089460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.095765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.096375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:47.102336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.103233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.103827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:47.286759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:47.300071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81dcceb0-fe84-4012-84ea-7a3072d9d2c6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1272 microversion: 2.1 time: 0.231365 Aug 30 17:48:47.318545 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2365/4498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:47 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:47.375849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:47.377706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:47.395378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.397434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.399034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:47.400083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.401985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.402662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:47.869586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:47.870219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:47.906955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.927645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.928701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:47.930072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:47.931014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:47.932141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:48.163770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:48.175047 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1b4086f-832c-4e66-aa6a-199bda0150e4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.809941 Aug 30 17:48:48.192902 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2134/4499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:47 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:48.198261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:48.199096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:48.227984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:48.228484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:48.228923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:48.229671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:48.230123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:48.230548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:48.459676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:48.472578 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4740a957-ddc2-410e-8e07-164be6985e23 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1668 microversion: 2.1 time: 0.622337 Aug 30 17:48:48.480722 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2366/4500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:47 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:48.497766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:48.503057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:48.517483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:48.518029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:48.520148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:48.521641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:48.522309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:48.524678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.098949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:49.128763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:49.729003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:49.738144 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe95f819-74d1-4b07-8293-e4dd929f532b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 1.543806 Aug 30 17:48:49.738737 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2135/4501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:48 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:49.757243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:49.757741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:49.762129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:49.764571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.765238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.766320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.767226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.767902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.768493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.777245 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-525a8f81-dd3a-44e1-8f24-6a50f6010ae6 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 1.286775 Aug 30 17:48:49.783932 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2367/4502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:48 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:49.805190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae86a761-09da-422b-a0d4-a0e85576cfc0", "tag": "14d8ac96-9a71-4918-b539-a0248c05da3c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:49.842796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.843624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.848506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.905100 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] Creating event network-changed:14d8ac96-9a71-4918-b539-a0248c05da3c for instance ae86a761-09da-422b-a0d4-a0e85576cfc0 on n-h1-852771-11 Aug 30 17:48:49.906613 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f48ae5c-23b9-4f05-9f72-4ca2de4f0274 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02/ips" status: 200 len: 178 microversion: 2.1 time: 0.148267 Aug 30 17:48:49.910693 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2136/4503] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:48:49 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02/ips => generated 178 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:49.922804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:49.923350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ecb110b8-9cef-417a-8739-bfaf9fdfc309 req-8394f0ab-3972-4e2b-8f33-f95c545c0873 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135680 Aug 30 17:48:49.927323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:49.932963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2368/4504] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:49.949801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:49.953986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:49.958028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.966497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.970713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.971833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.977454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.978536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.979899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.980618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.981167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:49.982208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:49.984605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:49.989034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:50.109532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:48:50.437742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04906dbf-68df-47ea-8ae3-9079294b7abb tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "DELETE /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 204 len: 0 microversion: 2.1 time: 0.502815 Aug 30 17:48:50.441916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2369/4505] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:48:49 2022] DELETE /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:48:50.455170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:50.457817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:50.472712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:50.473285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:50.473730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:50.475089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:50.475577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:50.478080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:50.574890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:50.698172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:50.707421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adbe412e-ea4a-4b9d-ae13-9ef7599e58e7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.795352 Aug 30 17:48:50.720298 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2137/4506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:49 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:50.759987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:50.761350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:50.773425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:50.774115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:50.774890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:50.775829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:50.776872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:50.777930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:51.501078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:51.521617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72bc8b3c-0842-40f5-9a9d-fb17ab550c06 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.766212 Aug 30 17:48:51.522226 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2138/4507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:50 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:48:51.527142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:51.545362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d99f68f-4dfb-455d-9330-8ed55308bd6a tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1674 microversion: 2.1 time: 1.099406 Aug 30 17:48:51.548698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2370/4508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:50 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1674 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:51.565011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f890a6b-1ad8-4ac2-828e-72f3f002fdc2", "tag": "6fea662b-e1ee-47df-9abc-8d4a13342c22"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:51.568493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:51.569120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:51.589983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:51.600062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:51.600972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:51.606277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:51.606951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:51.607824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:51.612948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:51.613824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:51.614137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:51.701935 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] Creating event network-changed:6fea662b-e1ee-47df-9abc-8d4a13342c22 for instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 on n-h2-852771-11 Aug 30 17:48:51.724839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-14beff14-402e-47d8-a2d4-0396f83aeab5 req-0d3c12d8-caf8-4610-8a9e-63104cdf7e0c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173692 Aug 30 17:48:51.735694 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2371/4509] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:51.768863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:51.774405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:51.801120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:51.814032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:51.820026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:51.821007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:51.822404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:51.823267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:51.828170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:52.789966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:52.804586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9d40cc9-4a8f-45eb-abbc-4645b349a885 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 1.050956 Aug 30 17:48:52.805461 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2372/4510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:51 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:53.217395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e938927-bb55-4f3e-be81-f773bf4db7b0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: .version_select at 0x7f2d935f5af0>, body: {"keypair": {"name": "tempest-keypair-1611209402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFd+4g6Qj/7LmtU24IjD2nh778nIirHMpaiXQNPgtO48Dk9baG4IsYy49yjULF6QuYY2phHugSNR1kRit4CFO6/Xdk8b77aMm/H8P4+8SusYOlJerbl3/DoNE/5rle5Q1Q=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:53.329415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3e938927-bb55-4f3e-be81-f773bf4db7b0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for project beeb3b961b6b4a53914579236a779da1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:48:53.348929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3e938927-bb55-4f3e-be81-f773bf4db7b0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for user e6a13ec5aee742fc99051ec485f19b55 and project beeb3b961b6b4a53914579236a779da1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:48:53.400548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:53.429322 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-637305d6-a81e-46af-8114-749578e6eda5 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 1.877604 Aug 30 17:48:53.459703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e938927-bb55-4f3e-be81-f773bf4db7b0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.652571 Aug 30 17:48:53.460733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2139/4511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:51 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:53.465513 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2373/4512] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:48:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:53.474385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57863d0b-8440-4d79-85cd-535660810108", "tag": "992220f8-9c6a-4441-b509-5a95fb310bee"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:53.486934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:53.487799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:53.501978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:53.502638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:53.503640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:53.504423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:53.505914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:53.507105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:53.507591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:53.508078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:53.508969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:53.535382 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] Creating event network-changed:992220f8-9c6a-4441-b509-5a95fb310bee for instance 57863d0b-8440-4d79-85cd-535660810108 on n-h1-852771-11 Aug 30 17:48:53.546573 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4d9862d6-21b9-4900-a385-42778448f911 req-c4f3719a-d19a-4d84-ae97-41a0bfacf85c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084508 Aug 30 17:48:53.551224 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2140/4513] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:53.556896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:53.562277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:53.575399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:53.580457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:53.585548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:53.586830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:53.588527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:53.595864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:53.602213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:48:53.986924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:53.998392 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2b3b8db7-5dbd-44b1-a91d-d0580cc5e0de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1674 microversion: 2.1 time: 0.444288 Aug 30 17:48:54.014186 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2141/4514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:53 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1674 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:54.021261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:54.022603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:54.032069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:54.033330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:54.035157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:54.036268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:54.037022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:54.037666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:54.226993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:54.249740 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fdef5467-0c99-465e-a709-cc061cc8ecfb tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.782851 Aug 30 17:48:54.255708 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2374/4515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:53 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:54.457126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:54.457914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:54.467750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:54.471312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:54.472587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:54.474553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:54.478170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:54.483027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:55.995216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:56.009164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-19303538-ce3f-4759-86ae-dcaa06722912 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 1.555956 Aug 30 17:48:56.025421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2375/4516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:54 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:48:56.072615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:56.073344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:56.095457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:56.095989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:56.115593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:56.120034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:56.121277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:56.123533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:56.287647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:56.302597 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9a2a4b1-7bbb-49f6-89f0-5cda37b3955e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 2.282753 Aug 30 17:48:56.318764 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2142/4517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:54 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:56.330330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:56.332312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:56.349441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:56.359448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:56.360004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:56.361238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:56.361784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:56.362453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:57.450683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:57.471203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd40d97a-c968-40e2-aeae-71fcd76445e3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 1.147125 Aug 30 17:48:57.487148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2143/4518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:56 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:57.487148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ad37e2-e1e9-4929-a50c-e2e3e00c60d8", "tag": "50a01fab-af03-45f2-a8a4-8e765113a1b9"}, {"name": "network-changed", "server_uuid": "18a61e58-3428-4bda-a7b4-59b70c1ff721", "tag": "6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39"}, {"server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "name": "network-vif-deleted", "tag": "12e2793c-4e30-447c-b5cd-6abfcab9ed7c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:48:57.517416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:57.520663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:57.521951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:57.565067 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Creating event network-changed:50a01fab-af03-45f2-a8a4-8e765113a1b9 for instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 on n-h2-852771-11 Aug 30 17:48:57.565800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Creating event network-changed:6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39 for instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 on n-h2-852771-11 Aug 30 17:48:57.567320 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] Creating event network-vif-deleted:12e2793c-4e30-447c-b5cd-6abfcab9ed7c for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:48:57.592409 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4cdb2d6e-a3b7-4afc-b584-f9e0ec1393af req-79d1d50e-fe80-4310-b69f-ead0ac706b58 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.115709 Aug 30 17:48:57.594487 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2144/4519] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:48:57.608389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:57.613199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:57.631130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:57.632077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:57.633062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:57.634253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:57.635017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:57.635686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:57.743264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:57.758044 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ee7ed22-23c4-4419-936f-eb0cdb8c777e tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1653 microversion: 2.1 time: 1.730756 Aug 30 17:48:57.759293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2376/4520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:56 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1653 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:57.765164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:57.768492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:57.783230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:57.784073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:57.789008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:57.790348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:57.791004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:57.791641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:58.707144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:58.723884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:58.744690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0374fa0-f33d-41bb-b110-4d58446cc46a tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.981470 Aug 30 17:48:58.748963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2377/4521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:57 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:58.765934 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0f6fc47-8065-4eb2-b64e-89579c345513 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 1.149709 Aug 30 17:48:58.774050 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2145/4522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:57 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:58.794575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:58.796821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:58.800922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:58.804337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:58.827380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:58.828646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:58.836617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:58.838086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:58.842760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:58.843646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:58.844866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:58.846993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:58.849207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:58.852190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:58.863786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:58.867767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:59.850926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:59.865307 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7e865e2-bd0c-424f-a2b7-67a96d83cd41 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 1.113038 Aug 30 17:48:59.866284 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2378/4523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:58 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:59.886029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:59.887061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:48:59.913358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:59.914228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:59.914895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:59.923868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:48:59.924701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:48:59.925372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:48:59.925882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:48:59.957710 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c944c57a-1c7a-4c5a-bce1-7b39493e210f tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1496 microversion: 2.1 time: 1.174939 Aug 30 17:48:59.963808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2146/4524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:58 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1496 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:48:59.978550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:48:59.980547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:00.016154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:00.016991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:00.018595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:00.021591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:00.022262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:00.022867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:00.746087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:00.755307 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7e524c9-8610-459d-8df1-e27f06053564 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 0.788786 Aug 30 17:49:00.761081 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2147/4525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:59 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:00.774885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:00.783948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d5da9e-773b-4f61-a96a-f0015a351b02", "name": "network-vif-deleted", "tag": "e317613e-8378-4a44-a6ae-715890b1420a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:00.792315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4379fb5e-cb64-40d3-84c6-a22eef218141 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.915522 Aug 30 17:49:00.798259 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2379/4526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:48:59 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:00.802077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:00.802791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:00.803472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:00.817599 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] Creating event network-vif-deleted:e317613e-8378-4a44-a6ae-715890b1420a for instance 85d5da9e-773b-4f61-a96a-f0015a351b02 on n-h1-852771-11 Aug 30 17:49:00.826499 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-df6ec633-c8b2-446e-a0f6-98fa26bebcb4 req-d7e9531d-a2c4-456b-9e33-42aac89909a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060171 Aug 30 17:49:00.828499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2148/4527] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:00.890929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:00.892109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:00.931929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:00.932546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:00.932968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:00.933717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:00.934229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:00.934658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:00.986317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:00.990430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:00.991122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:01.009490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.009864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.014368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.015143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.019394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.019905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.088911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.089476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.091166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.091839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lazy-loading 'fault' on Instance uuid 85d5da9e-773b-4f61-a96a-f0015a351b02 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:49:01.183087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd463e623a89a4fab91673219aeaec3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b32040f7264823b51522286868d313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:01.213208 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-803b064b-8e90-4ca0-8237-7a36675e13de tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 200 len: 1303 microversion: 2.1 time: 0.228745 Aug 30 17:49:01.223511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2149/4528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:00 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:01.311688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:01.325233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e606552-dcfd-4ae1-80f0-8cb7070ed043 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.441149 Aug 30 17:49:01.326286 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2380/4529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:00 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:01.785687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:01.786295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:01.788847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f890a6b-1ad8-4ac2-828e-72f3f002fdc2", "name": "network-vif-plugged", "status": "completed", "tag": "6fea662b-e1ee-47df-9abc-8d4a13342c22"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:01.798091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.798588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.799025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.801721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.802184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.805257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.805702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.806194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.806629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.834631 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] Creating event network-vif-plugged:6fea662b-e1ee-47df-9abc-8d4a13342c22 for instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 on n-h2-852771-11 Aug 30 17:49:01.848583 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8cc92ad7-fa17-44bf-bd1e-06b5f8101241 req-a07f7826-ec6f-4641-acca-7f9bd328d2d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063280 Aug 30 17:49:01.851769 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2381/4530] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:49:01.875796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:01.880396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:01.888708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.889612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.890246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:01.891185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:01.915010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:01.915719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:02.285045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:02.297282 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0e042da3-1ae6-4b4d-a367-d50a4c24f607 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 0.518147 Aug 30 17:49:02.299345 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2150/4531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:01 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:02.305782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:02.306707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:02.317562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:02.318734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:02.319626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:02.320622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:02.321305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:02.321984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:02.632574 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 HTTP/1.1 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '85d5da9e-773b-4f61-a96a-f0015a351b02'} Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:02.634256 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95c1583f-52d0-43dc-8a6f-8dba17f9b8ff tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 404 len: 111 microversion: 2.1 time: 0.335052 Aug 30 17:49:02.647063 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2151/4532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:02 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 111 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:02.649532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:02.650475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:02.658127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:02.658900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:02.659543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:02.660628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:02.661245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:02.661883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:02.853677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:02.872588 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-90a1cd5d-d366-42b0-9c1a-6d4e1b3a33b3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 1.017363 Aug 30 17:49:02.887500 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2382/4533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:01 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:03.122135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:03.143400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-774885bb-2da7-432b-9190-7eaad28f0ea6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.501233 Aug 30 17:49:03.147864 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2152/4534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:02 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:03.321672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:03.322307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:03.335425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:03.337071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:03.339193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:03.340798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:03.342364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:03.342997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:03.391072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:03.894507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:03.895155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:03.908779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:03.909708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:03.910170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:03.910942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:03.914201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:03.915034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:04.252124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:04.261346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5063e07-fc3b-4f14-b447-f72f4c9ef659 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 0.943590 Aug 30 17:49:04.262689 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2383/4535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:03 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:04.292597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:04.294333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:04.303024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:04.308475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:04.309712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:04.316587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:04.319224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:04.319935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:04.593925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:04.603212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7f5da46-39fd-4283-85e9-c41cc97a2c81 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.712775 Aug 30 17:49:04.603820 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2153/4536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:03 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:04.617778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57863d0b-8440-4d79-85cd-535660810108", "name": "network-vif-plugged", "status": "completed", "tag": "992220f8-9c6a-4441-b509-5a95fb310bee"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:04.689119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:04.690763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:04.694390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:04.748247 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] Creating event network-vif-plugged:992220f8-9c6a-4441-b509-5a95fb310bee for instance 57863d0b-8440-4d79-85cd-535660810108 on n-h1-852771-11 Aug 30 17:49:04.759052 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8b823228-9a3f-4354-844c-eac3214fef38 req-3865ac0a-ce76-45c8-bd4b-aa09de5d6cde service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148558 Aug 30 17:49:04.763427 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2154/4537] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:04.850664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1315105931", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2fa1c9f-d557-49bc-a165-bbf59c30c36f"}], "security_groups": [{"name": "tempest-securitygroup--2059245566"}], "key_name": "tempest-keypair-1611209402", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:05.330121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:05.342931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cdfbd7a4-4cbe-4abf-a89d-d698c9948352 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 1.067037 Aug 30 17:49:05.361293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2384/4538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:04 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:05.369743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:05.372814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:05.386386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:05.392493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:05.393221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:05.394146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:05.394778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:05.396346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:05.784903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:05.799922 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-79427968-5072-4f07-9668-fb8029afebd1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 0.437026 Aug 30 17:49:05.802640 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2385/4539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:05 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:05.815794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:05.816695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:05.828588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:05.832347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:05.833217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:05.834132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:05.834756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:05.836289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:06.138728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] validate_networks() for [('b2fa1c9f-d557-49bc-a165-bbf59c30c36f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:49:06.171762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:06.182076 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d1447e2-7957-4240-b61d-4dbdfa6d010c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.378171 Aug 30 17:49:06.188270 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2386/4540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:05 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:06.369053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:06.370359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:06.378411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:06.380188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:06.380843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:06.381856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:06.382551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:06.383198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:06.727234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:06.744406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd40ffe0-f9bc-4721-8ca6-6b023e4baf0d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.375056 Aug 30 17:49:06.745278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2387/4541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:06 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:06.817308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae86a761-09da-422b-a0d4-a0e85576cfc0", "name": "network-vif-plugged", "status": "completed", "tag": "14d8ac96-9a71-4918-b539-a0248c05da3c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:06.833994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:06.836868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:06.837523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:06.862920 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] Creating event network-vif-plugged:14d8ac96-9a71-4918-b539-a0248c05da3c for instance ae86a761-09da-422b-a0d4-a0e85576cfc0 on n-h1-852771-11 Aug 30 17:49:06.871346 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3b0a6d32-d644-4026-b65d-db776f78af78 req-9f8c7739-b4ea-4dc4-88d9-a3acf4bc0d55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057591 Aug 30 17:49:06.872622 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2388/4542] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:49:06.880979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:06.881898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:06.889808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:06.890727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:06.891380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:06.892330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:06.892978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:06.893613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.327739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:07.339415 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0946c51d-379d-485d-a1c2-4d0aa203f655 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 0.465365 Aug 30 17:49:07.346339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2389/4543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:06 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:07.354466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:07.364966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:07.378907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.384332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.385078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.386062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.387314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.392652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.512939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:49:07.513936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:49:07.514720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:49:07.515348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:49:07.515996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:49:07.545864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.551767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.552465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.553909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.558069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.559633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.615896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for project beeb3b961b6b4a53914579236a779da1. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:49:07.628047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for user e6a13ec5aee742fc99051ec485f19b55 and project beeb3b961b6b4a53914579236a779da1. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:49:07.669266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:49:07.672006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:49:07.766697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:07.780285 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1bd864f6-3eb5-4d08-860e-6829a9e2d8ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.935077 Aug 30 17:49:07.786900 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2155/4544] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:49:07.793959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:07.799410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:07.817076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.817715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.818253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.819026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:07.819688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:07.820275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:07.824676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e710cf6-be56-4609-82bf-1a53eb8698da tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1323 microversion: 2.1 time: 0.460274 Aug 30 17:49:07.834378 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2390/4545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:07 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:07.853478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3cbba1a8-e349-48ed-a2ae-83b1b11245a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:07.865166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3cbba1a8-e349-48ed-a2ae-83b1b11245a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:07.897885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:08.142383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3cbba1a8-e349-48ed-a2ae-83b1b11245a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:08.153198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3cbba1a8-e349-48ed-a2ae-83b1b11245a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1238 microversion: 2.1 time: 0.317437 Aug 30 17:49:08.158435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2391/4546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:07 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1238 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:08.360612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:08.368894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75eccd55-0f80-436d-be51-e27701489b2d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.580668 Aug 30 17:49:08.369438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:08.370064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:08.372544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2156/4547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:07 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:08.386137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:08.387177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:08.391895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:08.392811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:08.393288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:08.393725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:08.847344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:08.849177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:08.868288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:08.875298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:08.876146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:08.877105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:08.877956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:08.878642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.298309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:09.306771 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b81ed560-4e1d-4143-8529-17163e73eabc tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1515 microversion: 2.1 time: 0.463610 Aug 30 17:49:09.311710 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2157/4548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:08 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:49:09.316738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad37e2-e1e9-4929-a50c-e2e3e00c60d8", "name": "network-vif-plugged", "status": "completed", "tag": "50a01fab-af03-45f2-a8a4-8e765113a1b9"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:09.375648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.377043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.377982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.408327 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] Creating event network-vif-plugged:50a01fab-af03-45f2-a8a4-8e765113a1b9 for instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 on n-h2-852771-11 Aug 30 17:49:09.421307 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-816be687-79c6-4f98-9355-0a8517923ace req-9552e2d4-e938-4865-a090-59102ddaa8a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108264 Aug 30 17:49:09.422352 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2158/4549] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:09.435658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:09.436991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:09.467001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.467657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.468190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.469210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.469959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.471335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.681528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:09.697216 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35b9547c-1522-43ce-a30d-02d47b2924bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1290 microversion: 2.1 time: 0.273267 Aug 30 17:49:09.698530 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2159/4550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:09 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1290 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:09.722014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:09.723103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:09.755377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.776476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.777106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.780949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.781530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.782150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.783811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:09.799164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f253e6fb-be4a-4678-a9f8-02aa1ab79999 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1314 microversion: 2.1 time: 1.433509 Aug 30 17:49:09.801702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2392/4551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:08 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1314 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:09.821020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:09.821849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:09.840208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.845705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.846294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:09.847977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:09.850636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:09.853588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.184229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:10.193241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4092f54-dbee-48dd-91ac-f81ab32e508d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.382504 Aug 30 17:49:10.200093 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2393/4552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:09 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:10.213289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:10.214246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:10.221171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.227841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.228524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.229493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.230354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.231343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.290775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 HTTP/1.1 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '85d5da9e-773b-4f61-a96a-f0015a351b02'} Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:10.293609 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.297668 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.308476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:10.309887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30cc2007-9c84-48bf-9b13-570e9022f783 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "DELETE /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 404 len: 111 microversion: 2.1 time: 0.108442 Aug 30 17:49:10.316134 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2394/4553] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:10 2022] DELETE /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:10.321470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:10.339407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: 85d5da9e-773b-4f61-a96a-f0015a351b02] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:10.359626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.360498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.371011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.372189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.375392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.376172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.437217 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 HTTP/1.1 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '85d5da9e-773b-4f61-a96a-f0015a351b02'} Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.447545 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance 85d5da9e-773b-4f61-a96a-f0015a351b02 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0a36bb7-512c-4197-9a46-420a8ac4ec28 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02" status: 404 len: 111 microversion: 2.1 time: 0.128788 Aug 30 17:49:10.456592 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2395/4554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:10 2022] GET /compute/v2.1/servers/85d5da9e-773b-4f61-a96a-f0015a351b02 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:10.473709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:10.473709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:10.502463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.511990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.512817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.513741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.514360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.514966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.523142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:10.533332 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfe5ebde-4bdc-43cf-85aa-3580f05ec87e tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 200 len: 1516 microversion: 2.1 time: 0.827554 Aug 30 17:49:10.538748 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2160/4555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:09 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 1516 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:10.577589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:10.588245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:10.594452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:10.601176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 HTTP/1.1 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e1a1d641-4cb9-4dd6-8aec-43f03eede343'} Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:10.601971 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.606589 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.607454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.607454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.607454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.608481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:10.609333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.609708 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba7cd1bf-ab9d-44f9-bffc-e2f17ee129fc tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 404 len: 111 microversion: 2.1 time: 0.140913 Aug 30 17:49:10.614073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.614476 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2396/4556] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:10 2022] DELETE /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:10.619539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.627718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:10.628614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] [instance: e1a1d641-4cb9-4dd6-8aec-43f03eede343] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:10.645341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.647335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.647970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.648857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:10.649480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:10.650060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:10.683397 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] HTTP exception thrown: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.698274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Request method failure captured: Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 HTTP/1.1 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDkz-1FLR-JftI5ir6N87jJN5TXrGT4ufwZzAQmWQOimCDa1Am2uPbk95ZocKcv1RP0c8g7cl72cvKF4tPTXK22GxsY_CRiu_axr5zcq4HcejxHlZq-_dU6sPtmL2En86G1fkDiWcDNWVb0ewIDk8cu7WWGBmI_itn_iBSHo4sbIfcvU Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13b32040f7264823b51522286868d313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13b32040f7264823b51522286868d313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13b32040f7264823b51522286868d313"}]}] Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13b32040f7264823b51522286868d313 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestMultiNic-65460531 Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d463e623a89a4fab91673219aeaec3af Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestMultiNic-65460531-project Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e1a1d641-4cb9-4dd6-8aec-43f03eede343'} Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:10.701060 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. Aug 30 17:49:10.705141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:10.708759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] Returning 404 to user: Instance e1a1d641-4cb9-4dd6-8aec-43f03eede343 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:10.709868 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93951e19-17f6-49e0-9a94-ae6cf2d12420 tempest-ServersTestMultiNic-65460531 tempest-ServersTestMultiNic-65460531-project] 10.222.0.50 "GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343" status: 404 len: 111 microversion: 2.1 time: 0.094261 Aug 30 17:49:10.726806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2397/4557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:10 2022] GET /compute/v2.1/servers/e1a1d641-4cb9-4dd6-8aec-43f03eede343 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:10.935358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1522322350", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:11.036026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] validate_networks() for [('37096ef8-114d-449d-9672-1d0180c6f3c4', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:49:11.116390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:11.143189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37c2cc62-5b0f-462f-a38f-cf2e2f286332 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 200 len: 1516 microversion: 2.1 time: 0.579362 Aug 30 17:49:11.145891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2161/4558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:10 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 1516 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:11.171398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:11.172856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:11.201769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:11.202410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:11.203110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:11.204103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:11.206309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:11.207002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:11.608817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:11.640227 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfb7825d-6d1a-44b6-857c-b2b4bc2403cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1296 microversion: 2.1 time: 0.486341 Aug 30 17:49:11.643738 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2162/4559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:11 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1296 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:11.666216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:11.669184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:11.698111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:11.698915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:11.699681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:11.700952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:11.701691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:11.720824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.443898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:12.475095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dc3db408-27d4-4462-b4ed-1f3c905dc291 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1463 microversion: 2.1 time: 0.825162 Aug 30 17:49:12.479315 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2163/4560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:11 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1463 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:12.492888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:12.493763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:12.528274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.534450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.537734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.538686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.539317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.549085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.630894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:49:12.631361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:49:12.632795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:49:12.633220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:49:12.633636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:49:12.637041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:12.650530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.659743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.660205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.661031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.661495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.661926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.740560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Getting quotas for project 3abef25db6be4e9aa95482c407dc586d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:49:12.757494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Getting quotas for user 96d2360a58044af78b153c1984413a42 and project 3abef25db6be4e9aa95482c407dc586d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:49:12.796254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:49:12.801773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:49:12.859872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0e9d7a62-e10e-4712-8a53-4bb9d8d91eac tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 204 len: 0 microversion: 2.1 time: 0.373605 Aug 30 17:49:12.861685 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2164/4561] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:12 2022] DELETE /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:49:12.875979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:12.879283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:12.896872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.898239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.901661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.903489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.904366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.905240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:12.932673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-618b06ea-e5cc-4578-8b61-0a375f335337 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.204253 Aug 30 17:49:12.935140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2398/4562] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:49:12.952865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a61e58-3428-4bda-a7b4-59b70c1ff721", "name": "network-vif-plugged", "status": "completed", "tag": "6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:12.976185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:12.977594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:12.979081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.003761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] Creating event network-vif-plugged:6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39 for instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 on n-h2-852771-11 Aug 30 17:49:13.009754 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0314a2a2-7c8a-4008-a328-36bb735502da req-c58ffdd0-3099-45a5-87aa-f08f2409ff71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072677 Aug 30 17:49:13.010853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2399/4563] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:13.017631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:13.019172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:13.025633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.026617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.028229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.029352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.030539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.030539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.063230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:13.199699 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3edb14ad-fe87-4b9d-9452-79e956411706 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "DELETE /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 204 len: 0 microversion: 2.1 time: 0.184384 Aug 30 17:49:13.200337 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2400/4564] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:13 2022] DELETE /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:49:13.210130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:13.210850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:13.227492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.228427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.228746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.229720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.230753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.231037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.292601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:13.573031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:13.603426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36a67b6a-185b-483d-828b-8bbede273f99 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.737216 Aug 30 17:49:13.608213 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2165/4565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:12 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:13.640527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:13.644241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:13.661416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.665336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.666631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:13.670495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:13.674321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:13.675821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.038536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:14.065051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa067f58-e9d4-4357-b626-1ff293182d10 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 0.862937 Aug 30 17:49:14.080352 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2401/4566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:13 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:14.080352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:14.081068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:14.092556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.093068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.093520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.094305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.094767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.095202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.239418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:14.268346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ca94989-50db-4e9d-90f3-d695e0499fd4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 200 len: 1522 microversion: 2.1 time: 0.656513 Aug 30 17:49:14.270805 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2166/4567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:13 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:14.295932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:14.300511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:14.320011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.320510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.320953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.321655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.322115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.322541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.341828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:14.363390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c451d783-43a4-4bbe-a52f-feb1672927e0 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1228 microversion: 2.1 time: 0.291871 Aug 30 17:49:14.418598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2402/4568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:14 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1228 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:14.502657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbeeea5c-d741-4d17-b89c-41590b4572db", "tag": "5879cd82-e11f-4344-84c4-ea2847dc469a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:14.546575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.549161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.554858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.607980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] Creating event network-changed:5879cd82-e11f-4344-84c4-ea2847dc469a for instance bbeeea5c-d741-4d17-b89c-41590b4572db on n-h1-852771-11 Aug 30 17:49:14.622987 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a408d077-5e44-45ca-a38d-087bfd78cac5 req-00956e73-04b0-4775-86ba-d34bed1efa64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134974 Aug 30 17:49:14.624261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2403/4569] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:49:14.633406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:14.640256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:14.651285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.659084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.659983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:14.661086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:14.662071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:14.662669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:15.025308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:15.035066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4bb81eed-1133-41d2-a5cd-1ddc2630ea98 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 0.409447 Aug 30 17:49:15.054432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2404/4570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:14 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:15.089275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:15.090520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:15.103760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:15.113699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:15.114646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:15.116330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:15.116330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:15.118107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:15.692437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:15.708786 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1fb9e34f-5aaf-44d8-aff8-5b485e15af3b tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1469 microversion: 2.1 time: 1.423474 Aug 30 17:49:15.709808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2167/4571] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:14 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1469 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:15.727676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:15.732459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:15.779849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:15.783051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:15.784512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:15.790046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:15.790559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:15.795850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:16.036327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:16.044831 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-51a419d1-2b4f-4090-a660-c92c980fafe5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 0.960457 Aug 30 17:49:16.073537 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2405/4572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:15 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:16.090666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:16.091766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:16.120157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:16.120431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:16.121055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:16.123004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:16.123004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:16.127056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:16.571039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:16.612834 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-189fce68-8fca-418b-be91-a8a7f28065fa tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1276 microversion: 2.1 time: 0.537091 Aug 30 17:49:16.623763 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2406/4573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:16 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1276 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:16.648065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:16.648901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:16.671365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:16.671882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:16.672504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:16.673988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:16.675527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:16.678013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:17.457792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:17.472854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44bed5ee-e3eb-4c8f-82e6-922bfe8828ed tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 200 len: 1522 microversion: 2.1 time: 1.760980 Aug 30 17:49:17.474031 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2168/4574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:15 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 1522 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:17.486660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:17.490428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:17.509932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:17.511005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:17.517178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:17.519279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:17.523190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:17.526305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:17.612745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:17.646604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:17.706873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:17.768480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b52e3d9-4eb5-42f3-88bb-05c77e6d4cd0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1328 microversion: 2.1 time: 1.143602 Aug 30 17:49:17.792420 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2407/4575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:16 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1328 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:17.804137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:17.806119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:17.835218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:17.841859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:17.844674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:17.847420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:17.847973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:17.848436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:18.310000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9986f6d72a4df08e6827293684ca33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eb9a3be3ca4f148b527b01cd17f4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:18.321687 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0104dd5-5faa-413c-a1d2-7fdaebc3b4ea tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 200 len: 1469 microversion: 2.1 time: 0.844555 Aug 30 17:49:18.328939 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2169/4576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:17 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 1469 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:18.349741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:18.350582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:18.368940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:18.369462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:18.369901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:18.374595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:18.380536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:18.383747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:18.933759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:18.952918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9cc4f04-33e2-49a4-911e-76d48c346b90 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 1.169548 Aug 30 17:49:18.953525 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2408/4577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:17 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:18.964357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad37e2-e1e9-4929-a50c-e2e3e00c60d8", "name": "network-vif-deleted", "tag": "50a01fab-af03-45f2-a8a4-8e765113a1b9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:18.989496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:18.992413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:18.993993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.034036 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] Creating event network-vif-deleted:50a01fab-af03-45f2-a8a4-8e765113a1b9 for instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 on n-h2-852771-11 Aug 30 17:49:19.052386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e70e12f3-ffbc-4f80-8952-bf206f672e57 req-07e6decb-5d42-4880-af9e-c4d386a6d489 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094358 Aug 30 17:49:19.053621 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2409/4578] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:19.061591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:19.062625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:19.080299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.081486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.083666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.086347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.087016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.087662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.172200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.172687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.174060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.174533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lazy-loading 'fault' on Instance uuid 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:49:19.242857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:19.261718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68593210-f9ec-4c66-a358-0f33ca9324f6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 200 len: 1313 microversion: 2.1 time: 0.205920 Aug 30 17:49:19.266375 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2410/4579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:19 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:19.418874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:19.433850 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72aafa9b-3cce-4ebf-903f-437e69f3586b tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1282 microversion: 2.1 time: 1.103875 Aug 30 17:49:19.439330 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2170/4580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:18 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1282 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:19.444216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:19.459598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f890a6b-1ad8-4ac2-828e-72f3f002fdc2", "name": "network-vif-deleted", "tag": "6fea662b-e1ee-47df-9abc-8d4a13342c22"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:19.460035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:19.484137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.484628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.485312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.486021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.486466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.486896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.488507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.491133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.492609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.532768 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] Creating event network-vif-deleted:6fea662b-e1ee-47df-9abc-8d4a13342c22 for instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 on n-h2-852771-11 Aug 30 17:49:19.547780 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-565493cf-7711-4f1c-b6b8-065d708efd6f req-f8ef9111-2e97-4ae4-9e02-e44b04672792 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280002 Aug 30 17:49:19.549614 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2411/4581] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:19.557993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:19.564002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] [instance: 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:19.600937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.604158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.608501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.609532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.611333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:19.612964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:19.650524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] HTTP exception thrown: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Request method failure captured: Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 HTTP/1.1 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1wQB2kA5Jm_u9_s2FBXR-ueE5w5vxVxD1S8HjRDagPlLPCsHkaMPato1ilCO0cqSarBJYoHmgT01stCG1eR1rA2CEwu1MNdkTykfsBbdVGZW0Ql1jAvN7cpT4njal5Q8YBpXdyGv-PBc4Bk-JfIFctwhJ0cr4KMsKJPhbLSlOWGPE Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a9eb9a3be3ca4f148b527b01cd17f4b7 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesNegativeTest-906051052 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9eb9a3be3ca4f148b527b01cd17f4b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9eb9a3be3ca4f148b527b01cd17f4b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a9eb9a3be3ca4f148b527b01cd17f4b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a9eb9a3be3ca4f148b527b01cd17f4b7"}]}] Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesNegativeTest-906051052 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a9eb9a3be3ca4f148b527b01cd17f4b7 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesNegativeTest-906051052 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesNegativeTest-906051052-project Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: eb9986f6d72a4df08e6827293684ca33 Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesNegativeTest-906051052-project Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '85ad37e2-e1e9-4929-a50c-e2e3e00c60d8'} Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:19.662687 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. Aug 30 17:49:19.668772 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:19.670744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] Returning 404 to user: Instance 85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:19.671953 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c23ab652-658c-40ee-9fcf-2b9c6cae66d1 tempest-VolumesNegativeTest-906051052 tempest-VolumesNegativeTest-906051052-project] 10.222.0.50 "GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8" status: 404 len: 111 microversion: 2.1 time: 0.121072 Aug 30 17:49:19.672784 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2412/4582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:19 2022] GET /compute/v2.1/servers/85ad37e2-e1e9-4929-a50c-e2e3e00c60d8 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:19.976466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:19.977147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:19.994662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:19.999872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.000324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.006953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.007456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.008700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.062989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:20.094778 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-079efa17-8b4c-47a1-a091-7615618629f4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1508 microversion: 2.1 time: 0.652514 Aug 30 17:49:20.096645 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2171/4583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:19 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1508 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:20.123343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:20.124811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:20.160376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.169629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.170186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.170983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.173167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.175443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.441990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:20.456381 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d500730c-4772-4fa0-89e3-877c217f5443 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 0.484232 Aug 30 17:49:20.476446 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2413/4584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:19 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:49:20.486252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:20.494235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:20.505299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.505798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.506243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.506966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.507427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.507894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.550456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] HTTP exception thrown: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 HTTP/1.1 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3f890a6b-1ad8-4ac2-828e-72f3f002fdc2'} Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:20.552896 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 404 to user: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-069a1ae8-7a17-464c-9d37-89832d08b72c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 404 len: 111 microversion: 2.1 time: 0.076621 Aug 30 17:49:20.563471 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2414/4585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:20 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:20.570883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:20.572873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:20.594192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.595913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.596900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.598037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.599844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.600975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.805981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:20.815240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ed2a759-5d4a-4261-a3ea-b8438d48b3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1508 microversion: 2.1 time: 0.699487 Aug 30 17:49:20.845784 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2172/4586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:20 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:20.859141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:20.872494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:20.876221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:20.895279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.900522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.901181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:20.902708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:20.910987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:20.912062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.142170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab68dec0-30b9-4561-b7fd-fef902ac62c9 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.292502 Aug 30 17:49:21.143711 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2173/4587] 10.222.0.50 () {58 vars in 1230 bytes} [Tue Aug 30 17:49:20 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:49:21.173493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:21.175846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:21.191992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.194031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.194338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.194993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.195457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.202300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.284386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:21.421193 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1179a6b8-3fb4-45df-a116-4d0c2202e9cc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 204 len: 0 microversion: 2.1 time: 0.274857 Aug 30 17:49:21.422614 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2174/4588] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:21 2022] DELETE /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:49:21.433967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6dff03b4-e527-49d0-bdad-f9a20bfa68cf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6dff03b4-e527-49d0-bdad-f9a20bfa68cf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 17:49:21.440224 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 17:49:21.444606 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:21.449813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6dff03b4-e527-49d0-bdad-f9a20bfa68cf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:21.451323 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6dff03b4-e527-49d0-bdad-f9a20bfa68cf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026049 Aug 30 17:49:21.452135 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2175/4589] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 30 17:49:21 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:21.458485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:21.459764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:21.470308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.471128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.472039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.474376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.476054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.476054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.491323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:21.511233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e53464f-66f2-4ef7-940e-e84856da9f25 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.946689 Aug 30 17:49:21.516128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:21.525601 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2415/4590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:20 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:21.534718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:21.548177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:21.556646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:21.577121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.580063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.584088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.585109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.585743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.586343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.656659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:49:21.693934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de70b55b-0d5e-4bfb-ae43-8ea70e647a9b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.166903 Aug 30 17:49:21.701960 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2416/4591] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:49:21 2022] GET /compute/v2.1/servers => generated 683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:21.711439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:21.712294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:21.723196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.727172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.731709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:21.732808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:21.733442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:21.734029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.003973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.018354 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e6629f1-7680-4cca-b3ab-8017debb9724 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1514 microversion: 2.1 time: 0.564570 Aug 30 17:49:22.037071 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2176/4592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:21 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1514 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:22.047066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.053049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.054132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.servers [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Removing options 'limit' from query {{(pid=122123) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 17:49:22.055556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:22.064873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.065718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.066407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.067415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.068144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.068799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.104357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:49:22.142315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f973859e-55c8-4f42-9bc9-8cd926c69762 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.103496 Aug 30 17:49:22.143266 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2177/4593] 10.222.0.50 () {58 vars in 1144 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:22.148283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeeea5c-d741-4d17-b89c-41590b4572db", "name": "network-vif-plugged", "status": "completed", "tag": "5879cd82-e11f-4344-84c4-ea2847dc469a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:22.160410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.161597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.162252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.179392 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] Creating event network-vif-plugged:5879cd82-e11f-4344-84c4-ea2847dc469a for instance bbeeea5c-d741-4d17-b89c-41590b4572db on n-h1-852771-11 Aug 30 17:49:22.190108 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-97764fc5-32ed-40ce-ba7a-ef32b9f8ad65 req-67e05f29-a287-431c-a101-30286af9dbe7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044881 Aug 30 17:49:22.191423 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2178/4594] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:22.199589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b8e0db5-a39f-449c-86fd-44d61e9e931c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b8e0db5-a39f-449c-86fd-44d61e9e931c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '-1' Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 17:49:22.204299 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 17:49:22.208869 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.211569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b8e0db5-a39f-449c-86fd-44d61e9e931c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:22.212816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b8e0db5-a39f-449c-86fd-44d61e9e931c tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.019578 Aug 30 17:49:22.213987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2179/4595] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:22.232799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-466f2203-242d-4a5d-a97b-3d0a93c418af tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-466f2203-242d-4a5d-a97b-3d0a93c418af tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: action_args: {} Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'testing' Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 17:49:22.237589 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 17:49:22.242870 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:22.246656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-466f2203-242d-4a5d-a97b-3d0a93c418af tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:22.248342 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-466f2203-242d-4a5d-a97b-3d0a93c418af tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020635 Aug 30 17:49:22.249169 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2180/4596] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:22.281124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-980c5a04-46fc-4bc0-9561-35408528ca4b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.314749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-980c5a04-46fc-4bc0-9561-35408528ca4b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.320143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.322178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-980c5a04-46fc-4bc0-9561-35408528ca4b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:22.333635 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91522c3b-7695-446c-85a9-c7d8ff9b7616 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 0.630108 Aug 30 17:49:22.336431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2417/4597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:21 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:22.344379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.servers [None req-980c5a04-46fc-4bc0-9561-35408528ca4b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Flavor 'non_existing_flavor' could not be found {{(pid=122123) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 30 17:49:22.346099 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-980c5a04-46fc-4bc0-9561-35408528ca4b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.091179 Aug 30 17:49:22.347195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2181/4598] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:49:22.363281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.369723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.375005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:22.389629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.391213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.393535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.394311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.394857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.395221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.538734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.540997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:22.560325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.561534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.563185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.565516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.567464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.570031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.592016 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c416eb9c-eaa8-42c4-a396-ae317a97d99b tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.234247 Aug 30 17:49:22.603698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2418/4599] 10.222.0.50 () {58 vars in 1174 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:49:22.613204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.629004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.630280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:22.659134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.659673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.660230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.661337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.661806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.662232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.814740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:22.820170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-756a896f-f198-4b85-8da4-0f19ac2524fa tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.214820 Aug 30 17:49:22.823780 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2419/4600] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:49:22.836995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:22.849905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.850745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:22.873004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.873500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.879283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.880897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:22.881724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:22.881921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:22.958641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:22.969510 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e2a7b5f8-6788-45da-8b86-67dbe928637d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.437110 Aug 30 17:49:22.974739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:49:22.987061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2182/4601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:23.045726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:23.046322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:23.053453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:23.064434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.065336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.065745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.066186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.066304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.066667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.067424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.067915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.068344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.351860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:23.365157 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e6cf4f1-ee13-418e-813a-2949d8cde60b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1514 microversion: 2.1 time: 0.324470 Aug 30 17:49:23.365754 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2183/4602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:23 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:49:23.385326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:23.386924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:23.400533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.405180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.406413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.409644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.411753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.413082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.692545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ee55f25-83bf-417c-be94-fa9353604aaf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.862963 Aug 30 17:49:23.703937 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2420/4603] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:49:22 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:23.707903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fa4808-c22f-4ce2-a6be-c650724fb309", "tag": "5c68bdcb-43d4-4532-a677-775f1a973005"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:23.743144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.746157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.746907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.777424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] Creating event network-changed:5c68bdcb-43d4-4532-a677-775f1a973005 for instance 73fa4808-c22f-4ce2-a6be-c650724fb309 on n-h2-852771-11 Aug 30 17:49:23.795075 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-27a901ca-6f15-4138-b64f-ccc71a9e1a94 req-580135d8-b08b-456f-813d-755b05ebc61c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093785 Aug 30 17:49:23.798085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2421/4604] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:23.810886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-970430a7-5ff9-40f3-b416-ac2e793e0fa2 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:23.821531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-970430a7-5ff9-40f3-b416-ac2e793e0fa2 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:23.822912 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-970430a7-5ff9-40f3-b416-ac2e793e0fa2 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022938 Aug 30 17:49:23.837481 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2422/4605] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Aug 30 17:49:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:49:23.844182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:23.850299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:23.851371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Searching by: {'deleted': False, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:49:23.862032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.863405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.864171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.865169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.865925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.866367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.903822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:23.907106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:49:23.947420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-267b753c-ae88-49c7-87f2-d5c68525b3df tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.108568 Aug 30 17:49:23.956395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2423/4606] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:49:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:23.961556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:23.962410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:23.972708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.975894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.975894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.975894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:23.975894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:23.975894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:23.999090 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] HTTP exception thrown: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 HTTP/1.1 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3f890a6b-1ad8-4ac2-828e-72f3f002fdc2'} Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:24.001026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.005688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.009061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 404 to user: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:24.010221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-034f2f25-ba24-418a-81ce-7aa9536edab8 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 404 len: 111 microversion: 2.1 time: 0.052618 Aug 30 17:49:24.014776 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2424/4607] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:23 2022] DELETE /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:24.020988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.021624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.029946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.030149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:24.030436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.030932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.031694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.032146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.032570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.038657 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ec5e88a7-2312-4a74-ab0e-11d58660c421 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1364 microversion: 2.1 time: 0.671867 Aug 30 17:49:24.039434 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2184/4608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:23 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1364 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:24.076295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.077532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.087515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.088359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.090224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.091426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.092160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.092971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.131190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:24.341772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fe2e052-f183-46ac-9cde-4ee32b7a14e0 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 204 len: 0 microversion: 2.1 time: 0.278085 Aug 30 17:49:24.342295 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2185/4609] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:24 2022] DELETE /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:49:24.351406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.352301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.360221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.361343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.362004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.363097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.363843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.364516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.424596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:24.540603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:24.562914 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04304b78-9637-48c6-b50b-7b103b78b840 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.546999 Aug 30 17:49:24.563577 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2425/4610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:24 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:24.586846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.587573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.601398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.601822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.602260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.602983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.603442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.603903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.624129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-796a79db-6512-4efe-856d-6be43068dcff tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 204 len: 0 microversion: 2.1 time: 0.276866 Aug 30 17:49:24.625099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2186/4611] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:24 2022] DELETE /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:49:24.633216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.634237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.643468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.651309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.652511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.653436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.654057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.657774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.686630 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] HTTP exception thrown: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 HTTP/1.1 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3f890a6b-1ad8-4ac2-828e-72f3f002fdc2'} Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.688596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. Aug 30 17:49:24.693268 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:24.694922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 404 to user: Instance 3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:24.696036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27ff70b2-31c3-412f-bc08-2d0c0e3743bf tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2" status: 404 len: 111 microversion: 2.1 time: 0.067020 Aug 30 17:49:24.697123 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2187/4612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:24 2022] GET /compute/v2.1/servers/3f890a6b-1ad8-4ac2-828e-72f3f002fdc2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:49:24.723335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:24.724011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:24.743123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.743928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.744556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.748923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.750481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.750930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.841010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:24.853785 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-daedded4-c6f0-4f8e-90b3-ce5f7399f3c0 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 200 len: 1472 microversion: 2.1 time: 0.283292 Aug 30 17:49:24.856244 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2426/4613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:24 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:24.883267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a61e58-3428-4bda-a7b4-59b70c1ff721", "name": "network-vif-deleted", "tag": "6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:24.903659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:24.904536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:24.908482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:24.948222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] Creating event network-vif-deleted:6e71b23d-0a17-4a8f-a1a6-1e2bce8b9f39 for instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 on n-h2-852771-11 Aug 30 17:49:24.964775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3fb2a2dc-ca7c-4b97-a8db-9fbc81ec81c5 req-ea823f3b-edf2-486e-888d-f526a09a8c5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088050 Aug 30 17:49:24.966968 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2427/4614] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:25.066041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:25.068282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:25.107263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.108466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:25.113662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.117128 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67eafbcd-1c45-47d0-831f-ebda16829d77 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 200 len: 1522 microversion: 2.1 time: 0.415067 Aug 30 17:49:25.118577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.121892 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2188/4615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:24 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:25.126693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.129197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.130359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.485509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:25.499283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f63e5e5b-4a2a-4d8e-a00d-8edd41247542 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1550 microversion: 2.1 time: 0.440905 Aug 30 17:49:25.500957 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2428/4616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:25 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1550 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:25.527424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:25.527945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:25.538992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.540141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.540617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.541305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.544002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.544602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.586757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:25.587386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:25.590318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:25.602350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.608016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.615316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.616395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.616681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.617574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.798293 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eeeef9ee-44a1-4240-9739-996158803633 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275278 Aug 30 17:49:25.799976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2189/4617] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:49:25 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:25.886110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:25.887001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:25.900806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.908430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.909535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.910834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:25.911464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:25.912158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:25.950220 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 HTTP/1.1 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '18a61e58-3428-4bda-a7b4-59b70c1ff721'} Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:25.952214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:49:25.957438 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:25.958698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:25.959798 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b72119ce-5777-4f07-91d5-61369e37c5ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 404 len: 111 microversion: 2.1 time: 0.086635 Aug 30 17:49:25.960904 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2190/4618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:25 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:25.970423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a350fffb-32e9-4e90-b4bd-ff5ad4ea2ec7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '.version_select at 0x7f2d98f0d8b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:26.018096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:26.029314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a350fffb-32e9-4e90-b4bd-ff5ad4ea2ec7 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-key-569084014" status: 202 len: 0 microversion: 2.1 time: 0.063956 Aug 30 17:49:26.030642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2191/4619] 10.222.0.50 () {58 vars in 1206 bytes} [Tue Aug 30 17:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-569084014 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:49:26.039799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b08791c-a38b-4a54-9e5e-77f0cf2a4e12 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.445786 Aug 30 17:49:26.041697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2429/4620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:25 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:49:26.141267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:26.142200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:26.164596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:26.165093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:26.165537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:26.166257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:26.166717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:26.167743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:26.254965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-378868584", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:26.351153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:49:26.555628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:26.578897 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92227c91-e47d-4843-88d0-ba4168d1b6d3 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 200 len: 1522 microversion: 2.1 time: 0.431591 Aug 30 17:49:26.580145 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2192/4621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:26 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:27.067330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:27.068528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:27.076508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.077332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.078031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.080416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.083568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.084481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.109355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:49:27.110190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:49:27.110502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:49:27.111085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:49:27.111850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:49:27.128037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.132407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.133122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.134960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.136319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.136766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.181216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:49:27.199430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:49:27.230238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:49:27.234594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:49:27.345939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-751185cd-ed5c-4f94-aaa7-0317c03c2d30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096430 Aug 30 17:49:27.349277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2430/4622] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:49:27.364241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7458c6b-df64-4f4e-a53a-a9a719780493 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:27.365249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7458c6b-df64-4f4e-a53a-a9a719780493 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:27.430021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7458c6b-df64-4f4e-a53a-a9a719780493 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:27.439393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7458c6b-df64-4f4e-a53a-a9a719780493 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1208 microversion: 2.1 time: 0.084903 Aug 30 17:49:27.456418 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2431/4623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:27 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:27.604367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:27.604888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:27.614793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.615894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.616513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.617540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:27.618890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:27.619772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:27.638714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:27.648061 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e42d3e85-748e-4f89-a789-313193140b48 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.586026 Aug 30 17:49:27.655191 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2193/4624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:27 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:27.932504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:27.942188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f0858157-b02b-460f-9cd0-ef95b9170357 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 200 len: 1522 microversion: 2.1 time: 0.344447 Aug 30 17:49:27.949833 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2432/4625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:27 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:49:28.464602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:28.467878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:28.493116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:28.500057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:28.501768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:28.503805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:28.505097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:28.506233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:28.680262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:28.681571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:28.699067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:28.700752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:28.701541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:28.703125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:28.705047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:28.706621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:28.749045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:28.769252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ac4332e-bb16-497b-82d4-5d37ccc43809 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1212 microversion: 2.1 time: 0.310328 Aug 30 17:49:28.774470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2194/4626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:28 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1212 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:28.980343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:28.981424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:29.018252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:29.020079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:29.024813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:29.026323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:29.029469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:29.032950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:29.117930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:29.144914 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a6373e6-bb45-4c19-9100-d158c0f72c5f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.468813 Aug 30 17:49:29.160518 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2433/4627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:28 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:29.614014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fa4808-c22f-4ce2-a6be-c650724fb309", "name": "network-vif-plugged", "status": "completed", "tag": "5c68bdcb-43d4-4532-a677-775f1a973005"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:29.637532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:29.638365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:29.640375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:29.666435 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] Creating event network-vif-plugged:5c68bdcb-43d4-4532-a677-775f1a973005 for instance 73fa4808-c22f-4ce2-a6be-c650724fb309 on n-h2-852771-11 Aug 30 17:49:29.673480 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e0f01718-e7e4-4cd4-bede-e19053bb0d8e req-937886df-da10-42d2-b57a-e71937c4cf1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063715 Aug 30 17:49:29.678494 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2434/4628] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:49:29.800797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:29.801701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:29.831667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:29.836416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:29.836943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:29.837709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:29.844777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:29.845352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:30.104086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:30.114875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eede8132-00a0-49f4-ac65-13c9b56d4d36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1266 microversion: 2.1 time: 0.318799 Aug 30 17:49:30.130956 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2435/4629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:29 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:30.167231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:30.167860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:30.181528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:30.183331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:30.184006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:30.184998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:30.186156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:30.187571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:30.373200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:30.377304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:30.392302 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-141b0123-7508-4a17-87ff-e9db27c45cc7 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 200 len: 1522 microversion: 2.1 time: 1.420626 Aug 30 17:49:30.400660 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2195/4630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:28 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 1522 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:30.436233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae86a761-09da-422b-a0d4-a0e85576cfc0", "name": "network-vif-deleted", "tag": "14d8ac96-9a71-4918-b539-a0248c05da3c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:30.460960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:30.468643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:30.469413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:30.470009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:30.474348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f4e4d414-2202-440f-af83-eca90cc038a7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1324 microversion: 2.1 time: 0.310948 Aug 30 17:49:30.482527 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2436/4631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:30 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:30.498164 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] Creating event network-vif-deleted:14d8ac96-9a71-4918-b539-a0248c05da3c for instance ae86a761-09da-422b-a0d4-a0e85576cfc0 on n-h1-852771-11 Aug 30 17:49:30.503836 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-85a198f7-163c-4e17-bf3a-3b30de76122d req-dcffb43d-6833-41a7-bc1d-f61f6d84e226 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099252 Aug 30 17:49:30.504846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2196/4632] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:31.141221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:31.142256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:31.161761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.162256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.162699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.168023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.168533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.176619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.431724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:31.432979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:31.434284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: ae86a761-09da-422b-a0d4-a0e85576cfc0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:31.443095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb637f77-c29f-4b12-90a3-ca6f5c9b116b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1266 microversion: 2.1 time: 0.307511 Aug 30 17:49:31.461704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2437/4633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:31 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:31.465057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.466214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.467361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.469952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.471087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.473491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.503714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:31.507972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:31.532609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.546843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.548153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.549802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.550988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.552414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.559875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] HTTP exception thrown: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 HTTP/1.1 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ae86a761-09da-422b-a0d4-a0e85576cfc0'} Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:31.566576 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. Aug 30 17:49:31.576071 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:31.585314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 404 to user: Instance ae86a761-09da-422b-a0d4-a0e85576cfc0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:31.587036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1e64e27-f6a6-4ad2-a4b6-42ba26e8b7fd tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0" status: 404 len: 111 microversion: 2.1 time: 0.163811 Aug 30 17:49:31.595349 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2197/4634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:31 2022] GET /compute/v2.1/servers/ae86a761-09da-422b-a0d4-a0e85576cfc0 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:31.611605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:31.621758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:31.653820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.661525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.662914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.663930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.665548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.668256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.755585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:31.756079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:31.756972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:31.757631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lazy-loading 'fault' on Instance uuid 57863d0b-8440-4d79-85cd-535660810108 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:49:31.951468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802a95a947c44c38772ebf0deb363ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ffe9c2af074cbf9bd155965e0e25fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:31.970622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50728e0b-ada8-40ad-9998-18143ce61df6 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 200 len: 1313 microversion: 2.1 time: 0.372542 Aug 30 17:49:31.971256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2198/4635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:31 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:32.060409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:32.078286 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a0fbfd2-17ab-4f42-a714-fa67936cac66 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1520 microversion: 2.1 time: 0.578439 Aug 30 17:49:32.078935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2438/4636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:31 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:32.337245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5be419c-ea63-4277-a961-416d41bdfe35 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1096252892", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5be419c-ea63-4277-a961-416d41bdfe35 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 243 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1096252892", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1096252892', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '37096ef8-114d-449d-9672-1d0180c6f3c4'}]}}} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:32.344429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.349061 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.353963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5be419c-ea63-4277-a961-416d41bdfe35 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:32.360194 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5be419c-ea63-4277-a961-416d41bdfe35 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028780 Aug 30 17:49:32.369184 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2199/4637] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:32 2022] POST /compute/v2.1/servers => generated 175 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:32.376685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:32.377867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73792ba3-61f1-4817-a733-554d2faf96c4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:32.392373 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] HTTP exception thrown: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/73792ba3-61f1-4817-a733-554d2faf96c4/metadata HTTP/1.1 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '73792ba3-61f1-4817-a733-554d2faf96c4'} Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.402883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 404 to user: Instance 73792ba3-61f1-4817-a733-554d2faf96c4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9b2e4a1-2ef0-4406-b1d6-41ed644edaed tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73792ba3-61f1-4817-a733-554d2faf96c4/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033616 Aug 30 17:49:32.418194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2439/4638] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 17:49:32 2022] GET /compute/v2.1/servers/73792ba3-61f1-4817-a733-554d2faf96c4/metadata => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:32.474332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:32.475184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:32.490160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:32.504112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:32.504605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:32.505050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:32.505776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:32.506234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:32.506660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:32.574288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b27ae424-ff79-4413-b982-848a1aae6662 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1422216184", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b27ae424-ff79-4413-b982-848a1aae6662 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 499 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1422216184", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1422216184', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '37096ef8-114d-449d-9672-1d0180c6f3c4'}]}}} Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:49:32.583213 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.590389 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.596624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b27ae424-ff79-4413-b982-848a1aae6662 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:32.596624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b27ae424-ff79-4413-b982-848a1aae6662 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024737 Aug 30 17:49:32.600916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2440/4639] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:32 2022] POST /compute/v2.1/servers => generated 687 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:32.736224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e15f93fb-9d10-4e01-92f3-579b113b637f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-853506926", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e15f93fb-9d10-4e01-92f3-579b113b637f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 499 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-853506926", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-853506926', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '37096ef8-114d-449d-9672-1d0180c6f3c4'}]}}} Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:49:32.749496 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.753227 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.756992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e15f93fb-9d10-4e01-92f3-579b113b637f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:32.758819 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e15f93fb-9d10-4e01-92f3-579b113b637f tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.027161 Aug 30 17:49:32.763469 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2441/4640] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:32 2022] POST /compute/v2.1/servers => generated 689 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:49:32.828615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbeeea5c-d741-4d17-b89c-41590b4572db", "tag": "5879cd82-e11f-4344-84c4-ea2847dc469a"}, {"server_uuid": "57863d0b-8440-4d79-85cd-535660810108", "name": "network-vif-deleted", "tag": "992220f8-9c6a-4441-b509-5a95fb310bee"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:32.864089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:32.868566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:32.869916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:32.918505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Creating event network-changed:5879cd82-e11f-4344-84c4-ea2847dc469a for instance bbeeea5c-d741-4d17-b89c-41590b4572db on n-h1-852771-11 Aug 30 17:49:32.920887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] Creating event network-vif-deleted:992220f8-9c6a-4441-b509-5a95fb310bee for instance 57863d0b-8440-4d79-85cd-535660810108 on n-h1-852771-11 Aug 30 17:49:32.939065 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-827c5139-ea9a-422c-a2aa-f5d8a3b1b38c req-da364a99-4600-4be4-b786-cb5c4ec6639f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.113136 Aug 30 17:49:32.942130 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2442/4641] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:49:32.953362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c426f73c-f64d-4a29-ac86-03d87a895741 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-278503095", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c426f73c-f64d-4a29-ac86-03d87a895741 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 753 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-278503095", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-278503095', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '37096ef8-114d-449d-9672-1d0180c6f3c4'}]}}} Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:32.966139 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:32.971632 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:32.976939 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:32.976939 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:32.993934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c426f73c-f64d-4a29-ac86-03d87a895741 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:32.998056 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c426f73c-f64d-4a29-ac86-03d87a895741 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.053866 Aug 30 17:49:33.000640 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2443/4642] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:32 2022] POST /compute/v2.1/servers => generated 1197 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 17:49:33.012229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:33.019215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] [instance: 57863d0b-8440-4d79-85cd-535660810108] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:33.084645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:33.091330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:33.096368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:33.102777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90d241f3-2318-4342-91ca-0f5ecbc3fe59 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1266 microversion: 2.1 time: 0.630516 Aug 30 17:49:33.102912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:33.105952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:33.107682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:33.108155 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2200/4643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:32 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1266 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:33.111049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:33.183339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] HTTP exception thrown: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Request method failure captured: Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 HTTP/1.1 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk1u46bpwu1yf4wZtnuB7HfnRfk2PtznqPiyNs0ZM4cdttqLg503OgMVDt5RUj6USXOJ8y7aTzDiSzEnEMBjE6Wg4kIh3NGoHSonK1yTPnntZa4tqyn63MTrQwk4_A4A04dWot0B2FM1U4Fx6ymhceo7oYAzB8cer8svhzzfH7TMy30 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/13ffe9c2af074cbf9bd155965e0e25fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_13ffe9c2af074cbf9bd155965e0e25fd"}]}] Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 13ffe9c2af074cbf9bd155965e0e25fd Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473570859 Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d802a95a947c44c38772ebf0deb363ac Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ListServersNegativeTestJSON-473570859-project Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '57863d0b-8440-4d79-85cd-535660810108'} Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.187257 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. Aug 30 17:49:33.199583 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.207375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] Returning 404 to user: Instance 57863d0b-8440-4d79-85cd-535660810108 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:33.211714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1757ac37-ba96-424f-ae1e-d725aba79eb4 tempest-ListServersNegativeTestJSON-473570859 tempest-ListServersNegativeTestJSON-473570859-project] 10.222.0.50 "GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108" status: 404 len: 111 microversion: 2.1 time: 0.201482 Aug 30 17:49:33.214757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2444/4644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:33 2022] GET /compute/v2.1/servers/57863d0b-8440-4d79-85cd-535660810108 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:33.621880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc49e851-bf21-4970-8da0-337da2fc0770 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-631149959", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc49e851-bf21-4970-8da0-337da2fc0770 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 1265 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-631149959", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "37096ef8-114d-449d-9672-1d0180c6f3c4"}]}} Aug 30 17:49:33.628170 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-631149959', 'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '37096ef8-114d-449d-9672-1d0180c6f3c4'}]}}} Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.630885 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:49:33.632306 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:49:33.636801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 17:49:33.636801 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.636801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc49e851-bf21-4970-8da0-337da2fc0770 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:33.636801 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc49e851-bf21-4970-8da0-337da2fc0770 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012530 Aug 30 17:49:33.643849 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2201/4645] 10.222.0.50 () {60 vars in 1148 bytes} [Tue Aug 30 17:49:33 2022] POST /compute/v2.1/servers => generated 2221 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 17:49:33.645148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:33.645837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 7ee5123e-2826-4ae9-bd1b-d706894fe9be] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:33.662144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] HTTP exception thrown: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/7ee5123e-2826-4ae9-bd1b-d706894fe9be/metadata/test2 HTTP/1.1 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '7ee5123e-2826-4ae9-bd1b-d706894fe9be', 'id': 'test2'} Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:33.675693 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:33.680839 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:33.680839 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:33.680839 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. Aug 30 17:49:33.680839 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:33.681435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 404 to user: Instance 7ee5123e-2826-4ae9-bd1b-d706894fe9be could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:33.683260 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-447b34bb-ab5f-406a-a122-1c7aa5fd13c7 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/7ee5123e-2826-4ae9-bd1b-d706894fe9be/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.042398 Aug 30 17:49:33.686651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2445/4646] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 30 17:49:33 2022] GET /compute/v2.1/servers/7ee5123e-2826-4ae9-bd1b-d706894fe9be/metadata/test2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:49:33.703589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:33.704098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:33.707190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:33.740093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:33.740613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:33.741066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:33.741805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:33.742270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:33.742705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:33.831159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:49:34.100351 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-20f13a41-921d-49b0-bcda-38ee0372bc75 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 204 len: 0 microversion: 2.1 time: 0.401263 Aug 30 17:49:34.112367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:34.114171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:34.116418 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2202/4647] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:49:33 2022] DELETE /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:49:34.130875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:34.132688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:34.136387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:34.137730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:34.140295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:34.144279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:34.146738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:34.147579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:34.163159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:34.168360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:34.172299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:34.173310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:34.173951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:34.174574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:34.570821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:34.581485 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a51d21c5-8017-4c6c-a27f-b1163b37e348 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 0.454867 Aug 30 17:49:34.582856 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2203/4648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:34 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:35.554372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:35.571717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc7c81d9-3ca6-4377-a791-0b1f93b6c82d tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1526 microversion: 2.1 time: 1.464408 Aug 30 17:49:35.574715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2446/4649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:34 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1526 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:35.603291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:35.603971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:35.612681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:35.613444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:35.614446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:35.615378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:35.616008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:35.616589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:35.852195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:35.860228 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30f252c6-8c3a-4604-b3fa-3f0bef4ba700 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 0.261505 Aug 30 17:49:35.872047 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2204/4650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:35 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:36.255063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc6827c-1cee-497a-8e02-02e2afb03d34", "tag": "d635be21-9362-49ff-a07b-f78b0107148b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:36.277602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:36.281191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:36.282007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:36.319349 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] Creating event network-changed:d635be21-9362-49ff-a07b-f78b0107148b for instance dcc6827c-1cee-497a-8e02-02e2afb03d34 on n-h2-852771-11 Aug 30 17:49:36.332844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-502831ef-a3f4-4532-b17e-f9c04f1356a8 req-2408c137-6a6d-4ef0-a97e-31198f931981 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079905 Aug 30 17:49:36.334789 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2447/4651] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:36.597243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:36.598128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:36.610171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:36.610741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:36.611033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:36.611959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:36.612440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:36.612881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:36.888274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:36.889465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:36.899537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:36.902881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:36.903619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:36.904233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:36.905116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:36.914523 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1a6946c-a325-4311-9f94-637e47bc6865 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1526 microversion: 2.1 time: 0.322359 Aug 30 17:49:36.915365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:36.917539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:36.918507 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2205/4652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:36 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1526 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:37.149233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:37.438689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:37.493630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fa4808-c22f-4ce2-a6be-c650724fb309", "name": "network-vif-deleted", "tag": "5c68bdcb-43d4-4532-a677-775f1a973005"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:37.514452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:37.533258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:37.534041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:37.534637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:37.543159 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3b65390-8cee-4e60-b9e6-c76076f24f76 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 0.658420 Aug 30 17:49:37.546345 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2448/4653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:36 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:37.571500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] Creating event network-vif-deleted:5c68bdcb-43d4-4532-a677-775f1a973005 for instance 73fa4808-c22f-4ce2-a6be-c650724fb309 on n-h2-852771-11 Aug 30 17:49:37.582996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-755fb2d7-6d50-44d0-b24e-8047682fe60f req-215c3b7b-d506-4b34-8295-8939971253f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101669 Aug 30 17:49:37.589659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2206/4654] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:37.941755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:37.944751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:37.964499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:37.965348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:37.967793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:37.972340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:37.973168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:37.974069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:38.079686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:38.081753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:38.085176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:38.089799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lazy-loading 'fault' on Instance uuid 73fa4808-c22f-4ce2-a6be-c650724fb309 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:49:38.355691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2360a58044af78b153c1984413a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abef25db6be4e9aa95482c407dc586d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:38.358698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:38.378413 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-761b806e-3796-4ea5-9274-05ed57f450fd tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 200 len: 1314 microversion: 2.1 time: 0.439060 Aug 30 17:49:38.379677 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2449/4655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:37 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:38.570325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:38.571049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:38.625117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:38.629575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:38.630368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:38.632758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:38.636151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:38.638717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:39.082063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:39.092914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bacdbdb0-cfd2-4cb8-87b4-8ff340928992 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 0.530317 Aug 30 17:49:39.094210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2207/4656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:38 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:39.402522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:39.403186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] [instance: 73fa4808-c22f-4ce2-a6be-c650724fb309] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:39.428968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:39.429821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:39.438476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:39.439528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:39.440191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:39.445175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:39.474529 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] HTTP exception thrown: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Request method failure captured: Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 HTTP/1.1 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2WM-I2-MqJV_ukdHOz0CraMP0BFs5pH0chL0M-PeJ2DBgpNGSzxTK0tM452W0SRsek-bbdwVyhdJO0nei3LmHRja99SLoBMlJQhvVPIEW0ae4IVC4cxwVnCXKlfuiNoM8_3QZTChhKU8ZU54TbJTvyGA4lnovIlGz4zn9ClDkVVmM Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3abef25db6be4e9aa95482c407dc586d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3abef25db6be4e9aa95482c407dc586d"}]}] Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 3abef25db6be4e9aa95482c407dc586d Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1599145263 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 96d2360a58044af78b153c1984413a42 Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1599145263-project Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '73fa4808-c22f-4ce2-a6be-c650724fb309'} Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:39.481740 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. Aug 30 17:49:39.487417 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:49:39.489550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] Returning 404 to user: Instance 73fa4808-c22f-4ce2-a6be-c650724fb309 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:49:39.490973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac751782-2580-47d8-9823-3339a0107ef1 tempest-ServerMetadataNegativeTestJSON-1599145263 tempest-ServerMetadataNegativeTestJSON-1599145263-project] 10.222.0.50 "GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309" status: 404 len: 111 microversion: 2.1 time: 0.093230 Aug 30 17:49:39.491852 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2450/4657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:39 2022] GET /compute/v2.1/servers/73fa4808-c22f-4ce2-a6be-c650724fb309 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:49:40.115403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:40.116774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:40.166864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:40.187269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:40.188916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:40.190904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:40.194220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:40.196506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:40.738963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:40.751753 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b1323342-36b4-4769-8372-310007f11903 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 0.640979 Aug 30 17:49:40.768958 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2208/4658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:40 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:41.777339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:41.778142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:41.792365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:41.797646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:41.798360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:41.799309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:41.804702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:41.807444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:43.192764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc6827c-1cee-497a-8e02-02e2afb03d34", "name": "network-vif-plugged", "status": "completed", "tag": "d635be21-9362-49ff-a07b-f78b0107148b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:43.224414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:43.225164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:43.225603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:43.259252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] Creating event network-vif-plugged:d635be21-9362-49ff-a07b-f78b0107148b for instance dcc6827c-1cee-497a-8e02-02e2afb03d34 on n-h2-852771-11 Aug 30 17:49:43.276544 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e786efc9-894e-4a14-b59a-0c18abc3244f req-c590ffa4-5d65-4c62-bb0b-609d8bf85228 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085674 Aug 30 17:49:43.278416 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2209/4659] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:49:43.309371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:43.340441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4996f3a-28c1-47bb-b046-91f9a92c4dc5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 1.567476 Aug 30 17:49:43.345553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2451/4660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:41 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:44.366973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:44.367723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:44.384354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:44.384916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:44.385887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:44.386623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:44.387083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:44.387528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:45.572586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:45.584622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ebffb426-dd12-4544-8864-77ecb6046ebf tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1308 microversion: 2.1 time: 1.221760 Aug 30 17:49:45.593773 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2210/4661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:44 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1308 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:46.619580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:46.620607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:46.647680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:46.648372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:46.649005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:46.649903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:46.660299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:46.661189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:47.413357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:47.422602 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd39db10-caf0-44f0-b6b3-01e523aef864 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1488 microversion: 2.1 time: 0.811895 Aug 30 17:49:47.456219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2452/4662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:46 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1488 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:47.719387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-378868584", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:47.861069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:49:49.879955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1331622156", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:49:49.997048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] validate_networks() for [('d5b5dab7-4aa6-4b5f-9597-70dd85b5d1cf', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:49:50.135941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:49:50.136533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:49:50.137082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:49:50.137768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:49:50.138410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:49:50.164453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:50.164962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:50.165405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:50.168248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:50.168771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:50.169210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:50.251218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:49:50.269740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:49:50.313706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:49:50.317785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:49:50.408988 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-793a0921-f4ea-417a-977c-9188056280d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.698763 Aug 30 17:49:50.417195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2211/4663] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:49:50.423552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fbd0f855-714b-4a41-9564-e088616ed980 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:50.424497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fbd0f855-714b-4a41-9564-e088616ed980 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:50.687692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fbd0f855-714b-4a41-9564-e088616ed980 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:50.703606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fbd0f855-714b-4a41-9564-e088616ed980 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1208 microversion: 2.1 time: 0.284042 Aug 30 17:49:50.705135 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2212/4664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:50 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1208 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:51.096223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:49:51.097638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:49:51.098133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:49:51.098834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:49:51.112584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:49:51.171131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:51.173420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:51.173950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:51.178625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:51.180036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:51.180519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:51.250704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Getting quotas for project d45dcdf5ca3845ce89881e9fe215a084. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:49:51.285170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Getting quotas for user 3ac1df3fd32a4753ac0978c7d11b80fc and project d45dcdf5ca3845ce89881e9fe215a084. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:49:51.348579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:49:51.351047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:49:51.489747 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fbe53e1-51b4-455e-ac27-f7fa3945ec35 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.917707 Aug 30 17:49:51.493740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2453/4665] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:49:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:49:51.503585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07692cc0-f048-44ab-82f8-f85bbe526c52 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:51.505012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07692cc0-f048-44ab-82f8-f85bbe526c52 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:51.729817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f23fda33-e92f-4116-8261-ad0b307c25a2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:51.730770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f23fda33-e92f-4116-8261-ad0b307c25a2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:51.905087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07692cc0-f048-44ab-82f8-f85bbe526c52 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:51.913377 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07692cc0-f048-44ab-82f8-f85bbe526c52 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1214 microversion: 2.1 time: 0.413988 Aug 30 17:49:51.920338 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2213/4666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:51 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1214 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:52.227872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f23fda33-e92f-4116-8261-ad0b307c25a2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:52.276840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f23fda33-e92f-4116-8261-ad0b307c25a2 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1208 microversion: 2.1 time: 0.550192 Aug 30 17:49:52.281635 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2454/4667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:51 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1208 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:52.941978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:52.943268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:52.969594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:52.971571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:52.972301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:52.974053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:52.976975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:52.978136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:53.306245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:53.307157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:53.327431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:53.337287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:53.338883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-859e4339-4c0e-4de7-88a2-86c4671f48c3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1218 microversion: 2.1 time: 0.400291 Aug 30 17:49:53.340601 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2214/4668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:52 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1218 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:53.343315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:53.344494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:53.348845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:53.349669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:53.350572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:53.792786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:53.805591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57f10e2f-ccc8-4ade-a140-0881c8f91f82 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1278 microversion: 2.1 time: 0.507018 Aug 30 17:49:53.810612 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2455/4669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:53 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1278 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:54.361420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:54.362119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:54.375526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:54.377602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:54.378889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:54.388570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:54.389315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:54.391705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:54.642622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:54.691774 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4fe687e5-f40a-4656-baab-5e7a7a614491 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1284 microversion: 2.1 time: 0.318937 Aug 30 17:49:54.693742 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2215/4670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:54 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:54.840339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:54.842242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:54.864917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:54.866261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:54.870675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:54.871718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:54.872495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:54.873098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:55.075339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:55.090228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-29334121-0247-44eb-aeda-3e3168d4f7e5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1266 microversion: 2.1 time: 0.258292 Aug 30 17:49:55.093163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2456/4671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:54 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:55.726063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:55.728877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:55.749697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:55.756157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:55.757537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:55.762002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:55.764368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:55.765692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:56.001688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:56.022447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e717c78-5652-461e-ab50-2da253e17e5d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1272 microversion: 2.1 time: 0.309069 Aug 30 17:49:56.039511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2216/4672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:55 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:56.116612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:56.118066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:56.122531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:56.144064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:56.148294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:56.148782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:56.152511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:56.153000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:56.153803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:57.049445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:57.050340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:57.071873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:57.073778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:57.076369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:57.082079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:57.082778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:57.085973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:57.818533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:57.847515 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ac0e3f4-680c-4966-b733-87a35eaee733 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 1.735104 Aug 30 17:49:57.852285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2457/4673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:56 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:58.138302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:49:58.151422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:49:58.158248 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b54341c3-a110-4143-9572-1ad3521fb1ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1272 microversion: 2.1 time: 1.114858 Aug 30 17:49:58.162251 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2217/4674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:57 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1272 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:49:58.874343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:58.874968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:58.892198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:58.897647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:58.899203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:58.900555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:58.907146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:58.909336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:59.185963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:49:59.187251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:49:59.198119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:59.198977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:59.199819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:49:59.201548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:49:59.202261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:49:59.203533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:00.086475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:00.128759 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8efeec9c-5747-4c14-babe-94be2276e132 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 1.240370 Aug 30 17:50:00.147258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2458/4675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:58 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:00.217479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:00.517169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:00.547232 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2eef8ec-9330-4ca6-86b3-a3aa01a270ca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 1.369062 Aug 30 17:50:00.549024 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2218/4676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:49:59 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:00.834708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:00.835336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:00.854869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:00.857470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:00.859984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:00.862105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:00.869712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:00.870440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:00.976713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3153377-9e4d-46ca-85e7-418d91d10fd1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/ips" status: 200 len: 146 microversion: 2.1 time: 0.146824 Aug 30 17:50:00.985752 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2459/4677] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:50:00 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/ips => generated 146 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:01.154511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:01.155162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:01.168730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:01.169611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:01.173105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:01.174384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:01.180551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:01.183991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:01.573034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:01.574523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:01.580303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:01.595927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:01.596447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:01.602575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:01.605542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:01.607579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:01.608517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:01.909904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:01.943422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:01.952686 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-198c1f44-59b6-4082-92df-569cd99ab11f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.802722 Aug 30 17:50:01.957374 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2219/4678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:01 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:02.266434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:02.522841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:02.546146 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e510e3a-9147-43b3-be75-86b0cf4fadd3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.980706 Aug 30 17:50:02.560927 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2460/4679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:01 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:02.749367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a31d640d-5870-450c-82d0-597ada07a7f9 tempest-ComputeTenantNetworksTest-1532192322 tempest-ComputeTenantNetworksTest-1532192322-project] Calling method '.version_select at 0x7f2d9cd02040>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:02.848892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8eed3e8-91f2-4f8c-88b3-37ea10002105", "tag": "9c6af454-d19b-4e59-a1b2-160575bbc26f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:02.885188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:02.886522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:02.889624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:02.929668 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] Creating event network-changed:9c6af454-d19b-4e59-a1b2-160575bbc26f for instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 on n-h2-852771-11 Aug 30 17:50:02.945695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-896a4734-aa6f-4c18-9e0c-59c219e28271 req-ad0b6df5-fd86-4e6b-ae1e-f4e903a49cff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102541 Aug 30 17:50:02.946739 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2461/4680] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:02.981566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:02.982647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:02.998659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:03.001434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:03.002604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:03.004047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:03.004650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:03.007082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:03.601890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:03.614859 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d2c38a42-a80b-48cd-9d14-985a093d0305 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.640273 Aug 30 17:50:03.619760 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2462/4681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:02 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:03.643979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:03.645130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:03.655864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:03.656713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:03.657409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:03.658964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:03.680040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:03.686405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:03.920339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:03.936344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a43e7ec7-88a0-4b4c-aaf2-34c2acb06519 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.313044 Aug 30 17:50:03.943887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2463/4682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:03 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:04.621962 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a31d640d-5870-450c-82d0-597ada07a7f9 tempest-ComputeTenantNetworksTest-1532192322 tempest-ComputeTenantNetworksTest-1532192322-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 2.193105 Aug 30 17:50:04.632206 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2220/4683] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 30 17:50:02 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:04.637674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e29d114-b0af-4987-914f-5b1980ef8625 tempest-ComputeTenantNetworksTest-1532192322 tempest-ComputeTenantNetworksTest-1532192322-project] Calling method '.version_select at 0x7f2d989cbdc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:04.641351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:04.642186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:04.666561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:04.668647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:04.678681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:04.679165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:04.682420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:04.683100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:04.683790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:05.204817 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e29d114-b0af-4987-914f-5b1980ef8625 tempest-ComputeTenantNetworksTest-1532192322 tempest-ComputeTenantNetworksTest-1532192322-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks/a8e54199-8df3-494a-9715-d9b5e388d525" status: 200 len: 139 microversion: 2.1 time: 0.573593 Aug 30 17:50:05.214848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2464/4684] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:50:04 2022] GET /compute/v2.1/os-tenant-networks/a8e54199-8df3-494a-9715-d9b5e388d525 => generated 139 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:05.221305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1214bbf8-0ff3-4b67-bf23-187079173f1f"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:05.230258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:05.267088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:05.271878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:05.273703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:05.276314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:05.279365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:05.280931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:05.879739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3992eef1-5f6d-4a47-b74d-2062702874c5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670152 Aug 30 17:50:05.881763 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2465/4685] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:50:05 2022] POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:05.890461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:05.891660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:05.900216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:05.901171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:05.901704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:05.902487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:05.902950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:05.903651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:06.193115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:06.203452 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5929349-de85-4bbf-ba2e-7aa9a931cc72 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 1.567290 Aug 30 17:50:06.206930 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2221/4686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:04 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:06.213561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de7af36-70e0-4cb7-bc48-46ef1b5e20d9", "tag": "8cd54b83-bf1d-4f56-b9d7-027c360d5fb6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:06.240900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:06.241584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:06.242281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:06.268147 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] Creating event network-changed:8cd54b83-bf1d-4f56-b9d7-027c360d5fb6 for instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 on n-h2-852771-11 Aug 30 17:50:06.289516 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8919c7e6-64cd-42f1-80df-71b919d30a51 req-9f9cbaae-9cfa-4270-b65e-79c4613401fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081098 Aug 30 17:50:06.297048 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2222/4687] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:07.087731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:07.116003 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-618228ad-c1cb-4550-b6cc-98ec29a849f3 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 1.232889 Aug 30 17:50:07.116811 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2466/4688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:05 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:07.231597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:07.232303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:07.250342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:07.250841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:07.251285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:07.252030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:07.252488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:07.252910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:07.735250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:07.748018 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a20a083d-b0c1-4bd1-b893-5f783fc9fa56 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.521266 Aug 30 17:50:07.748621 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2223/4689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:07 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:07.843692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1902401157", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1ea0bdad-b124-4618-b692-9b0b34259d39"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:07.952621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] validate_networks() for [('1ea0bdad-b124-4618-b692-9b0b34259d39', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:50:08.147362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:08.148027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:08.204104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:08.204655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:08.205110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:08.205915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:08.206318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:08.206748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:09.724260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:50:09.725432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:50:09.726259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:50:09.727207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:50:09.727955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:50:09.768465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:09.770648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:09.772076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:09.773790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:09.775307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:09.776245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:09.794262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:09.795309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:09.807447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-81b71b5c-e9ec-4e94-86fa-1b9fb6377d68 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 1.665169 Aug 30 17:50:09.814619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2224/4690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:08 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:09.820569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Getting quotas for project 2254c0ecde294172976bdda72a4a8a4a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:50:09.823855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:09.824617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:09.832558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Getting quotas for user d8af3374fab740e6b2f1274763007351 and project 2254c0ecde294172976bdda72a4a8a4a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:50:09.852395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Going to run 2 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:50:09.856330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: c03916fb-c9be-4f17-b6eb-0743390290ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:09.873343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:09.873840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:09.883102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:09.883969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:09.889372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:09.889858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:09.903742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=c03916fb-c9be-4f17-b6eb-0743390290ed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:10.049443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b6b22df-ca5e-4ac7-8a6d-45dbab66ef7c tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.621996 Aug 30 17:50:10.060599 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2467/4691] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:50:10.068884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:10.092466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:10.095494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Searching by: {'deleted': False, 'project_id': '2254c0ecde294172976bdda72a4a8a4a'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:50:10.137210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:10.137987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:10.138978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:10.140655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:10.145253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:10.146801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:10.202036 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a65bca3d-b618-47c4-a4eb-bd4072967563 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.137103 Aug 30 17:50:10.210037 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2468/4692] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:50:10 2022] GET /compute/v2.1/servers => generated 677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:10.225205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1a7bb77-66ac-4d92-8424-5b23c9ed8624 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:10.229914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1a7bb77-66ac-4d92-8424-5b23c9ed8624 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:10.346690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1a7bb77-66ac-4d92-8424-5b23c9ed8624 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:10.354664 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1a7bb77-66ac-4d92-8424-5b23c9ed8624 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1220 microversion: 2.1 time: 0.137914 Aug 30 17:50:10.367985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2469/4693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:10 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:10.458299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:10.471939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8a7687e-5c18-440a-a36e-de543fffde35 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.655048 Aug 30 17:50:10.478955 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2225/4694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:09 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:10.833249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:10.839357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:10.874110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:10.878095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:10.880068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:10.881084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:10.884447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:10.887112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:11.378257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d6a3f18-4df6-41f2-943e-f09794a30ec1 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:11.379587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d6a3f18-4df6-41f2-943e-f09794a30ec1 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:11.841362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:11.867682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e4a21af-f597-44c7-9700-d5b5588aa91a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 1.029837 Aug 30 17:50:11.884400 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2470/4695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:10 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:11.904592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:11.909100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:11.924417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:11.926859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:11.939684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:11.941054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:11.941761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:11.942420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:12.523930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:12.545827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59b7951d-6cd1-4aaf-9b07-96a38dcdd9db tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.648782 Aug 30 17:50:12.546577 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2471/4696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:11 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:12.890640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:12.892555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:12.904740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:12.912333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:12.913379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:12.917569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:12.918527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:12.921962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:13.197839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d6a3f18-4df6-41f2-943e-f09794a30ec1 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:13.231142 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d6a3f18-4df6-41f2-943e-f09794a30ec1 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1220 microversion: 2.1 time: 1.856636 Aug 30 17:50:13.239087 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2226/4697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:11 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1220 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:13.570147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:13.570695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:13.592366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:13.593066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:13.593684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:13.598178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:13.598837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:13.599463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:14.246713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:14.267699 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e67c7700-3168-48cf-8502-a8cf8c805688 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 1.370310 Aug 30 17:50:14.269122 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2472/4698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:12 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:14.286823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:14.287751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:14.340708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:14.341218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:14.344676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:14.345495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:14.346958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:14.347441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:14.534991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:14.549348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1b7ec87-1442-47f2-bfc6-3284e5a9e948 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1278 microversion: 2.1 time: 0.275314 Aug 30 17:50:14.563418 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2473/4699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:14 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:14.792016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:14.803218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e23226c7-c281-4044-ad0d-da44f103e94b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 1.237763 Aug 30 17:50:14.824413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2227/4700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:13 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:15.299790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:15.300474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:15.350598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:15.355711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:15.359768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:15.364646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:15.366533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:15.370682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:15.584931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:15.585822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:15.608190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:15.608826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:15.609556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:15.634755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:15.637121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:15.640250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:16.074522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:16.096107 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da95fb13-13f5-4d34-9802-f83e4502fde6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.801255 Aug 30 17:50:16.103219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2474/4701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:15 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:16.116423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:16.120184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:16.163087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:16.163887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:16.164078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:16.172872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:16.174915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:16.175471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:16.187315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:16.226437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55183d28-7d81-4de1-93f1-93fd0557fab5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1278 microversion: 2.1 time: 0.657095 Aug 30 17:50:16.231870 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2228/4702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:15 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1278 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:16.579807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8eed3e8-91f2-4f8c-88b3-37ea10002105", "name": "network-vif-plugged", "status": "completed", "tag": "9c6af454-d19b-4e59-a1b2-160575bbc26f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:16.637044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:16.637544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:16.637981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:16.705867 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] Creating event network-vif-plugged:9c6af454-d19b-4e59-a1b2-160575bbc26f for instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 on n-h2-852771-11 Aug 30 17:50:16.726800 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-905c1782-9eb2-4143-9b2e-6ff72c8a3385 req-8fc28fc8-6262-41ae-b11f-7052ab6ffa27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149346 Aug 30 17:50:16.727382 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2229/4703] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:16.758284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:16.785005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba8b4f28-02a3-40cc-b65e-f2ca47c9fe67 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.677402 Aug 30 17:50:16.796761 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2475/4704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:16 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:17.126911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:17.127930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:17.153481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.153980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.154417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:17.155147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.178877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.179523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:17.249776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:17.250953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:17.272098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.279426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.288075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:17.288923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.289411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.297523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:17.692373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:17.706234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4559c822-f1a3-478d-ae2a-ecd3b27a71ee tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.582909 Aug 30 17:50:17.708745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2230/4705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:17 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:17.751126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:17.761602 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-486ca38e-f992-45b3-b5b8-1e9c173ba50b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.515694 Aug 30 17:50:17.764278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2476/4706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:17 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:17.822094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:17.823097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:17.842082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.843107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.845982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:17.848186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:17.851602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:17.854042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:18.496124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:18.519859 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9a7cc7d-2a5c-457f-a1fb-b9effd2f91ca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1308 microversion: 2.1 time: 0.701870 Aug 30 17:50:18.523146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2231/4707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:17 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:18.732700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:18.733745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:18.747959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:18.749569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:18.750571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:18.752973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:18.753671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:18.755170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:18.785347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:18.787778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:18.815392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:18.817613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:18.819878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:18.825815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:18.827497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:18.828232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:19.277577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:19.293541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-54d27c9e-cf34-4724-a29a-4448c02a8c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.564924 Aug 30 17:50:19.294961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2477/4708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:18 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:19.501704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de7af36-70e0-4cb7-bc48-46ef1b5e20d9", "name": "network-vif-plugged", "status": "completed", "tag": "8cd54b83-bf1d-4f56-b9d7-027c360d5fb6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:19.537956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:19.538452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:19.551514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:19.598880 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] Creating event network-vif-plugged:8cd54b83-bf1d-4f56-b9d7-027c360d5fb6 for instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 on n-h2-852771-11 Aug 30 17:50:19.621581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8997abb6-64a3-4b0c-8c4d-5661eb4c8255 req-43503bcf-8f3b-48c3-860e-484236dabb7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123867 Aug 30 17:50:19.625435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2478/4709] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:19.657815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:19.658992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:19.680987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:19.681610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:19.682058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:19.688617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:19.689322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:19.691545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.180040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:20.230752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:20.239755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cd57d8a-7337-410b-831c-f31135e64353 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1489 microversion: 2.1 time: 0.612783 Aug 30 17:50:20.240366 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2479/4710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:19 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1489 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:20.304554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:20.309457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:20.322957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.323459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.323926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.329236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.331731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.335319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.365886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:20.374914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d7e4b72-eef5-4b0e-aed9-bdfe31eeaaa8 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 1.593971 Aug 30 17:50:20.386199 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2232/4711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:18 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:20.394046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:20.408795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:20.416498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:20.433924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.436503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.443034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.444046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.444660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.445193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.711291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:20.723287 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84f7d316-e13a-4953-a0d9-fbbe21d9b25f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1488 microversion: 2.1 time: 0.451152 Aug 30 17:50:20.726293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2480/4712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:20 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:20.751121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:20.755169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:20.776185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.777527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.779097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:20.781130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:20.783244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:20.784331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.031947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:21.044314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75496bfe-1e2a-4463-9dc3-9c4d2cc6e436 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1314 microversion: 2.1 time: 0.656672 Aug 30 17:50:21.047636 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2233/4713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:20 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:21.197140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:21.215419 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8486b7f5-c54b-4fc7-875c-b29dbfea440d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1489 microversion: 2.1 time: 0.468989 Aug 30 17:50:21.216081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2481/4714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:20 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1489 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:21.242124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:21.242675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:21.254087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.254767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.255366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.279717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.284408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.284873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.357376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:21.420184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:21.422506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:21.441749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.444177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.444702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.449026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.454070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.454842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.470705 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09cf6ef1-e681-4cb9-afb5-0bc8c9d8953b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 204 len: 0 microversion: 2.1 time: 0.231985 Aug 30 17:50:21.476490 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2234/4715] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:21 2022] DELETE /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:21.486567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b850c0-371f-4611-ad83-ada2705b18b2", "tag": "ede809be-f91a-4f2f-9124-a12d78db7cd2"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:21.500708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.501205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.501837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.560102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] Creating event network-changed:ede809be-f91a-4f2f-9124-a12d78db7cd2 for instance 97b850c0-371f-4611-ad83-ada2705b18b2 on n-h1-852771-11 Aug 30 17:50:21.569574 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-60e3e1f6-cdec-44cf-8d70-b6846074dbdd req-aa750617-e3cd-46a8-9390-250390bd2181 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088811 Aug 30 17:50:21.570988 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2235/4716] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:21.597928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:21.599177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:21.614663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.615955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.616634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.618145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:21.618831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:21.620558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:21.936705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:21.946843 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8443702-e813-4769-acac-9080fba2b882 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.538275 Aug 30 17:50:21.963867 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2482/4717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:21 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:22.075010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:22.080261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:22.081333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:22.082714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:22.097986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.100115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.100857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.101766 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5fc17b03-a703-4832-83ff-6031920b1792 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1495 microversion: 2.1 time: 0.514457 Aug 30 17:50:22.105712 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2236/4718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:21 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1495 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:22.105863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.106033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.106388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.320463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:22.330808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ba19d9a-8980-4f55-894d-d032fed9614d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1501 microversion: 2.1 time: 0.259399 Aug 30 17:50:22.344112 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2483/4719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:22 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:22.354329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:22.357074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:22.379644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.380440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.381296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.382230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.382847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.384180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.415158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lazy-loading 'flavor' on Instance uuid 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:50:22.518497 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8507fa8-9a2e-4f19-9530-2de13e802ddd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "POST /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9/action" status: 200 len: 32 microversion: 2.1 time: 0.169472 Aug 30 17:50:22.521506 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2237/4720] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:50:22 2022] POST /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:50:22.531329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:22.532673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:22.541063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.541961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.542394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.543107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.543580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.544009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.744585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:22.755975 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-930e38fa-49ae-42c6-8d30-ee2598797dbd tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.229391 Aug 30 17:50:22.757294 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2484/4721] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:22 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:22.970771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:22.971890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:22.981784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.982660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.983319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:22.984631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:22.986411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:22.987102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.131349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:23.133169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:23.145301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:23.146052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:23.146697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.147632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:23.148264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:23.149058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.212377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:23.376862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:23.387262 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30d17954-8b25-4e5c-93b4-cf09e1805a4c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1495 microversion: 2.1 time: 0.262353 Aug 30 17:50:23.397039 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2485/4722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:23 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1495 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:23.606475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03916fb-c9be-4f17-b6eb-0743390290ed", "tag": "c36baa9c-4d16-47a6-b1cb-35be4fca76d9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:23.650111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:23.650849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:23.653630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.685394 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] Creating event network-changed:c36baa9c-4d16-47a6-b1cb-35be4fca76d9 for instance c03916fb-c9be-4f17-b6eb-0743390290ed on n-h1-852771-11 Aug 30 17:50:23.699139 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0829b087-75f7-42df-baee-a8bd93ac7ab2 req-fc84d08d-a64d-49f6-b0f7-ba4e603e20e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105290 Aug 30 17:50:23.704618 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2486/4723] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:23.752619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:23.765962 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d63af4f-65cc-44f1-8a5d-36a76e6945d2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.802524 Aug 30 17:50:23.766982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2238/4724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:22 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:23.781974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:23.782946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:23.793463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:23.798505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:23.799157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.800697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:23.801326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:23.801917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:23.836237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:23.998988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:24.010729 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-375d378c-ad04-457c-9baf-383103089d9b tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.232145 Aug 30 17:50:24.012080 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2487/4725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:23 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:24.412551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:24.414073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:24.425851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:24.426778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:24.428106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:24.431791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:24.433096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:24.434285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:24.791104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:24.792411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:24.808379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:24.811408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:24.812638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:24.819226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:24.819931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:24.820985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:24.920419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:24.961857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1415fda-b4e6-4bbb-8518-6270697fff40 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 200 len: 1495 microversion: 2.1 time: 0.549450 Aug 30 17:50:24.964228 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2239/4726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:24 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 1495 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:25.052232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:25.055819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:25.063844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:25.071911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-27f55c56-7887-4a1d-b0b0-3ac79db499ec tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.285498 Aug 30 17:50:25.072694 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2488/4727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:24 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:25.080224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:25.080957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:25.081591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:25.083079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:25.083762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:25.085489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:25.452021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:25.465701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37faf01f-c360-4a04-8b79-294eb6cfdf15 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.422450 Aug 30 17:50:25.479530 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2240/4728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:25 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:25.759060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8eed3e8-91f2-4f8c-88b3-37ea10002105", "name": "network-vif-deleted", "tag": "9c6af454-d19b-4e59-a1b2-160575bbc26f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:25.771111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:25.771903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:25.773230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:25.801664 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] Creating event network-vif-deleted:9c6af454-d19b-4e59-a1b2-160575bbc26f for instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 on n-h2-852771-11 Aug 30 17:50:25.816407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2af9b492-e00d-40b7-8d3b-d642425b0760 req-09834b8e-e732-4a42-86bd-1fab7b7a5370 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063884 Aug 30 17:50:25.817552 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2489/4729] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:25.990463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:25.991194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:25.999368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.000345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.001124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.002058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.002804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.003236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.022276 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 HTTP/1.1 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c8eed3e8-91f2-4f8c-88b3-37ea10002105'} Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:26.025039 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:50:26.030673 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:26.033303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:50:26.034352 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed9c27b7-246f-4d11-8519-cdd0bc86604a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 404 len: 111 microversion: 2.1 time: 0.047862 Aug 30 17:50:26.053848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:26.054773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:26.059749 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2241/4730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:25 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:50:26.063904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.064631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.065244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.066835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.067465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.068104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.093464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:26.095131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:26.103345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.108178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.108806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.110180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.110797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.113723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.120404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:26.270392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:26.313098 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a5f3d6a-2d80-40a9-b462-3a6a958a52a3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 204 len: 0 microversion: 2.1 time: 0.270793 Aug 30 17:50:26.318868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2490/4731] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:26 2022] DELETE /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:26.329985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:26.332360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:26.349883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.351228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.351750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.352816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.353292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.353868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.437328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:26.449024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54e878d6-e9f4-4c68-89b5-e4bfbcd0459f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.359414 Aug 30 17:50:26.449606 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2242/4732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:26 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:26.489204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:26.490231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:26.496875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.497371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.497864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.498576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:26.499419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:26.500137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:26.612490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:26.632032 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc74718e-29a2-44ec-9286-1a83ec9f1f14 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1494 microversion: 2.1 time: 0.305839 Aug 30 17:50:26.636762 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2491/4733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:26 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1494 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:26.887029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:26.898063 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad790b03-402a-46f5-9406-2a3441905299 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.413580 Aug 30 17:50:26.898944 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2243/4734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:26 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:27.470607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:27.471425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:27.491719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.497029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.497795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.498935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.500398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.500948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.562486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b850c0-371f-4611-ad83-ada2705b18b2", "name": "network-vif-plugged", "status": "completed", "tag": "ede809be-f91a-4f2f-9124-a12d78db7cd2"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:27.601519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.603096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.608510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.638670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] Creating event network-vif-plugged:ede809be-f91a-4f2f-9124-a12d78db7cd2 for instance 97b850c0-371f-4611-ad83-ada2705b18b2 on n-h1-852771-11 Aug 30 17:50:27.646362 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ee49d2d0-758a-4501-99a6-a47538906ce5 req-87e1d636-5ec7-49a0-b216-e0f10668e9b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089247 Aug 30 17:50:27.647821 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2244/4735] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:27.670832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:27.673713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:27.715645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.721249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.725232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.729841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.730739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.731822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.777718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:27.812621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e18165d7-0591-4856-a4a3-8b19db89bc62 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.346450 Aug 30 17:50:27.816642 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2492/4736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:27 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:27.921344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:27.922208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:27.935138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.940024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.940572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:27.941319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:27.941921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:27.942353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.177936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:28.189187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0384eaf0-b1ce-4646-9832-1c65661810de tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.271638 Aug 30 17:50:28.204313 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2493/4737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:27 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:28.208695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:28.211116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:28.218698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.219454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.220085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.220337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8310cc7a-31c6-49ec-ad2d-9a169b1c01aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1494 microversion: 2.1 time: 0.559477 Aug 30 17:50:28.231710 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2245/4738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:27 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1494 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:28.264372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Going to try to stop instance {{(pid=122124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:50:28.322547 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-532c4172-a2d9-454f-bd9d-d8f67eb1f4b9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action" status: 202 len: 0 microversion: 2.1 time: 0.116104 Aug 30 17:50:28.336189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:28.337269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:28.341672 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2494/4739] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:50:28 2022] POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:50:28.346171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.346669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.347253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.348246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.348890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.349484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.601254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:28.611139 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d522fa9-dc76-426d-a62f-5a1f1bb42f1e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.283293 Aug 30 17:50:28.611761 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2246/4740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:28 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:28.839217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:28.842562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:28.867556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.867556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.867556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.873476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.873983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.877648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:28.909186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc6827c-1cee-497a-8e02-02e2afb03d34", "name": "network-vif-deleted", "tag": "d635be21-9362-49ff-a07b-f78b0107148b"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:28.927818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:28.944641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:28.951623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.005692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] Creating event network-vif-deleted:d635be21-9362-49ff-a07b-f78b0107148b for instance dcc6827c-1cee-497a-8e02-02e2afb03d34 on n-h2-852771-11 Aug 30 17:50:29.020002 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e54bab2b-c48f-48be-ab9e-536a21a13415 req-6687067a-3941-4e86-ab8c-a4ddb94973e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115191 Aug 30 17:50:29.021171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2247/4741] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:50:29.149712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:29.159955 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2eef6271-2c0a-41e3-af89-c37808abf6e2 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1320 microversion: 2.1 time: 0.326828 Aug 30 17:50:29.173382 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2495/4742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:28 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:29.221226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:29.222148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:29.250218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:29.250607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:29.260842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.264522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.265368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.266011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.266930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.267587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.269054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.274777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.278687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.279681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.280332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.303920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.408261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.412574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.428617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.430270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lazy-loading 'fault' on Instance uuid dcc6827c-1cee-497a-8e02-02e2afb03d34 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:50:29.505977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:29.515453 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfdaf477-4bda-40c3-80bb-d07764a7856c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 200 len: 1298 microversion: 2.1 time: 0.276846 Aug 30 17:50:29.516157 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2496/4743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:29 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 1298 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:29.574800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:29.586328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-047105d2-3cf1-4ea0-8ec2-26b45dfe3d2e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.374103 Aug 30 17:50:29.594896 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2248/4744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:29 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:29.634309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:29.635294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:29.643711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.644209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.644652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.645416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.645835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.646275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.712408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03916fb-c9be-4f17-b6eb-0743390290ed", "name": "network-vif-plugged", "status": "completed", "tag": "c36baa9c-4d16-47a6-b1cb-35be4fca76d9"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:29.723752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:29.724844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:29.725372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:29.744437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] Creating event network-vif-plugged:c36baa9c-4d16-47a6-b1cb-35be4fca76d9 for instance c03916fb-c9be-4f17-b6eb-0743390290ed on n-h1-852771-11 Aug 30 17:50:29.751788 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f013c652-3127-42c5-8923-adea0e8c33c5 req-9ddcf58b-9d7f-4b7a-8064-024d63d7076f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048817 Aug 30 17:50:29.752663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2249/4745] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:29.825638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:29.835911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6923e24-b8c1-4513-93a2-5aa7ae49c339 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.205620 Aug 30 17:50:29.836715 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2497/4746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:29 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:30.182753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:30.183471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:30.196635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.197318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.198045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.199061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.199670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.200339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.375556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:30.385146 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd2c020a-91c8-4132-a35d-6858e8734aa0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 200 len: 1508 microversion: 2.1 time: 0.206722 Aug 30 17:50:30.386282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2250/4747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:30 2022] GET /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:30.406798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:30.408029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: c03916fb-c9be-4f17-b6eb-0743390290ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:30.422133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.422905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.423580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.424484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.425177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.425791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.550920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:30.552062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:30.564831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.565676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.566807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.567971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.568691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.569226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.586545 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 HTTP/1.1 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'dcc6827c-1cee-497a-8e02-02e2afb03d34'} Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:30.589181 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:50:30.594907 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:30.595855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:50:30.597108 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c81a2ead-ac7f-4ece-8e00-97203d058ead tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 404 len: 111 microversion: 2.1 time: 0.060036 Aug 30 17:50:30.598511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2251/4748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:30 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:50:30.606894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:30.618611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34c6e896-d093-4623-be71-8eeba6e0f3a4 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed" status: 200 len: 1320 microversion: 2.1 time: 0.212781 Aug 30 17:50:30.619961 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2498/4749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:30 2022] GET /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:30.625011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:30.626937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:30.636601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.637988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.639582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.641647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:30.642367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:30.643015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:30.809667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-299332378", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:30.940820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:50:30.971656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:30.981504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2bcdbc0f-953e-4c0b-a9da-47baee398cd8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.370251 Aug 30 17:50:30.982108 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2252/4750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:30 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:30.998238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:30.998873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:31.014728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.015225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.015703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.016473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.016885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.017330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.355871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:31.365720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54c986ed-9145-4b58-ae72-f81df2512df3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.382398 Aug 30 17:50:31.366823 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2253/4751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:30 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:31.563914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:50:31.564447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:50:31.565242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:50:31.565720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:50:31.566322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:50:31.577447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.578014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.578676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.579541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.580070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.580560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.603409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:50:31.612108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:50:31.627926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:50:31.630245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:31.650680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:31.651299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: c03916fb-c9be-4f17-b6eb-0743390290ed] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:31.660580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.661041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.661583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.662374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.662825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.663434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.703207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e693e7f8-4bfa-41f3-b75a-51080443dadd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899323 Aug 30 17:50:31.706128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2499/4752] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:50:31.718176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f6a99eb8-f975-4192-8058-14afb69ad719 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:31.719100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f6a99eb8-f975-4192-8058-14afb69ad719 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:31.793908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f6a99eb8-f975-4192-8058-14afb69ad719 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:31.804383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f6a99eb8-f975-4192-8058-14afb69ad719 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1208 microversion: 2.1 time: 0.089635 Aug 30 17:50:31.805532 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2500/4753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:31 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:31.864450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:31.869273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:31.875703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6460879b-6aa9-419f-a126-e7c1ef9d7d85 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed" status: 200 len: 1509 microversion: 2.1 time: 0.230351 Aug 30 17:50:31.876236 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2254/4754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:31 2022] GET /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:31.896960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:31.897476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: c03916fb-c9be-4f17-b6eb-0743390290ed] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:31.904141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.904629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.905060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.906037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:31.906653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:31.907431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:31.938416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: c03916fb-c9be-4f17-b6eb-0743390290ed] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:32.015506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:32.017414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:32.020068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:32.034303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.035546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.036194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.039655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.041019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.041643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.074496 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2129e3b3-50ec-4767-84a8-a3e26af4513f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed" status: 204 len: 0 microversion: 2.1 time: 0.181966 Aug 30 17:50:32.079843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2501/4755] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:31 2022] DELETE /compute/v2.1/servers/c03916fb-c9be-4f17-b6eb-0743390290ed => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:32.087375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:32.088489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:32.095701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.096375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.096995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.098916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.098916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.099121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.132151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 97b850c0-371f-4611-ad83-ada2705b18b2] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:32.270441 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6f033067-c53e-4a9b-8918-d54022bdcc0f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2" status: 204 len: 0 microversion: 2.1 time: 0.188320 Aug 30 17:50:32.292618 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2502/4756] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:32 2022] DELETE /compute/v2.1/servers/97b850c0-371f-4611-ad83-ada2705b18b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:32.312656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:32.332072 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-353688af-afb8-4c3d-aaad-72351bdbae29 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.327564 Aug 30 17:50:32.338908 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2255/4757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:32 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:32.388866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:32.389566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:32.402531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.403022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.403456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.404187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.404636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.405060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.559209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-744969323", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1ea0bdad-b124-4618-b692-9b0b34259d39"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:32.640334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] validate_networks() for [('1ea0bdad-b124-4618-b692-9b0b34259d39', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:50:32.774274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:32.787919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ac7fc38-61f4-47ed-9c8c-7e9aa6a129b3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.401428 Aug 30 17:50:32.788626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2503/4758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:32 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:32.828069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:32.828845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:32.837515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.842569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.843139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:32.849297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:32.849297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:32.849297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.000952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:33.012986 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3cfd444-a088-4228-b4a3-49cc07f39f30 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1260 microversion: 2.1 time: 0.189955 Aug 30 17:50:33.023983 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2504/4759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:32 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:33.372468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:33.373092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:33.387058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.387889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.388700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.389657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.390588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.391189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.620184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:33.628715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87b8f965-42c7-4d85-8940-10d75784ad89 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.261575 Aug 30 17:50:33.630163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2505/4760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:33 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:33.799021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:50:33.801080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:50:33.801789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:50:33.802369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:50:33.804202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:50:33.813574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:33.814196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:33.829530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.830055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.830496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.831235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.836578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.836578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.842845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.848826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.849524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.850493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:33.851138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:33.852468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:33.915958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Getting quotas for project 2254c0ecde294172976bdda72a4a8a4a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:50:33.931144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Getting quotas for user d8af3374fab740e6b2f1274763007351 and project 2254c0ecde294172976bdda72a4a8a4a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:50:33.950946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Going to run 2 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:50:33.954857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:34.006358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=cf91f611-92f4-4ef9-a581-5f3b47a8e586,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:34.126865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-645ca118-93e5-4842-a5b1-073c5401f2ad tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.571577 Aug 30 17:50:34.127933 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2256/4761] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:50:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 17:50:34.135711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:34.136697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:34.143101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.143852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.144595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.145524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.146213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.146854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.224322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:34.234832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d563952-6a65-416e-838c-d6a070205cda tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.425752 Aug 30 17:50:34.240580 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2506/4762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:33 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:34.268957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:34.274479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:34.280525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:34.281910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Searching by: {'deleted': False, 'project_id': '2254c0ecde294172976bdda72a4a8a4a'} {{(pid=122124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:50:34.291987 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a112b3b-df7b-46c4-a217-61b7ce3d8f81 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1266 microversion: 2.1 time: 0.156180 Aug 30 17:50:34.303836 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2257/4763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:34 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:34.367828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.368334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.372612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.375028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.380039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.382479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.495503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.multi_cell_list [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:50:34.595694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-581812b2-00fd-47d9-a034-5d32a4bd6e72 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.347252 Aug 30 17:50:34.596877 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2507/4764] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 17:50:34 2022] GET /compute/v2.1/servers => generated 1335 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:34.635180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a06e08ff-f78a-437b-8b46-a87fed46f91b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:34.639747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a06e08ff-f78a-437b-8b46-a87fed46f91b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:34.647044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:34.653744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:34.654729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:34.670070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.671001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.673084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.674091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:34.676287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:34.678470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:34.908544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:34.921341 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6369bb59-36f1-48af-858d-48150b458de9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.272429 Aug 30 17:50:34.922490 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2508/4765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:34 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:34.931860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a06e08ff-f78a-437b-8b46-a87fed46f91b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:34.940095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a06e08ff-f78a-437b-8b46-a87fed46f91b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1217 microversion: 2.1 time: 0.332275 Aug 30 17:50:34.941541 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2258/4766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:34 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:35.278156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:35.280057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:35.289404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.289956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.290505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.291318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.291910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.292561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.317321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:35.318049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:35.331003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.331590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.333254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.334968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.335715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.336663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.552585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:35.563084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5cd95d7-77e4-4a7b-bf04-0f0e6cb8d001 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.303297 Aug 30 17:50:35.564344 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2509/4767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:35 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:35.657146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:35.675511 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ff4d9f3-004c-4f04-92f2-c4be2099900f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1266 microversion: 2.1 time: 0.363853 Aug 30 17:50:35.676108 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2259/4768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:35 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:35.943056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:35.944479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:35.958457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.962898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.963388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:35.965012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.965689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:35.966706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.969429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.970921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.977262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.977753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.978183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:35.979665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:35.980123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:35.980547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:36.292177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:36.300855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-945f8caa-0a79-48e9-85b5-150c3656b032 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1269 microversion: 2.1 time: 0.341958 Aug 30 17:50:36.301803 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2260/4769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:35 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1269 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:36.307417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b850c0-371f-4611-ad83-ada2705b18b2", "name": "network-vif-deleted", "tag": "ede809be-f91a-4f2f-9124-a12d78db7cd2"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:36.350584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:36.356281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:36.357041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:36.386392 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] Creating event network-vif-deleted:ede809be-f91a-4f2f-9124-a12d78db7cd2 for instance 97b850c0-371f-4611-ad83-ada2705b18b2 on n-h1-852771-11 Aug 30 17:50:36.400362 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3e49b67a-5cd2-4959-950e-959e12303382 req-f05a3afb-7ab1-4aa5-9b84-c0ba765ec0e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096799 Aug 30 17:50:36.403346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2261/4770] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:36.425417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:36.450448 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6de85edc-8aad-4d5e-9b6d-a2e6f65d1abb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.511880 Aug 30 17:50:36.464844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2510/4771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:35 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:36.588209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:36.589017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:36.613307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:36.613990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:36.614816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:36.616096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:36.620718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:36.628199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:36.699431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:36.701336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:36.722175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:36.729699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:36.731278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:36.732365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:36.737544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:36.738207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:37.464437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:37.479246 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07f54b88-2ba1-40d1-822b-c2b87b4bf1b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.784373 Aug 30 17:50:37.480224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2511/4772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:36 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:37.485852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:37.486637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:37.498846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:37.500120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:37.501190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:37.502226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:37.503280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:37.503968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:37.613161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:37.626929 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ecf4b8c8-e250-4154-b9bb-2565123114f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 1.044132 Aug 30 17:50:37.633562 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2262/4773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:36 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:37.654875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:37.657733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:37.659977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:37.666519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2d1f47c-66b5-477a-a184-4e0af67a4910 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1275 microversion: 2.1 time: 0.184877 Aug 30 17:50:37.667288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2512/4774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:37 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:37.685401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:37.686873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:37.687671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:37.688547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:37.689165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:37.689879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.197779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:38.208505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a1a2885-c4b3-4bee-874c-575048d5e8ce tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.573107 Aug 30 17:50:38.224876 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2263/4775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:37 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:38.440976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03916fb-c9be-4f17-b6eb-0743390290ed", "name": "network-vif-deleted", "tag": "c36baa9c-4d16-47a6-b1cb-35be4fca76d9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:38.464760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.465969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.466586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.511442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:38.512836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:38.551613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.552194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.552659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.553411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.553873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.554390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.558028 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] Creating event network-vif-deleted:c36baa9c-4d16-47a6-b1cb-35be4fca76d9 for instance c03916fb-c9be-4f17-b6eb-0743390290ed on n-h1-852771-11 Aug 30 17:50:38.571829 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-16615a24-76b7-40bb-9797-aa581f66d923 req-2c903a99-ff93-4e7f-9938-b465faa6e61b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136236 Aug 30 17:50:38.572467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2513/4776] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:38.660175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:38.661412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:38.670593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.671820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.673180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.674815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.675388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.680133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.875649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:38.887183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-554b7151-5d9a-4f64-90af-b5f58b463647 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.233379 Aug 30 17:50:38.888014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2514/4777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:38 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:38.897390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:38.899389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:38.916666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.917182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.917741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.920218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:38.921158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:38.922021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:38.978302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:38.996059 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26d73462-cae8-4cb5-8cc9-0d4e09dd496a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.491921 Aug 30 17:50:38.998574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2264/4778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:38 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:39.021848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:39.032600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b7f21b9-12d8-45c0-887e-db27902829fd tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1275 microversion: 2.1 time: 0.143168 Aug 30 17:50:39.049983 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2515/4779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:38 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:39.231461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:39.232270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:39.247035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:39.249478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:39.250354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:39.252705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:39.252824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:39.253200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:39.911370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:39.912206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:39.937361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:39.938804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:39.939808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:39.942891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:39.943613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:39.944242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.116106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:40.133322 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-970eef9f-41a9-4d3f-be61-4cb7aa99209c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.907139 Aug 30 17:50:40.134273 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2265/4780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:39 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:40.145012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:40.145921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:40.158505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:40.159283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:40.160056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.162808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:40.163325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:40.165078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.331408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:40.342456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0887bd63-30ec-4aeb-89af-8486bb32d5ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.436411 Aug 30 17:50:40.343645 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2516/4781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:39 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:40.348456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:40.349283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:40.357369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:40.358115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:40.358719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.359889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:40.360924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:40.361816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.402171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:40.701252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:40.714398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad44b10a-a8f9-42da-b79e-f975f4405c5a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.369339 Aug 30 17:50:40.715887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2517/4782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:40 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:40.729778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f9fa80-6696-4130-ae72-7c3f0fee89b5", "tag": "3396c7df-b413-4567-b2ba-0ff25a91c612"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:40.778580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:40.779835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:40.780973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:40.798915 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] Creating event network-changed:3396c7df-b413-4567-b2ba-0ff25a91c612 for instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 on n-h2-852771-11 Aug 30 17:50:40.807129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ac26acad-6c1e-4c97-a312-f9df927e586c req-c212a7a0-358b-4165-9049-d544b8ecd806 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089165 Aug 30 17:50:40.808306 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2518/4783] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:41.089706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:41.098559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c7b9a3d-b5e8-4770-bb50-c71a4a431f32 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.962861 Aug 30 17:50:41.102195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2266/4784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:40 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:41.156484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:41.157422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:41.169379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.176728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.180211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.181193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.182380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.184463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.377990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:41.379870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:41.406013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.406549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.406997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.407749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.408206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.408641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.565987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:41.575407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9893649-b139-40fe-890a-47ab737b8237 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.422458 Aug 30 17:50:41.576044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2519/4785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:41 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:41.740925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:41.742093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:41.761451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.761951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.762400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.763115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:41.763603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:41.764033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:41.800790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:41.952457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:41.973801 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe988145-5104-4515-8c86-625fabe1e2d3 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.236619 Aug 30 17:50:41.989841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2520/4786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:41 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:42.111454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:42.131233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:42.132044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03b02f99-14ba-4ac7-af82-f0dacf89ac3d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.764474 Aug 30 17:50:42.133036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2267/4787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:41 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:42.147521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:42.169345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:42.170725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:42.172237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:42.174988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:42.177188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:42.177880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:42.462859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:42.476691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d23a24a7-4caf-4a38-9d65-89cf3cb839a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.349725 Aug 30 17:50:42.479906 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2521/4788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:42 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:42.606399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:42.609722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:42.619788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:42.620611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:42.621284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:42.622486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:42.623150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:42.623999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:42.943472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d14f24-be6c-4ed1-9433-dd071874211a", "tag": "857f12ea-45f3-4754-9361-d8abd8f43537"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:42.969863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:42.971037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:42.972064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.006060 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] Creating event network-changed:857f12ea-45f3-4754-9361-d8abd8f43537 for instance 69d14f24-be6c-4ed1-9433-dd071874211a on n-h1-852771-11 Aug 30 17:50:43.024966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-86eb625e-51d2-414b-af79-84535622c821 req-62a67523-36cf-4f37-81a3-fd4324b79c8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085757 Aug 30 17:50:43.027401 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2522/4789] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:43.045858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:43.049406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:43.066182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:43.068992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.069472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.075765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.076797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.078016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.081147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.256457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:43.273424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac42f6e8-8cd4-4567-bc66-895965c422cc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.670326 Aug 30 17:50:43.275035 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2268/4790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:42 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:43.289402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:43.297000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:43.330562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.335987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.340651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.343742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.352807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.353594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.810085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:43.822866 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3cf4607-57df-48fd-93e1-ad444fc14158 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.789874 Aug 30 17:50:43.825536 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2523/4791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:43 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:43.830870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:43.831731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:43.849328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.852261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.855551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.856525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:43.857251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:43.857861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:43.886847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:44.407357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:44.467971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:44.492337 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a827650f-0b95-463e-826a-61ad969df3f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.665480 Aug 30 17:50:44.492984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2524/4792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:43 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:44.517557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:44.518708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:44.535276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:44.535821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:44.542310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:44.543112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:44.543633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:44.544083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:44.572529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:44.588022 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76c52f78-a713-457c-bcc7-74cad9de720f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 1.310939 Aug 30 17:50:44.588630 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2269/4793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:43 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:44.848328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:44.848955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:44.867343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:44.867873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:44.869179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:44.870135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:44.870824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:44.871430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:44.943914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:45.519198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:45.536143 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1b377eb8-d3fb-4cd7-98b6-b595a0b9e086 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.691727 Aug 30 17:50:45.550332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2270/4794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:44 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:45.556351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf91f611-92f4-4ef9-a581-5f3b47a8e586", "tag": "dba021e1-113f-4d34-b55a-d4a13617ed19"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:45.575298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:45.578740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:45.580040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:45.580661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:45.584832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2982ee4-3bf0-45bb-83e2-d5b3cf3fd531 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 1.090710 Aug 30 17:50:45.588296 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2525/4795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:44 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:45.601582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:45.602371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:45.603290 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] Creating event network-changed:dba021e1-113f-4d34-b55a-d4a13617ed19 for instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 on n-h2-852771-11 Aug 30 17:50:45.617925 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-109a17ad-56bb-4640-b627-f3faf3a920a9 req-be9c2910-7dc6-4e3c-bb5f-d2c08477d698 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065835 Aug 30 17:50:45.618840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2271/4796] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:45.620538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:45.621429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:45.621970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:45.622827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:45.623378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:45.623948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:45.625278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:45.626137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:45.639540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:45.640256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:45.640870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:45.641738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:45.642350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:45.642936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:45.893504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:45.910447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-891047cc-19af-4595-914c-55b306b9f19b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.320649 Aug 30 17:50:45.911180 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2526/4797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:45 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:46.344397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:46.358425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1a54964-4ae2-4d99-bb6f-d4c90f9a8ca1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.737908 Aug 30 17:50:46.359525 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2272/4798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:45 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:46.399285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f9fa80-6696-4130-ae72-7c3f0fee89b5", "name": "network-vif-plugged", "status": "completed", "tag": "3396c7df-b413-4567-b2ba-0ff25a91c612"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:46.421862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.422577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.423177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.450682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] Creating event network-vif-plugged:3396c7df-b413-4567-b2ba-0ff25a91c612 for instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 on n-h2-852771-11 Aug 30 17:50:46.458188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5e287a25-331f-4ede-892d-e313dcd008dc req-393b82b9-c291-45d9-9dc3-c12d6ee389ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062795 Aug 30 17:50:46.460763 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2527/4799] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:46.561867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:46.562893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:46.571433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.572082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.572720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.573600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.574385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.575096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.608306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:46.609262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:46.615706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.616526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.617142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.618200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.618821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.619412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.815649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:46.825562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb6df7aa-9ff8-4d1d-97af-bec13e60994f tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.269075 Aug 30 17:50:46.826399 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2273/4800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:46 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:46.943120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:46.943896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:46.950677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.951164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.951624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.952585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:46.953137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:46.953811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:46.977169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:46.992314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:47.004428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9e13e87-4c65-4eb7-8f5a-c55e4b81b173 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.400251 Aug 30 17:50:47.005544 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2528/4801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:46 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:47.135519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:47.146567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4569f8d7-e170-44f8-9bab-f468633f1e5b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.214036 Aug 30 17:50:47.166185 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2274/4802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:46 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:47.383686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:47.384386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:47.392955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:47.393889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:47.394587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:47.395541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:47.399136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:47.400886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:47.848719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:47.849327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:47.868234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:47.883986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:47.884723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:47.885900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7aa09ab9-95e0-47ef-a69a-74367b94770c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1725 microversion: 2.1 time: 0.506664 Aug 30 17:50:47.888646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:47.890073 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2529/4803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:47 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:47.891805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:47.893723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:47.894434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.026881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:48.027990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:48.044077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.044955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.045909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.048275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.061987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.063931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.206026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:48.220877 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0afdf4f-4dff-44ed-bfe7-5827efd48928 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.377324 Aug 30 17:50:48.223056 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2275/4804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:47 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:48.258269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:48.262940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:48.280496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.280996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.281431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.282141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.282598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.293107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.493212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:48.508309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-170b4540-e1a4-4e93-ab88-0091c38e6418 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.484994 Aug 30 17:50:48.509240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2530/4805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:48 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:48.606036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:48.620161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d76351fe-a054-493f-b37d-48d05fb84237 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1308 microversion: 2.1 time: 0.375507 Aug 30 17:50:48.637480 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2276/4806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:48 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:48.918415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:48.919909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:48.930809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.933788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.934461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:48.935429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:48.937171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:48.939859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.149595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:49.158526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09dbd45a-38ce-45f7-9a1f-365804c8d694 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1702 microversion: 2.1 time: 0.246468 Aug 30 17:50:49.159993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2531/4807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:48 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1702 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:49.181428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:49.192583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.193129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.193779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.240259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:50:49.248464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:49.251214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:49.273534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.284573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.285344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.294137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.295134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.296936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.373611 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57890792-e28e-40cf-bb39-8707f624fea0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action" status: 202 len: 0 microversion: 2.1 time: 0.196967 Aug 30 17:50:49.378354 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2277/4808] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:50:49 2022] POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:50:49.396665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:49.399709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:49.412111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.415830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.418070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.419238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.421480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.422180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.597880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:49.608238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed6a62f9-5b4d-4d9e-8ae1-e0b8818c2a9b tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.363263 Aug 30 17:50:49.609465 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2532/4809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:49 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:49.615176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d14f24-be6c-4ed1-9433-dd071874211a", "name": "network-vif-plugged", "status": "completed", "tag": "857f12ea-45f3-4754-9361-d8abd8f43537"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:49.626840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.627881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.628710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.645842 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] Creating event network-vif-plugged:857f12ea-45f3-4754-9361-d8abd8f43537 for instance 69d14f24-be6c-4ed1-9433-dd071874211a on n-h1-852771-11 Aug 30 17:50:49.656737 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7c395268-9887-47ba-ad31-f9da80b773be req-6c9b4bc2-2b27-45d0-95fd-de64d8c911e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043084 Aug 30 17:50:49.658640 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2533/4810] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:49.672359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:49.675934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:49.704443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.711710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.712606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.714237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:49.716198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:49.719597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:49.979986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:49.986878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:49.989508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-128a620e-5aea-4035-871f-c9af72113da9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.328309 Aug 30 17:50:49.992243 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2534/4811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:49 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:49.997384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:49.998447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:50.005017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.005795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.006425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.007037 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3157160f-53ce-4874-885e-74464bbceff5 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1711 microversion: 2.1 time: 0.626977 Aug 30 17:50:50.008450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.008846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2278/4812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:49 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1711 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:50.009367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.009978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.290654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:50.319218 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-edec9580-b255-4e0a-a76a-cb0bbaebc1bd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1488 microversion: 2.1 time: 0.325442 Aug 30 17:50:50.320228 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2535/4813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:49 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1488 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:50.342827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:50.347872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:50.356435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.357131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.357743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.358872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.359787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.360424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.457189 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-acd0f539-135b-4c8b-9fa1-c6440326c0e9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "PUT /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1083 microversion: 2.1 time: 0.119390 Aug 30 17:50:50.458395 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2279/4814] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:50:50 2022] PUT /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1083 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:50.489782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:50.490906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:50.501878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.502999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.504342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.505575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.506349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.507410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.532332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:50.631834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:50.633326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:50.647211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.649775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.651664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.652891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.653596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.654362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.752010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:50.766488 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee8c7a96-d069-4eaf-84aa-12da38926532 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1509 microversion: 2.1 time: 0.283693 Aug 30 17:50:50.767558 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2536/4815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:50 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:50.792094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:50.792904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:50.800654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.801319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.801993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.806536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:50.807959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:50.809376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:50.861749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:50.891804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad3ec0ec-2430-4803-be3d-722d020d5595 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1317 microversion: 2.1 time: 0.245192 Aug 30 17:50:50.895496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2280/4816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:50 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:51.016572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:51.017262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:51.041120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.041942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.042622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.043719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.044354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.049696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.182178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:51.192026 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d006067-d605-416e-9722-e8dda064c738 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1509 microversion: 2.1 time: 0.407009 Aug 30 17:50:51.192625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2537/4817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:50 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:51.216613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:51.217236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:51.246445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.246957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.251123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.252715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.258393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.259313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.703011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:51.720784 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-740908e6-53cb-4d17-a92d-0b6b8eb4a206 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1711 microversion: 2.1 time: 0.519872 Aug 30 17:50:51.721941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2538/4818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:51 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1711 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:51.728002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:51.729073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:51.740771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.743804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.744429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.746445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.747092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.760197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.799696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:51.854781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:51.867720 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-918310b8-24e7-4cec-8c73-82fcb30e69b6 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.853686 Aug 30 17:50:51.870399 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2281/4819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:51 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:51.876854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf91f611-92f4-4ef9-a581-5f3b47a8e586", "name": "network-vif-plugged", "status": "completed", "tag": "dba021e1-113f-4d34-b55a-d4a13617ed19"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:51.891827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.892913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.893566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.913663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] Creating event network-vif-plugged:dba021e1-113f-4d34-b55a-d4a13617ed19 for instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 on n-h2-852771-11 Aug 30 17:50:51.930132 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-27e2932a-a44d-4bb9-892c-21dcf318a953 req-982a735a-436e-48f5-92be-864e741b38ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055712 Aug 30 17:50:51.938414 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2282/4820] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:51.954094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:51.956968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:51.976420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-388c2cc9-8e2f-43dc-8883-6e2fe3ac32e6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 204 len: 0 microversion: 2.1 time: 0.252322 Aug 30 17:50:51.977004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.980636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.980795 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2539/4821] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:51 2022] DELETE /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:51.983425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.984964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:51.985893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:51.986632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:51.987651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:51.988499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:52.004273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.004778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.005212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:52.005921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.006366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.008680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:52.354487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:52.363175 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f743476-935a-456d-831c-d13797458e6a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1506 microversion: 2.1 time: 0.422008 Aug 30 17:50:52.363801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2283/4822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:51 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:52.391581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:52.392324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:52.402842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.403620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.404355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:52.405772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.406489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.407133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:52.513988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:52.525690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71b31031-a425-4c9f-a10c-13a8ce20d1da tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1515 microversion: 2.1 time: 0.543534 Aug 30 17:50:52.526409 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2540/4823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:51 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1515 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:52.743421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:52.744068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:52.750556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.751523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.752034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:52.752963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:52.753491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:52.753998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:53.005059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:53.015596 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ca07917-f797-4ade-be46-e5d28b68bb8a tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1317 microversion: 2.1 time: 0.634001 Aug 30 17:50:53.029193 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2284/4824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:52 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:53.033909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:53.034660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:53.043725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:53.044635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:53.045459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:53.046883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:53.047830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:53.048686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:53.186666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:53.230653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8ab9a7a-9778-456d-8dd1-2afbb224547b tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1715 microversion: 2.1 time: 0.488425 Aug 30 17:50:53.234165 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2541/4825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:52 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1715 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:53.374937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:53.395777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62d63b93-7846-48de-b79b-4f101da39fe2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1507 microversion: 2.1 time: 0.364720 Aug 30 17:50:53.397444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2285/4826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:53 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:53.548226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:53.548864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:53.567579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:53.568106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:53.568693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:53.571073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:53.572540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:53.572989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.037113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:54.038364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:54.052184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:54.053203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:54.054448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.056691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:54.058798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:54.061038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.544965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:54.557854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-429ac3ad-77b3-477f-935a-aa61f96550a9 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1317 microversion: 2.1 time: 0.524905 Aug 30 17:50:54.558459 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2286/4827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:54 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:54.571324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:54.581346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:54.595799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:54.596821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:54.599751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.600946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:54.601957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:54.602588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.819371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:54.829233 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a57be8a8-6356-4f0c-b0fb-b308b96f35d3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 200 len: 1515 microversion: 2.1 time: 1.285228 Aug 30 17:50:54.835047 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2542/4828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:53 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 1515 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:54.841266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f9fa80-6696-4130-ae72-7c3f0fee89b5", "name": "network-vif-deleted", "tag": "3396c7df-b413-4567-b2ba-0ff25a91c612"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:54.879574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:54.880895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:54.884045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:54.894077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:54.915236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26ae1a18-aff7-47e9-9f50-7a93a0cf19f2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1487 microversion: 2.1 time: 0.348873 Aug 30 17:50:54.917198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2287/4829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:54 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1487 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:54.922967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] Creating event network-vif-deleted:3396c7df-b413-4567-b2ba-0ff25a91c612 for instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 on n-h2-852771-11 Aug 30 17:50:54.941457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-98a4b9e5-77f5-42b1-b724-38a90589ade3 req-12de678e-c3b3-4a66-bb25-c05f24029d3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104681 Aug 30 17:50:54.946143 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2543/4830] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:55.066536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-844548757", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:55.160161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] validate_networks() for [('d5b5dab7-4aa6-4b5f-9597-70dd85b5d1cf', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:50:55.581759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:55.582549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:55.597980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.598481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:55.598921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:55.603763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.604458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:55.604782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:55.844146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:50:55.844573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:50:55.845323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:50:55.845741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:50:55.846150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:50:55.862609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.863102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:55.867563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:55.868797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.871530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:55.872002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:55.900270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Getting quotas for project d45dcdf5ca3845ce89881e9fe215a084. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:50:55.906127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Getting quotas for user 3ac1df3fd32a4753ac0978c7d11b80fc and project d45dcdf5ca3845ce89881e9fe215a084. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:50:55.920192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:50:55.922520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:55.977409 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed164e0e-dba1-40d0-9f3f-c93d26686eca tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.920595 Aug 30 17:50:55.978903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2288/4831] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:50:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:50:55.985099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:55.985985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:55.995102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.996216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:55.997610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:55.998774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:55.999549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.000165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.037407 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 HTTP/1.1 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '54f9fa80-6696-4130-ae72-7c3f0fee89b5'} Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:56.047090 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79795be3-adbb-436e-860f-005e20322ac5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 404 len: 111 microversion: 2.1 time: 0.068544 Aug 30 17:50:56.052702 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2289/4832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:55 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:50:56.065202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e67c718-5b81-4852-a603-aa5f2bd61c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:56.066225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e67c718-5b81-4852-a603-aa5f2bd61c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:56.191015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9e67c718-5b81-4852-a603-aa5f2bd61c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:56.203156 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e67c718-5b81-4852-a603-aa5f2bd61c6a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1213 microversion: 2.1 time: 0.148931 Aug 30 17:50:56.204515 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2290/4833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:56 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:56.267545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-168540182", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e6ff93dc-8242-4b60-97b4-ca969796e06f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:56.418623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] validate_networks() for [('e6ff93dc-8242-4b60-97b4-ca969796e06f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:50:56.464135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:56.482505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9afb83f-e063-4594-baaf-f43410032c4d tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1505 microversion: 2.1 time: 0.905737 Aug 30 17:50:56.485372 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2544/4834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:55 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1505 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:50:56.517577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:56.518398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:56.527444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.528216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.529716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.530848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.531784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.533375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.575780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:56.730781 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f01bde48-b267-4d1c-93bb-02dec2eb7807 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 204 len: 0 microversion: 2.1 time: 0.216731 Aug 30 17:50:56.736361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2545/4835] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:56 2022] DELETE /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:50:56.745487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:56.747206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:56.756167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.757805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.758415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.759829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.760479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.761015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.800604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:50:56.938848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d692778-9f88-49dc-9ac7-26d151b575c5 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 204 len: 0 microversion: 2.1 time: 0.200319 Aug 30 17:50:56.939990 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2546/4836] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:50:56 2022] DELETE /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:50:56.950860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:56.952097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:56.959047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.961234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.962101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:56.963305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:56.964907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:56.965736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:57.096898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:50:57.097398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:50:57.097944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:50:57.098426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:50:57.098961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:50:57.110347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:57.111182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:57.111980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:57.113252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:57.114802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:57.115464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:57.142166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:50:57.149460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Getting quotas for user 91e86d7db7a54b6d8046c3d496584bd1 and project 6d039d9401f6443a8229a96ccceab620. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:50:57.166477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:50:57.168873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:50:57.223031 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c816657f-002e-4bc5-a246-1e7e02927aac tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962042 Aug 30 17:50:57.223751 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2291/4837] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:50:57.233361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:57.234227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:57.236333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:57.248394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:57.249008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:57.249451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:57.250665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:57.251180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:57.251647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:57.328041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:57.330364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:57.340601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a7869a3-c8c5-4b04-ba61-ad6ce17912e0 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1511 microversion: 2.1 time: 0.395306 Aug 30 17:50:57.342012 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2547/4838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:56 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:57.344028 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0c2cd32-9bb4-4b9b-9304-edc26cbf4414 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1209 microversion: 2.1 time: 0.119241 Aug 30 17:50:57.344953 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2292/4839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:57 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:57.347454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-949b205f-fd7f-4398-ba26-8053e2628e6f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:57.348332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-949b205f-fd7f-4398-ba26-8053e2628e6f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:57.466806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-949b205f-fd7f-4398-ba26-8053e2628e6f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:57.488688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-949b205f-fd7f-4398-ba26-8053e2628e6f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1208 microversion: 2.1 time: 0.145282 Aug 30 17:50:57.489396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2548/4840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:57 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:58.390625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:58.391329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:58.399895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:58.403113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:58.430364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.438419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.439267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.441918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.442893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.443378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.444740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.445980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.449231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.450190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.450854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.454512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.460873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:58.723380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:58.734258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79f45a55-a8e0-4b32-9c4f-adb957e5adab tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1265 microversion: 2.1 time: 0.365456 Aug 30 17:50:58.753886 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2293/4841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:58 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:58.753886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:58.753886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:58.773341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.774069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.774640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.775440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:58.775999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:58.776504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:58.902224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:58.914864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ca4c47b-3d97-497b-a067-c67f325abc68 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1260 microversion: 2.1 time: 0.167682 Aug 30 17:50:58.915926 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2294/4842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:58 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:58.992457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:50:59.001390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:50:59.008070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-987bb7ec-5411-40ab-a0f4-0602deca16ae tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1511 microversion: 2.1 time: 0.631718 Aug 30 17:50:59.010379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2549/4843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:58 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1511 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:50:59.356703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf91f611-92f4-4ef9-a581-5f3b47a8e586", "name": "network-vif-deleted", "tag": "dba021e1-113f-4d34-b55a-d4a13617ed19"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:50:59.370273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:59.371008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:59.377169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:59.391957 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] Creating event network-vif-deleted:dba021e1-113f-4d34-b55a-d4a13617ed19 for instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 on n-h2-852771-11 Aug 30 17:50:59.401300 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-96aca132-850c-4f2a-ae36-12c92f1a7a0d req-eeb5d172-aa19-41de-bbad-141e499a8608 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053412 Aug 30 17:50:59.409386 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2295/4844] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:50:59.767351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:59.769001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:59.785127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:59.786120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:59.787424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:59.789174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:59.789843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:59.791677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:59.944202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:50:59.945415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:50:59.970789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:59.980309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:59.981147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:50:59.985483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:50:59.991188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:50:59.991969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:00.029869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:00.052906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f884883e-b1ae-43ea-84b5-1f076251d35c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1271 microversion: 2.1 time: 0.293489 Aug 30 17:51:00.054691 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2550/4845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:59 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:00.061245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:00.061866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:00.076477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:00.077232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:00.078285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:00.079374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:00.080051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:00.080651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:00.128239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:00.129366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:00.129978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:00.130604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lazy-loading 'fault' on Instance uuid cf91f611-92f4-4ef9-a581-5f3b47a8e586 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:00.386264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:00.407540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e07404f-4bea-41aa-990f-54650e01ac6a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1266 microversion: 2.1 time: 0.468871 Aug 30 17:51:00.413415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2296/4846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:50:59 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1266 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:00.563204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:00.571072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-628a105c-ac4b-4e2c-85fb-753b0778b2dc tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 200 len: 1307 microversion: 2.1 time: 0.515064 Aug 30 17:51:00.585044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2551/4847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:00 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:01.092378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:01.093671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:01.125138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.137607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.138072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.138829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.157625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d14f24-be6c-4ed1-9433-dd071874211a", "name": "network-vif-deleted", "tag": "857f12ea-45f3-4754-9361-d8abd8f43537"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:01.164191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.167609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.222853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.227912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.228369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.299968 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] Creating event network-vif-deleted:857f12ea-45f3-4754-9361-d8abd8f43537 for instance 69d14f24-be6c-4ed1-9433-dd071874211a on n-h1-852771-11 Aug 30 17:51:01.341136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-060ea4f7-8006-4633-8290-6a51ea52db8a req-fb0cc053-00ed-464f-ab9b-58285b48c398 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186142 Aug 30 17:51:01.347199 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2552/4848] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:01.433868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:01.434627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:01.462815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.463286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.464286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.466656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.467994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.477170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.565847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:01.590783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cebd7436-c985-43c0-8802-e2fa044726bc tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1271 microversion: 2.1 time: 0.512188 Aug 30 17:51:01.593173 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2297/4849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:01 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:01.614187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:01.614945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: cf91f611-92f4-4ef9-a581-5f3b47a8e586] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:01.644129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.644656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.645119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.645841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.646306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.646736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.711436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] HTTP exception thrown: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Request method failure captured: Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 HTTP/1.1 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk3PTCKVFzmXyJCQ5Dlmm-aDEmB71HQR4Sm3JZWIsehu7B8NiJnBCkvRsD30yMgUrYxCI9My4f0AUCkrZBo50BH4xiYgvOMu5elduemhTAIa9WPqtZBenvacvPdnvr0ah63b1mfDML_W5h5t3CosFjlEtDLfG2lUcpKf8IXRM-XIvo4 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2254c0ecde294172976bdda72a4a8a4a Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2254c0ecde294172976bdda72a4a8a4a"}]}] Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2254c0ecde294172976bdda72a4a8a4a Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-MultipleCreateTestJSON-182971079-project Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d8af3374fab740e6b2f1274763007351 Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-MultipleCreateTestJSON-182971079-project Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'cf91f611-92f4-4ef9-a581-5f3b47a8e586'} Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:01.713288 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Returning 404 to user: Instance cf91f611-92f4-4ef9-a581-5f3b47a8e586 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c624515-fd4f-4972-b804-c38b495a9262 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586" status: 404 len: 111 microversion: 2.1 time: 0.119458 Aug 30 17:51:01.719131 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2298/4850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:01 2022] GET /compute/v2.1/servers/cf91f611-92f4-4ef9-a581-5f3b47a8e586 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:01.733348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:01.736220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:01.756001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.757034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.757480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.758209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.758665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.759095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.826260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:01.826948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:01.828652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:01.829298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lazy-loading 'fault' on Instance uuid 69d14f24-be6c-4ed1-9433-dd071874211a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:01.950530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:01.962769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee134575-1368-4d23-9d6a-f3e021b181a8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.533236 Aug 30 17:51:01.965771 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2553/4851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:01 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:02.164452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8af3374fab740e6b2f1274763007351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254c0ecde294172976bdda72a4a8a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:02.183688 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c38d252-e9bf-410d-a92d-18c10851f730 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 200 len: 1307 microversion: 2.1 time: 0.456699 Aug 30 17:51:02.185497 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2299/4852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:01 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:02.613590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:02.614920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:02.630742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:02.632384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:02.632779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:02.640449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:02.641449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:02.641449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:02.996901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:02.998139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:03.012802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:03.019640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:03.020179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:03.020991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:03.021612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:03.022112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:03.152072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:03.163173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f08fc05-c25d-4c93-bb10-b0a7610f6bc7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.553031 Aug 30 17:51:03.164207 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2554/4853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:02 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:03.225690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:03.226701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] [instance: 69d14f24-be6c-4ed1-9433-dd071874211a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:03.243001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:03.246606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:03.255985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:03.257379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:03.260042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:03.260531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] HTTP exception thrown: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Request method failure captured: Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a HTTP/1.1 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk3PTCKVFzmXyJCQ5Dlmm-aDEmB71HQR4Sm3JZWIsehu7B8NiJnBCkvRsD30yMgUrYxCI9My4f0AUCkrZBo50BH4xiYgvOMu5elduemhTAIa9WPqtZBenvacvPdnvr0ah63b1mfDML_W5h5t3CosFjlEtDLfG2lUcpKf8IXRM-XIvo4 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2254c0ecde294172976bdda72a4a8a4a Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2254c0ecde294172976bdda72a4a8a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2254c0ecde294172976bdda72a4a8a4a"}]}] Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2254c0ecde294172976bdda72a4a8a4a Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-MultipleCreateTestJSON-182971079 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-MultipleCreateTestJSON-182971079-project Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d8af3374fab740e6b2f1274763007351 Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-MultipleCreateTestJSON-182971079-project Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '69d14f24-be6c-4ed1-9433-dd071874211a'} Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:03.302190 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:03.310186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] Returning 404 to user: Instance 69d14f24-be6c-4ed1-9433-dd071874211a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:03.313694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a6bfabd-1752-49b7-b011-38df90d0fba7 tempest-MultipleCreateTestJSON-182971079 tempest-MultipleCreateTestJSON-182971079-project] 10.222.0.50 "GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a" status: 404 len: 111 microversion: 2.1 time: 0.100727 Aug 30 17:51:03.316697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2555/4854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:03 2022] GET /compute/v2.1/servers/69d14f24-be6c-4ed1-9433-dd071874211a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:03.627736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:03.641676 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-356c25ef-4e52-4f53-8e58-99226d4b7866 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.656837 Aug 30 17:51:03.642396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2300/4855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:02 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:03.693491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6459b0d3-460b-471d-ad8d-375ae6a9df7a", "tag": "d5b40c07-ba5d-4b93-bc08-2118d06504f7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:03.712580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:03.713361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:03.714045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:03.728930 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] Creating event network-changed:d5b40c07-ba5d-4b93-bc08-2118d06504f7 for instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a on n-h1-852771-11 Aug 30 17:51:03.735411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5a6e5de8-8958-4125-a69e-5b8ec9ce41c2 req-d0e73593-331b-4a8f-81a9-4990cdfb5735 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045479 Aug 30 17:51:03.737024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2556/4856] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:04.189020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:04.189649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:04.199041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:04.199913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:04.200584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:04.201569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:04.202548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:04.203211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:04.570987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:04.584061 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c964353c-aa55-43dd-96e4-a0dc90e13215 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.396957 Aug 30 17:51:04.586699 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2301/4857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:04 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:04.666555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:04.668105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:04.689358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:04.690428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:04.692274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:04.694632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:04.695812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:04.699256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:05.114334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3caf912b-44ff-42df-865a-7b2f74770d19", "tag": "c0120007-6612-4285-9c20-8e9daf49b543"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:05.141651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:05.143867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:05.144884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:05.180779 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] Creating event network-changed:c0120007-6612-4285-9c20-8e9daf49b543 for instance 3caf912b-44ff-42df-865a-7b2f74770d19 on n-h1-852771-11 Aug 30 17:51:05.191522 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4f52a69d-d328-492e-b651-2efd991b32db req-f95dc8f9-0516-4363-9e29-2f895502ab14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081000 Aug 30 17:51:05.196089 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2302/4858] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:51:05.308024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:05.320173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ed1580fd-2219-4e74-8777-604f5d32c806 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.660283 Aug 30 17:51:05.321924 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2557/4859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:04 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:05.612010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:05.612974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:05.644081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:05.644865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:05.648870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:05.656087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:05.656834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:05.657388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:06.352490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:06.354765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:06.370453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:06.372960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:06.375894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:06.378375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:06.379617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:06.383387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:06.417040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:06.457150 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b796357a-7aeb-43bf-8298-8115b772c6e8 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.846378 Aug 30 17:51:06.458192 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2303/4860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:05 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:07.039835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:07.056411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-26049023-f269-46e9-a732-4cea28d6baca tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.707013 Aug 30 17:51:07.056411 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2558/4861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:06 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:07.478338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:07.478957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:07.483028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:07.486629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=14 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:07.502073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:07.502573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:07.503018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:07.507859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:07.508410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:07.508857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:08.073774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:08.078533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:08.079236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:08.104511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:08.106929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:08.107714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:08.112203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:08.115000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:08.123841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:08.140524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:08.150384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2083cb81-3bbf-425f-b3c6-52bc8a27af5c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.676584 Aug 30 17:51:08.156734 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2304/4862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:07 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:08.961284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:08.981652 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af13b651-6407-4083-aff1-417d68256518 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.908143 Aug 30 17:51:08.985489 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2559/4863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:08 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:09.175669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:09.176572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:09.191193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:09.194801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:09.197635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:09.198508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:09.199081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:09.205488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:09.509955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6459b0d3-460b-471d-ad8d-375ae6a9df7a", "name": "network-vif-plugged", "status": "completed", "tag": "d5b40c07-ba5d-4b93-bc08-2118d06504f7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:09.544231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:09.545206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:09.546327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:09.575398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] Creating event network-vif-plugged:d5b40c07-ba5d-4b93-bc08-2118d06504f7 for instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a on n-h1-852771-11 Aug 30 17:51:09.590174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-db88e25e-999f-460e-ab52-92594ac511c8 req-c474d329-f05d-4674-a1d1-251ac0eca61f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103142 Aug 30 17:51:09.591829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2560/4864] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:09.817733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:09.831741 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a111eadc-3eac-4b24-b621-849d075e2bef tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.659937 Aug 30 17:51:09.832775 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2305/4865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:09 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:10.026921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:10.028394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:10.038517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:10.040422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:10.063417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:10.067151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:10.067151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:10.070670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:10.440864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:10.457393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec184c11-a2f2-4d8a-aa59-c4cb5d85566e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.453669 Aug 30 17:51:10.457711 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2561/4866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:10 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:10.861997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:10.862636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:10.876193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:10.877207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:10.882542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:10.885123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:10.887172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:10.887899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:11.317768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:11.331314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ff8b76f-7bfb-4bcf-aa2d-af4bc271728e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.478630 Aug 30 17:51:11.331938 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2306/4867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:10 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:11.479973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:11.480852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:11.503119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:11.512672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:11.513524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:11.514332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:11.515255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:11.515829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:11.520790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:11.855238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:11.876530 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0f27b06-4d6c-45c8-9a8b-56c6c99abbae tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1308 microversion: 2.1 time: 0.402168 Aug 30 17:51:11.897728 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2562/4868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:11 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:12.354311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:12.355705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:12.363967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:12.364449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:12.364886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:12.367895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:12.368604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:12.369041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:12.909965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:12.911191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:12.932200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:12.932821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:12.933487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:12.934299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:12.936687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:12.937221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:13.120849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:13.155624 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df0f89ec-3e71-488d-8e14-7bc26828642c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.792696 Aug 30 17:51:13.169661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2307/4869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:12 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:13.256072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:13.273265 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23dcac0b-329e-4cc2-ad44-2da7c32558aa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1489 microversion: 2.1 time: 0.369521 Aug 30 17:51:13.273971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2563/4870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:12 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1489 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:13.296299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1500222143"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:13.299765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:13.314753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:13.315677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:13.316402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:13.317451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:13.318206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:13.319680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:13.424942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d16ea3c2-1546-4bb9-aebd-3876bbed285a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "PUT /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1075 microversion: 2.1 time: 0.133023 Aug 30 17:51:13.441696 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2308/4871] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:51:13 2022] PUT /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1075 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:13.447057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:13.447733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:13.458436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:13.465142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:13.466334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:13.466699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:13.467044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:13.467524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.011881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:14.028268 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a08738f-2511-4125-9fef-552a2395ba70 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1501 microversion: 2.1 time: 0.587039 Aug 30 17:51:14.030937 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2564/4872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:13 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1501 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:14.062346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:14.063632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:14.088539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.089073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.091873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.093815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.094300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.097120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.180208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:14.180812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:14.190097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.190600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.191040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.195365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.195869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.196310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.515003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:14.530284 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0cc63bb3-6bfe-45d5-8a8f-bcdb16e7999a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1501 microversion: 2.1 time: 0.477725 Aug 30 17:51:14.531568 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2309/4873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:14 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1501 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:14.556965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:14.564516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.565295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.566087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.575079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:14.592055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bbeb3e78-79ed-46e9-b824-7beb71010d71 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.418444 Aug 30 17:51:14.594161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2565/4874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:14 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:14.597311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:51:14.602625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:14.657579 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ceab3da-9a50-420c-8c4e-35d8150f38d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "POST /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a/action" status: 202 len: 0 microversion: 2.1 time: 0.105987 Aug 30 17:51:14.658822 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2310/4875] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:14 2022] POST /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:51:14.669340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:14.670890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:14.680052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.681421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.682319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:14.683224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:14.684036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:14.684634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:15.110338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:15.127387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58544383-6ebf-4d1b-9945-fb9bfafa7f36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.463418 Aug 30 17:51:15.135798 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2566/4876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:14 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:15.616638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:15.617333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:15.635319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:15.636652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:15.636652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:15.636935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:15.637567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:15.638003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:15.989786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:16.013885 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f275454f-d11b-4351-8e1f-12cee3ae0de0 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.402428 Aug 30 17:51:16.016227 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2311/4877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:15 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:16.157727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:16.158337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:16.165812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:16.166550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:16.167149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:16.168047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:16.168661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:16.169276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:16.292945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3caf912b-44ff-42df-865a-7b2f74770d19", "name": "network-vif-plugged", "status": "completed", "tag": "c0120007-6612-4285-9c20-8e9daf49b543"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:16.305577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:16.308735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:16.309413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:16.325482 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] Creating event network-vif-plugged:c0120007-6612-4285-9c20-8e9daf49b543 for instance 3caf912b-44ff-42df-865a-7b2f74770d19 on n-h1-852771-11 Aug 30 17:51:16.333606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-26966544-0906-48aa-a3fe-81f643dda3a6 req-a83f2b98-b1f7-406c-9f7a-8cae2f3488a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046279 Aug 30 17:51:16.335051 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2312/4878] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:16.611995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:16.624295 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3faa1ac7-38e5-4d0f-95a5-a7a6b86ccdc9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.470284 Aug 30 17:51:16.626209 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2567/4879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:16 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:17.040922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:17.042410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:17.058849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:17.060247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:17.061146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:17.062170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:17.062881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:17.063560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:17.470575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:17.486446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02456105-9403-406e-963d-0815e1555be2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.453358 Aug 30 17:51:17.488039 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2313/4880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:17 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:17.649284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:17.650559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:17.666444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:17.666952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:17.675789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:17.676580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:17.677063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:17.678379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:18.144779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:18.149274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:18.160455 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc103dbf-6b72-4ef9-93b5-12fc604a2f05 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.515393 Aug 30 17:51:18.163071 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2568/4881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:17 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:18.513176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:18.513787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:18.546607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:18.547247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:18.554149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:18.555017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:18.555565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:18.556032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:19.057824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:19.066367 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-275cc428-090b-485c-82f8-3fd4e0e3aa0e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1313 microversion: 2.1 time: 0.559651 Aug 30 17:51:19.067683 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2314/4882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:18 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:19.185167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:19.186054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:19.205840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:19.210056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:19.212020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:19.216884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:19.219049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:19.220708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:19.798999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:19.811606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e4153d8-4aff-4141-ae96-611da7458d3f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.632852 Aug 30 17:51:19.829007 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2569/4883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:19 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:20.091934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:20.092906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:20.138453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.142354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.143168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:20.144682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.145397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.146464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:20.835807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:20.848975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:20.859232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:20.875273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.877396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-788253aa-f861-48bb-9ee9-39d8442c3536 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1499 microversion: 2.1 time: 0.792538 Aug 30 17:51:20.881923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.882431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:20.883279 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2315/4884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:20 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1499 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:20.885386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.885888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.886328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:20.907430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:20.920982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:20.952905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.953459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.956228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:20.962403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:20.963024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:20.964750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:21.066912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lazy-loading 'flavor' on Instance uuid 3caf912b-44ff-42df-865a-7b2f74770d19 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:21.325351 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-34ce929a-39de-40fd-af07-0f14cae00ca4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "POST /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19/action" status: 200 len: 32 microversion: 2.1 time: 0.424304 Aug 30 17:51:21.328099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2316/4885] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:20 2022] POST /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 17:51:21.347279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:21.348442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:21.363604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:21.364442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:21.366150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:21.368172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:21.368909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:21.370496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:21.952010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:21.962391 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f65416eb-294e-40a9-b00f-c1b9edfb74ba tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.627070 Aug 30 17:51:21.979840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2317/4886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:21 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:22.261768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:22.274990 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e1da557e-2f6e-4c1a-8bdd-35319f33037f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 1.444679 Aug 30 17:51:22.278941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2570/4887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:20 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:22.992227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:22.994088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:23.010046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:23.013494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:23.015170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:23.017165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:23.018836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:23.020022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:23.305351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:23.305982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:23.321336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:23.321833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:23.324680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:23.329376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:23.329891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:23.330338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:23.598582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:23.616014 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-964e576b-9928-4617-9786-e3070c12242f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.317206 Aug 30 17:51:23.627993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2571/4888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:23 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:24.211830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:24.223085 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-46e75c83-b9b7-4960-a562-0a40570508a7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 1.235907 Aug 30 17:51:24.241160 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2318/4889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:22 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:24.659699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:24.666120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:24.696432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:24.697703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:24.699215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:24.700677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:24.704944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:24.705886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:24.947390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:24.964770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-10715763-01a1-467c-a825-8231e8aac5d9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.319663 Aug 30 17:51:24.966224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2572/4890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:24 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:25.251134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:25.255063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:25.279766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:25.281007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:25.282682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:25.283908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:25.284463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:25.284989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:25.851615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:25.862039 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-092a4211-430a-4ead-b327-75dd1ecac778 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.620275 Aug 30 17:51:25.879117 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2319/4891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:25 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:25.986477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:25.987741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:26.001717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.004145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.004783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:26.008576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.009251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.009928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:26.237582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:26.247199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5158a7a4-f496-4886-89b9-0706cd4bdef3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.264775 Aug 30 17:51:26.252175 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2573/4892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:25 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:26.887460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:26.888778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:26.899441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:26.899951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:26.917123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.921883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.923166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.924084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.924963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:26.925723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:26.926270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.928150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:26.928330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.928829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:26.930574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:26.943325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:27.184682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lazy-loading 'services' on Instance uuid bbeeea5c-d741-4d17-b89c-41590b4572db {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:27.363848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5abb5fa2-72e2-4062-b401-210efcc02291 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments/1214bbf8-0ff3-4b67-bf23-187079173f1f" status: 202 len: 0 microversion: 2.1 time: 0.470899 Aug 30 17:51:27.365027 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2574/4893] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:51:26 2022] DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments/1214bbf8-0ff3-4b67-bf23-187079173f1f => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:51:27.379776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:27.383929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:27.425188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:27.431077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:27.433793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:27.434794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:27.437892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:27.438538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:27.726268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:27.743859 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2828182a-bf74-4bb1-ac02-ad9ca3a3521e tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.377233 Aug 30 17:51:27.745210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2575/4894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:27 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:27.749802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:27.772493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf78904b-9bc7-44a4-b6d7-63854ad3bb8a tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.880236 Aug 30 17:51:27.775241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2320/4895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:26 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:28.203424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-6845971", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:28.340538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] validate_networks() for [('fdb89103-a105-480e-8a62-f5210819b757', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:51:28.778597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:28.780182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:28.793757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=60 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:28.799859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:28.800783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:28.801585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:28.805256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:28.807557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:28.809089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:28.952639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:51:28.953361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:51:28.954075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:51:28.955288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:51:28.955948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:51:28.976535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:28.978735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:28.980677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:28.982258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:28.984152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:28.985363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:29.023140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:51:29.043358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for user 643142ee7f7e4128a4344fb4cad92b29 and project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:51:29.083634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:51:29.091587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:51:29.123754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:29.154508 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8374c69d-f76d-4bf1-96eb-bc31ac1417cd tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.380865 Aug 30 17:51:29.157255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2321/4896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:28 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:29.175279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:29.176466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:29.194689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:29.199378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:29.200776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:29.203204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:29.204874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:29.207223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:29.220946 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efb71b02-2392-4c1a-902f-f3e60f99f0fc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.217812 Aug 30 17:51:29.225158 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2576/4897] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:51:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:51:29.250785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8689d360-e74e-48da-8853-fb584057a052 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:29.253447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8689d360-e74e-48da-8853-fb584057a052 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:29.547120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8689d360-e74e-48da-8853-fb584057a052 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:29.562503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:29.562686 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8689d360-e74e-48da-8853-fb584057a052 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1219 microversion: 2.1 time: 0.324932 Aug 30 17:51:29.564626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2577/4898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:29 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1219 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:29.571916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a66b5df0-d7f2-4aeb-bee8-a69717c58f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.412164 Aug 30 17:51:29.575714 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2322/4899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:29 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:29.868007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2087343816", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:30.042381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] validate_networks() for [('fdb89103-a105-480e-8a62-f5210819b757', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:51:30.177710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:30.178334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:30.190095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:30.191759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:30.194197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:30.194955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:30.195437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:30.198423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:31.068115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:31.088594 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43e6a58c-f727-47d0-899f-838a133fce28 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.914763 Aug 30 17:51:31.091079 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2323/4900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:30 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:31.096073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:31.112359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:31.135004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:31.137118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:31.137812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:31.140198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:31.141879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:31.142980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:32.187597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:32.221604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d577c255-e791-4bab-a58e-a9b11996c572 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 1.125336 Aug 30 17:51:32.222296 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2324/4901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:31 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:32.247621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:32.252259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:32.296465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:32.298569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:32.299318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:32.301605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:32.305087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:32.306928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:32.362904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:32.884969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:32.899825 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a7f5fb0-78f9-4ac3-9c7a-e8ebcf2d2422 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.673216 Aug 30 17:51:32.903381 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2325/4902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:32 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:33.039809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:51:33.040981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:51:33.041653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:51:33.042250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:51:33.042866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:51:33.057700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.060329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.060718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:33.062069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.062782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.063805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:33.125745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:51:33.137247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for user 643142ee7f7e4128a4344fb4cad92b29 and project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:51:33.176330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:51:33.179946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:51:33.244243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:33.244854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:33.270031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.271142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.271613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:33.272345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.272792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.290926 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87a6f5f4-a2d8-4a7b-a609-10cc3619ee2f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.428088 Aug 30 17:51:33.294709 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2578/4903] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:51:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:51:33.309140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-599b2563-f3b7-49aa-a2d5-fd652d17fcab tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:33.310487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-599b2563-f3b7-49aa-a2d5-fd652d17fcab tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:33.319001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:33.567451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-599b2563-f3b7-49aa-a2d5-fd652d17fcab tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:33.581431 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-599b2563-f3b7-49aa-a2d5-fd652d17fcab tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1222 microversion: 2.1 time: 0.277087 Aug 30 17:51:33.582470 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2579/4904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:33 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:33.871399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:33.887084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8860158-20c7-4c97-8440-63581b009255 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.647202 Aug 30 17:51:33.890441 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2326/4905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:33 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:33.924327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:33.925470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:33.937218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.937961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.938592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:33.941509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:33.944023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:33.944649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:34.604060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:34.604677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:34.625817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:34.626315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:34.626752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:34.627458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:34.640100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:34.640609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:34.946858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:34.975849 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12dbaef7-59c4-4adc-9215-ad3352a8e02d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 1.049179 Aug 30 17:51:34.978144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2580/4906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:33 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:34.986533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:35.003249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:35.030157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:35.034221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:35.035553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:35.039768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:35.063688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:35.070394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:35.091074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:35.120671 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08e076b8-26e2-4e31-aa82-038cb717030c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1226 microversion: 2.1 time: 0.522125 Aug 30 17:51:35.121204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2327/4907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:34 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1226 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:35.447024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:35.457867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-413644a5-c4ca-4fdc-89ed-0fb1fc5b6e01 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.477590 Aug 30 17:51:35.458803 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2581/4908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:34 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:36.008743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:36.009488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:36.031067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.033935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.034830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:36.035790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.038614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.046494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:36.143928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:36.145897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:36.159372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.160729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.162255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:36.165592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.166217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.166765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:36.511946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:36.512844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:36.531114 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f11d2aa-b352-46c2-8c7a-bc4607ae406b tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.529214 Aug 30 17:51:36.535847 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c6cce3d6-1a00-492e-bc6f-afae258d3d82 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1280 microversion: 2.1 time: 0.396783 Aug 30 17:51:36.538028 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2328/4909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:36 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:36.548332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2582/4910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:36 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1280 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:36.550113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:36.550747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:36.572858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.582481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.584588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:36.585375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:36.585857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:36.586295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:37.037023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:37.051387 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95d10aae-050b-4869-8a0d-20aa3e95e38e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.509993 Aug 30 17:51:37.053094 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2329/4911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:36 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:37.566485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:37.566485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:37.573519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:37.574131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:37.574283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:37.574783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:37.575225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:37.584808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:37.592107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:37.592107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:37.593588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:37.602230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:37.602886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:37.603659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:37.604139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:37.605092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:38.341836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:38.373001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:38.376213 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ecf4a79c-a977-4077-a063-09705f1c75b6 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.814082 Aug 30 17:51:38.377572 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2583/4912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:37 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:38.396562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5f99a31-25df-4002-ba92-620a9590e9c8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.821155 Aug 30 17:51:38.398826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:38.399824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:38.409251 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2330/4913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:37 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:38.412728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:38.413538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:38.416622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:38.417742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:38.423193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:38.425826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:38.773780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:38.785161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:38.791925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:38.793706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:38.886938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:51:39.000746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a549e180-5c49-499c-8a8e-698ac92b90cd tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action" status: 202 len: 0 microversion: 2.1 time: 0.232508 Aug 30 17:51:39.001667 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2331/4914] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:38 2022] POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:51:39.010870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:39.021787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:39.038057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.038812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.039428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:39.040335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.040963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.041552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:39.367298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:39.378129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d12fd18d-17c9-466e-9deb-51f5217f6999 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.998633 Aug 30 17:51:39.383078 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2584/4915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:38 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:39.400817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:39.401883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:39.417104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.418978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.420083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:39.422289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.422768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.424530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:39.429909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:39.444411 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08d728f9-398e-49b7-b6d2-73f958702639 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.437558 Aug 30 17:51:39.455504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2332/4916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:39 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:39.455504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:39.455504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:39.465428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.465932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.466377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:39.467099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:39.467590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:39.468031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.048641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:40.059179 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c3aa66d-d4c9-4031-ac3c-6efe54cc37bd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.612663 Aug 30 17:51:40.062210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2333/4917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:39 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:40.101005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:40.123280 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-76cb6eeb-6eb4-4edb-a5bd-1f964b4dfda1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1511 microversion: 2.1 time: 0.724345 Aug 30 17:51:40.124219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2585/4918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:39 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1511 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:40.138047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48313007-4ae9-453a-89c4-3d27094a8617", "tag": "59b98d90-3c36-4e1a-9f3d-666368fbc8af"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:40.175802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.176795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.177239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.230080 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] Creating event network-changed:59b98d90-3c36-4e1a-9f3d-666368fbc8af for instance 48313007-4ae9-453a-89c4-3d27094a8617 on n-h2-852771-11 Aug 30 17:51:40.258475 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8b344829-ddb6-45aa-900f-85de2442d7fc req-64d8b9ca-d70c-4a7b-8054-01583f6f8eed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126060 Aug 30 17:51:40.262099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2334/4919] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:51:40.403638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:40.404559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:40.419317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.424917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.425488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.426790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.430505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.431107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.620516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2367f7f9-2633-4030-ab63-74a0a255411e", "tag": "c6ed2315-fd5e-4fb0-920c-44c6b15f1805"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:40.642618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.649659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.651357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.695017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] Creating event network-changed:c6ed2315-fd5e-4fb0-920c-44c6b15f1805 for instance 2367f7f9-2633-4030-ab63-74a0a255411e on n-h2-852771-11 Aug 30 17:51:40.715005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d54b9bc6-3d68-4006-a9dd-b61c1147148a req-e4904e38-bd75-4177-9718-64fe931cf48b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563094 Aug 30 17:51:40.721406 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2586/4920] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:51:40.736493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:40.737216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:40.759018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.759533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.759974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:40.768092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:40.770738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:40.772562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:41.155671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:41.172521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32ce8450-bc08-4165-8e1c-02e47be7f929 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.774159 Aug 30 17:51:41.190210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2335/4921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:40 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:41.202478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:41.206376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:41.218311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:41.226226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:41.226688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:41.227449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:41.227941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:41.228367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:41.413293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:41.423212 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-96e9658c-6b29-417d-aa5f-d9fd61d2333c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.699994 Aug 30 17:51:41.430640 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2587/4922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:40 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:41.451738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:41.452748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:41.460688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:41.461607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:41.462292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:41.463247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:41.464207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:41.464897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:41.735230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:41.745705 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4bf33345-017c-451d-a122-b57685cb51e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.554111 Aug 30 17:51:41.750254 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2336/4923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:41 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:41.920549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:41.923981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:41.935169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bffd03d6-2399-45bc-9e86-abfe810a00f9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1488 microversion: 2.1 time: 0.488513 Aug 30 17:51:41.937079 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2588/4924] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:41 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1488 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:41.969230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1742416130"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:41.977059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:41.999114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.009364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.010280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.011980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.015378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.019520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.201039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:42.201925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:42.222525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:42.233226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.234452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.238183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.240554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.241889 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8fb14c5-c9ae-4d28-8a0f-57785a2edfaa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "PUT /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1061 microversion: 2.1 time: 0.280078 Aug 30 17:51:42.243602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.245096 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2337/4925] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 17:51:41 2022] PUT /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1061 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:42.247330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.275294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:42.289401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:42.322979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.329692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.331310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.332114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.341407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.342044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.579116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:42.592893 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a24f75f8-1f24-49d9-a023-3cbde720cec3 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1488 microversion: 2.1 time: 0.336268 Aug 30 17:51:42.601898 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2338/4926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:42 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1488 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:42.612046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:42.612999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:42.621248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.621891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.622400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:42.623180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:42.623743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:42.624282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.087697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:43.092959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:43.101192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5da804b8-47fa-45a3-abd7-7bc4f6be16a3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.497921 Aug 30 17:51:43.101613 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2339/4927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:42 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:43.134450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:43.137131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:43.156587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.157377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.158004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.158899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.161113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.162058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.529384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:43.535167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:43.539627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:43.552629 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a9c7e11-b668-4bf5-a867-565d99607ab5 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1488 microversion: 2.1 time: 0.433591 Aug 30 17:51:43.556514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2340/4928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:43 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1488 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:43.559045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-649befaf-c80d-4f07-b632-21258d2bc586 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 1.364526 Aug 30 17:51:43.560364 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2589/4929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:42 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:43.563278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:43.569911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:43.580678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.581602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.582357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.584306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.585008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.585690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.597579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:43.598138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:43.601846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:43.635285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.635818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.636270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.636993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.637452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.637886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.703949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:51:43.914934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9291273b-7099-4b5d-9fc4-c258af7cc4af tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 204 len: 0 microversion: 2.1 time: 0.321627 Aug 30 17:51:43.915579 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2590/4930] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:43 2022] DELETE /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:51:43.924209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:43.924835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:43.948743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.949481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.950116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:43.951223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:43.951883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:43.952475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:44.056559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:44.070000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03cc2b2f-b831-4d2e-ad82-90e241c5546a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.512110 Aug 30 17:51:44.075968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2341/4931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:43 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:44.122802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:44.124170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:44.157118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:44.159172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:44.159935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:44.164669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:44.166158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:44.166867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:44.543833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:44.570611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-136055a2-e101-4837-99fe-998a0b395bea tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1494 microversion: 2.1 time: 0.647197 Aug 30 17:51:44.583517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2591/4932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:43 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1494 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:44.589031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:44.590183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:44.603365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:44.604137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:44.604806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:44.605724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:44.606647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:44.607370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:44.813367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:44.821708 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-512cabd0-b6e0-4677-b516-cf1ccd47861c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.703002 Aug 30 17:51:44.836762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2342/4933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:44 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:45.099502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:45.100121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:45.110836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.112003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.112003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:45.124620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.125247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.125572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:45.413301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:45.423130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f8b3339-92d2-4487-8f84-71df4412b570 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.329001 Aug 30 17:51:45.437553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2343/4934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:45 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:45.518554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:45.537611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e449333-aa0b-405c-ab0a-2a3662334feb tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.959226 Aug 30 17:51:45.560028 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2592/4935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:44 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:45.599130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:45.599751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:45.610114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.610613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.611053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:45.611783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.612237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.612856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:45.873464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:45.883833 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-938f3463-050e-4faa-82a7-a54edfe679d1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1494 microversion: 2.1 time: 0.289403 Aug 30 17:51:45.884768 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2344/4936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:45 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1494 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:45.890556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:45.891390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:45.899848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.900593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.901846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:45.903099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:45.903927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:45.904528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:46.183423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d0566742-095f-466c-bd1a-a7d03a6c1f1c tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-949575001", "availability_zone": "foo_zone"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:46.187796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.aggregate [None req-d0566742-095f-466c-bd1a-a7d03a6c1f1c tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Generated uuid 808a6126-fa65-4051-987f-0eef68ceee75 for aggregate {{(pid=122124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 17:51:46.191139 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0566742-095f-466c-bd1a-a7d03a6c1f1c tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:51:46.225679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:46.237906 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b8771d5-238f-4b85-bd91-c3a5f0e3a5c1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.351736 Aug 30 17:51:46.253431 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2345/4937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:45 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:46.445006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:46.445751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:46.455401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:46.455937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:46.460020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:46.460973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:46.461462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:46.461905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:46.840589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:46.852635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6bb9ebf0-1bfe-47e8-9b04-68bc214579d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.412221 Aug 30 17:51:46.860781 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2346/4938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:46 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:46.873716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:46.874376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:46.882780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:46.883756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:46.884363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:46.885491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:46.886178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:46.886771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.085549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:47.103028 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ccc5650-a9b2-49b4-a3cf-2c53bba867d2 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.240016 Aug 30 17:51:47.104198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2347/4939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:46 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:47.110102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:47.112613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:47.132637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.133679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.135790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.140154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.141530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.148018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.206939 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0566742-095f-466c-bd1a-a7d03a6c1f1c tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34216. Aug 30 17:51:47.266003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:47.272515 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d0566742-095f-466c-bd1a-a7d03a6c1f1c tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.675429 Aug 30 17:51:47.282141 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2593/4940] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 30 17:51:45 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:51:47.288163 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e12ae3b-ff50-4b91-ba7b-5c777b59b99f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 200 len: 1452 microversion: 2.1 time: 0.181417 Aug 30 17:51:47.291106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2348/4941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:47 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:47.295838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ce87889-a1b4-4f87-9efe-c8545dfbadd0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:47.302439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:47.311902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:47.322701 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ce87889-a1b4-4f87-9efe-c8545dfbadd0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] [39b00306-4754-4ed7-9070-25b484b9e9a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:51:47.326779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.328809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.329598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.332418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.334158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.336986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.743152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:47.757315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da2ce809-f82d-43d0-85c3-0c61a15ad4b4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.473935 Aug 30 17:51:47.760257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2594/4942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:47 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:47.772500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48313007-4ae9-453a-89c4-3d27094a8617", "name": "network-vif-plugged", "status": "completed", "tag": "59b98d90-3c36-4e1a-9f3d-666368fbc8af"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:47.798207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.800499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.803809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.857350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] Creating event network-vif-plugged:59b98d90-3c36-4e1a-9f3d-666368fbc8af for instance 48313007-4ae9-453a-89c4-3d27094a8617 on n-h2-852771-11 Aug 30 17:51:47.873324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-58714045-cd17-4127-bdcf-2425684f8d25 req-1b9d50fc-b392-4dd7-b597-f17c87d9ea5d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109129 Aug 30 17:51:47.874634 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2595/4943] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:47.889799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6459b0d3-460b-471d-ad8d-375ae6a9df7a", "name": "network-vif-deleted", "tag": "d5b40c07-ba5d-4b93-bc08-2118d06504f7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:47.901142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.901622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.902301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.921862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] Creating event network-vif-deleted:d5b40c07-ba5d-4b93-bc08-2118d06504f7 for instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a on n-h1-852771-11 Aug 30 17:51:47.936620 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5cc0b25a-8a46-4eeb-bd41-3aeab715e62f req-8c0fb812-e0d4-4a12-aff3-4151b107f323 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060319 Aug 30 17:51:47.941298 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2596/4944] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:47.951299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:47.951858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:47.972067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.975943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.976623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:47.978758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:47.979430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:47.981500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.331383 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ce87889-a1b4-4f87-9efe-c8545dfbadd0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] [39b00306-4754-4ed7-9070-25b484b9e9a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34238. Aug 30 17:51:48.388851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ce87889-a1b4-4f87-9efe-c8545dfbadd0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.095361 Aug 30 17:51:48.390211 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2349/4945] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:51:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:48.414842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.415909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:48.427652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.429122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.430691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.432306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.432992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.433599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.468826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:48.478161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d19a6e57-d8bb-4652-9ffd-ade1db7304cf tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.534705 Aug 30 17:51:48.489987 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2597/4946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:47 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:48.511851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.513553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:48.539443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.541179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.541778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.542583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.543715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.544333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.569190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a HTTP/1.1 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6459b0d3-460b-471d-ad8d-375ae6a9df7a'} Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.583101 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-26411f0a-ba38-48d6-bcfb-84097b8be84a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 404 len: 111 microversion: 2.1 time: 0.100509 Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2598/4947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:48.589697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.605829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.606806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.609855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.625593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.627855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.628318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.659104 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ace666fc-ede9-4211-9e92-6263e88158b6 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.072882 Aug 30 17:51:48.667395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2599/4948] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:48.673502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.674250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:48.681129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.681878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.682497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.683450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.684120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.684742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:48.684911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.692996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-091e5bda-bce7-4268-ae28-764530fad090 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.291820 Aug 30 17:51:48.696573 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2350/4949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:48.702179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a HTTP/1.1 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6459b0d3-460b-471d-ad8d-375ae6a9df7a'} Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:48.704032 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.710437 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.712464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:48.713514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-22bc2243-d851-4b4a-9d2b-44dfd273fcfa tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 404 len: 111 microversion: 2.1 time: 0.044188 Aug 30 17:51:48.714575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2600/4950] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:48 2022] DELETE /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:48.718374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-18d18584-3d8a-4a8d-979e-0bad863447fc tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.729954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.730539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 6459b0d3-460b-471d-ad8d-375ae6a9df7a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:48.731011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-18d18584-3d8a-4a8d-979e-0bad863447fc tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.033183 Aug 30 17:51:48.731815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2351/4951] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:48.744195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.744553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-addedab0-c98d-4d8c-b66b-b570af949101 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:48.745251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.745921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.746891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.747594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.748250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.764393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a HTTP/1.1 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6459b0d3-460b-471d-ad8d-375ae6a9df7a'} Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.766297 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. Aug 30 17:51:48.771240 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:48.771837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addedab0-c98d-4d8c-b66b-b570af949101 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.772377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addedab0-c98d-4d8c-b66b-b570af949101 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.772923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addedab0-c98d-4d8c-b66b-b570af949101 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.773202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 6459b0d3-460b-471d-ad8d-375ae6a9df7a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:48.774258 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e212c265-407d-4ff5-900e-af0758830d22 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a" status: 404 len: 111 microversion: 2.1 time: 0.055629 Aug 30 17:51:48.775014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2601/4952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/servers/6459b0d3-460b-471d-ad8d-375ae6a9df7a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:48.784264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.794924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:48.802371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.803294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.804716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.807373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:48.807979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:48.810883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:48.981117 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-addedab0-c98d-4d8c-b66b-b570af949101 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.240495 Aug 30 17:51:48.987845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2352/4953] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:51:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:48.993356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:48.993859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.000088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.000859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.001305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.002161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.002722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.003157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.019970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 HTTP/1.1 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '54f9fa80-6696-4130-ae72-7c3f0fee89b5'} Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.021827 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50be804d-6b13-47be-965e-45dc13ce5148 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 404 len: 111 microversion: 2.1 time: 0.033665 Aug 30 17:51:49.027574 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2353/4954] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:48 2022] DELETE /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.032999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1ddd9f4-46eb-4289-965f-052ac4472151 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.035073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:49.055194 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-489b722e-0e69-4927-b465-1309f02a407d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1679 microversion: 2.1 time: 0.275445 Aug 30 17:51:49.056187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2602/4955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:48 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1679 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:49.060977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1ddd9f4-46eb-4289-965f-052ac4472151 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.036068 Aug 30 17:51:49.069741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.070765 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2354/4956] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:49.071029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 54f9fa80-6696-4130-ae72-7c3f0fee89b5] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.077473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e80992fa-53aa-47ed-aa2d-647d50125a77 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1175598022", "availability_zone": "foo_zone"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:49.086541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.087370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.088564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.089392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.089849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.090535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.118481 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 HTTP/1.1 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '54f9fa80-6696-4130-ae72-7c3f0fee89b5'} Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.120376 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. Aug 30 17:51:49.125783 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.127929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 54f9fa80-6696-4130-ae72-7c3f0fee89b5 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.132213 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aef92a76-2d1d-4cd5-9d61-9484d2eb19b4 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5" status: 404 len: 111 microversion: 2.1 time: 0.073511 Aug 30 17:51:49.134946 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2603/4957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/54f9fa80-6696-4130-ae72-7c3f0fee89b5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.156017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.157314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.171127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.175990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.176766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.178532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.179189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.179991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.199392 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 HTTP/1.1 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c8eed3e8-91f2-4f8c-88b3-37ea10002105'} Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.201241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.206279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.208804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.209925 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a8c1eccb-21c9-486a-9f7a-895e735b2edc tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 404 len: 111 microversion: 2.1 time: 0.067585 Aug 30 17:51:49.210056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e80992fa-53aa-47ed-aa2d-647d50125a77 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.137547 Aug 30 17:51:49.210636 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2355/4958] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 30 17:51:49 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:49.211317 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2604/4959] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:49 2022] DELETE /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.221928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-219c332e-7313-49d0-a3bf-1476f4a8a95f tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:49.236252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.236888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: c8eed3e8-91f2-4f8c-88b3-37ea10002105] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.244822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.245600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.246221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.247296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.248297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.248919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.272979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 HTTP/1.1 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c8eed3e8-91f2-4f8c-88b3-37ea10002105'} Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.275421 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. Aug 30 17:51:49.280558 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.282063 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-219c332e-7313-49d0-a3bf-1476f4a8a95f tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.063742 Aug 30 17:51:49.289332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2356/4960] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:51:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:49.290045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance c8eed3e8-91f2-4f8c-88b3-37ea10002105 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.290943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18d7ac7e-b6cd-4a55-b2a7-55e8ea134a6c tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105" status: 404 len: 111 microversion: 2.1 time: 0.065932 Aug 30 17:51:49.295149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c02c722d-0548-427a-a406-fb8becc110f0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.295341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2605/4961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/c8eed3e8-91f2-4f8c-88b3-37ea10002105 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.302450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.303217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.316223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.317378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.317984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.319144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.319744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.320212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.323309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c02c722d-0548-427a-a406-fb8becc110f0 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.029766 Aug 30 17:51:49.337172 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2357/4962] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:51:49.349782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0846cba6-4143-455e-a22c-3da3d328cf91 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-11"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:49.355786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 HTTP/1.1 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'dcc6827c-1cee-497a-8e02-02e2afb03d34'} Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.359036 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.366200 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.369877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.371238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af8f5fc0-ce18-4454-89ad-6a995d65cb36 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 404 len: 111 microversion: 2.1 time: 0.074807 Aug 30 17:51:49.372115 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2606/4963] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:49 2022] DELETE /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.387343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.388887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: dcc6827c-1cee-497a-8e02-02e2afb03d34] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.407018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0846cba6-4143-455e-a22c-3da3d328cf91 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.429655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0846cba6-4143-455e-a22c-3da3d328cf91 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.433377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0846cba6-4143-455e-a22c-3da3d328cf91 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.439718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.441313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.442799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.444384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.445150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.448205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.450747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:49.489693 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 HTTP/1.1 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'dcc6827c-1cee-497a-8e02-02e2afb03d34'} Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.491458 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.499202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance dcc6827c-1cee-497a-8e02-02e2afb03d34 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.536820 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-126bf069-59d3-4c1e-8dbe-b468e588d07f tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34" status: 404 len: 111 microversion: 2.1 time: 0.159761 Aug 30 17:51:49.542360 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2607/4964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/dcc6827c-1cee-497a-8e02-02e2afb03d34 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.563022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.570067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.596081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.597646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.599091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.600240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.600893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.601775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.749317 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0846cba6-4143-455e-a22c-3da3d328cf91 tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.400115 Aug 30 17:51:49.750021 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2358/4965] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 30 17:51:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:49.758810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.759345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.768391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.768882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.769324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.770809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.771569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.772474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.788268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 HTTP/1.1 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '18a61e58-3428-4bda-a7b4-59b70c1ff721'} Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.791670 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ffc0182a-58d2-44c5-ac01-0bbb66797bb9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 404 len: 111 microversion: 2.1 time: 0.042187 Aug 30 17:51:49.797649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2359/4966] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:49 2022] DELETE /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:49.803542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.804974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.812697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.813431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.814064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.815008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.815694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.824595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.840880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:49.849191 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8c06e799-2241-4a58-96c4-06552030060e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1326 microversion: 2.1 time: 0.304132 Aug 30 17:51:49.862469 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2608/4967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1326 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:49.862469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ecce5ce-cb9e-47f5-9884-cd43ba3ced9a tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.910802 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ecce5ce-cb9e-47f5-9884-cd43ba3ced9a tempest-TestAggregatesBasicOps-123366512 tempest-TestAggregatesBasicOps-123366512-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.054011 Aug 30 17:51:49.911843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2609/4968] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:51:49 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 17:51:49.921097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:49.923472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 18a61e58-3428-4bda-a7b4-59b70c1ff721] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:49.933896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.934766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.935445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.936457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:49.937179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:49.939063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:49.984978 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 HTTP/1.1 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '18a61e58-3428-4bda-a7b4-59b70c1ff721'} Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:49.990804 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. Aug 30 17:51:49.997547 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.000348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 18a61e58-3428-4bda-a7b4-59b70c1ff721 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:50.000348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0251f83-2786-471e-aa8f-1c35238b257d tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721" status: 404 len: 111 microversion: 2.1 time: 0.085855 Aug 30 17:51:50.000348 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2610/4969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/18a61e58-3428-4bda-a7b4-59b70c1ff721 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:50.012156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.017797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.033741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.039965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.040566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.041630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.042101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.042588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.086955 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 HTTP/1.1 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '7989980b-d124-4aea-a8ac-c2e0dec65057'} Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:50.088598 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:50.093279 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9003bb4-5e60-4981-be8b-359465a4472a tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 404 len: 111 microversion: 2.1 time: 0.084110 Aug 30 17:51:50.098202 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2611/4970] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:50 2022] DELETE /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:50.098747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:50.106525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.110388 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26991c19-32eb-43dc-bd3a-21900a473303 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.315548 Aug 30 17:51:50.110568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.111695 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2360/4971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:49 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:50.118076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.119348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 7989980b-d124-4aea-a8ac-c2e0dec65057] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.123854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.124354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.124791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.125505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.125959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.126389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.127684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.128398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.129774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.130706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.131405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.132040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.147911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 HTTP/1.1 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '7989980b-d124-4aea-a8ac-c2e0dec65057'} Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.149826 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. Aug 30 17:51:50.154525 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.157065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 7989980b-d124-4aea-a8ac-c2e0dec65057 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:50.158357 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82fd2dcc-2576-4d8e-a176-9c12732f2570 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057" status: 404 len: 111 microversion: 2.1 time: 0.045365 Aug 30 17:51:50.159133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2361/4972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:50 2022] GET /compute/v2.1/servers/7989980b-d124-4aea-a8ac-c2e0dec65057 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:50.177723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.180256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.192948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 HTTP/1.1 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '896259ae-e867-4062-9c5b-5e696556a493'} Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.194830 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.199552 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.201881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:50.202944 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7d76508-eba4-4a15-91c6-57dc1594e083 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493" status: 404 len: 111 microversion: 2.1 time: 0.038603 Aug 30 17:51:50.204695 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2362/4973] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:50 2022] DELETE /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:50.212735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.213583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 896259ae-e867-4062-9c5b-5e696556a493] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.223970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 HTTP/1.1 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '896259ae-e867-4062-9c5b-5e696556a493'} Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:50.225542 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 896259ae-e867-4062-9c5b-5e696556a493 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:50.230429 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5fa29a7b-1e5f-4ee1-9572-16c1da27c5a9 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493" status: 404 len: 111 microversion: 2.1 time: 0.018285 Aug 30 17:51:50.232367 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2363/4974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:50 2022] GET /compute/v2.1/servers/896259ae-e867-4062-9c5b-5e696556a493 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:51:50.236207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.236704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.247026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.247387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.247931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.248577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.249987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.250277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.312033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:51:50.562738 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d22eab19-3847-4250-90e0-12ecfe577b91 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "DELETE /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 204 len: 0 microversion: 2.1 time: 0.330483 Aug 30 17:51:50.568052 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2364/4975] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:50 2022] DELETE /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:51:50.604039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.605251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.620076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.620576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.621021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.627212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.630300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.630882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.820548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:50.839882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-812e941d-7db2-43ea-86b3-02e7713b93ef tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1656 microversion: 2.1 time: 0.740504 Aug 30 17:51:50.844922 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2612/4976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:50 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1656 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:50.877286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:50.878579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:50.890725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.891761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.892744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.894298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:50.897493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:50.898523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:50.940096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:50.951616 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0218e76c-aa89-4f58-bce5-a949d32ea538 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1479 microversion: 2.1 time: 0.378833 Aug 30 17:51:50.967999 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2365/4977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:50 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1479 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:50.979723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:51.011395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.011932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.012372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.052324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:51.062285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:51:51.182711 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7f2ca4f-6468-4202-91c0-2a858e586710 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action" status: 202 len: 0 microversion: 2.1 time: 0.212800 Aug 30 17:51:51.183356 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2366/4978] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:50 2022] POST /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:51:51.194946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2367f7f9-2633-4030-ab63-74a0a255411e", "name": "network-vif-plugged", "status": "completed", "tag": "c6ed2315-fd5e-4fb0-920c-44c6b15f1805"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:51.239593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.244518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.246846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.277402 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] Creating event network-vif-plugged:c6ed2315-fd5e-4fb0-920c-44c6b15f1805 for instance 2367f7f9-2633-4030-ab63-74a0a255411e on n-h2-852771-11 Aug 30 17:51:51.289762 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0d6ab87f-a43f-4f24-bb10-846d40e9c907 req-87fa2cf0-522a-4561-993a-fab7c941da45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104945 Aug 30 17:51:51.299873 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2367/4979] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:51.307761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:51.309116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:51.328328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.329178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.329834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.330785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.331440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.332110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.583284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:51.591351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfbd814a-f721-47a9-9897-2c5c72350a3c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.721248 Aug 30 17:51:51.604630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2613/4980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:50 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:51.612547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:51.614304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:51.621616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.622343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.622981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.623943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.625059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.625670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.666025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:51.748657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:51.764210 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-60ce7cb3-7969-4b79-9aab-6bd82838a7f1 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1485 microversion: 2.1 time: 0.461900 Aug 30 17:51:51.764986 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2368/4981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:51 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1485 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:51.792921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:51.794259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:51.803815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.804588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.805502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.806437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.808913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.809615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.914701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1bf21114-6bae-486f-974e-29ee6eeae6fe tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "POST /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19/action" status: 202 len: 0 microversion: 2.1 time: 0.132540 Aug 30 17:51:51.918900 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2369/4982] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:51 2022] POST /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:51:51.928620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:51.929484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:51.940630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.941220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.942392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:51.943296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:51.944046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:51.944540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:52.041060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:52.055128 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-376d26a5-9b7b-4fec-a838-c9b3c795fde6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.448834 Aug 30 17:51:52.060326 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2614/4983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:51 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:52.072665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:52.074080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:52.085275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:52.086762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:52.087596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:52.088987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:52.089655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:52.090487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:52.556281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:52.571444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f53396c4-da6b-4342-9386-afc402249bd8 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1479 microversion: 2.1 time: 0.506420 Aug 30 17:51:52.572514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2615/4984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:52 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1479 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:52.619106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:52.619891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:52.628070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:52.628572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:52.629669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:52.630403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:52.631116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:52.631778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:52.862978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:52.877765 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2091957-c454-470d-be1c-8a37a5c6d2d4 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1493 microversion: 2.1 time: 0.956906 Aug 30 17:51:52.879664 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2370/4985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:51 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1493 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:52.928711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:52.939922 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c6eb0cd-0207-4369-b7af-7329ce4ca1ad tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1322 microversion: 2.1 time: 0.326351 Aug 30 17:51:52.940744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2616/4986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:52 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:53.078842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:53.079817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:53.088877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.089934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.090599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.091835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.092508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.093169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.314339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099dbd08-b3b7-440a-bc93-c6dedaf2c06e", "name": "network-vif-deleted", "tag": "9c8db8ab-d118-436b-b20f-9db7ee8c3eea"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:53.352304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.355756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.358327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.405981 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] Creating event network-vif-deleted:9c8db8ab-d118-436b-b20f-9db7ee8c3eea for instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e on n-h1-852771-11 Aug 30 17:51:53.422323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-82c27fc0-1d2c-4dea-bfd7-934d4badbfbd req-8b584383-1512-4ba2-8ac2-067a45947215 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115995 Aug 30 17:51:53.423789 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2617/4987] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:51:53.596608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:53.598391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:53.606937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:53.626191 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-459f8700-9136-40c0-9406-f32c0eb2b8bc tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.551267 Aug 30 17:51:53.629341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.629873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.630324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.630678 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2371/4988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:53 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:53.643993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.645389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.646147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.687266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.688541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.689180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.689899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lazy-loading 'fault' on Instance uuid 099dbd08-b3b7-440a-bc93-c6dedaf2c06e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:53.760066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e86d7db7a54b6d8046c3d496584bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d039d9401f6443a8229a96ccceab620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:53.778274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6fe1023-df13-4027-8220-26fbb93a1bc1 tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 200 len: 1283 microversion: 2.1 time: 0.187667 Aug 30 17:51:53.778955 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2618/4989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:53 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 1283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:53.901633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:53.902316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:53.916177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.917102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.917835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.918997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.919784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.920475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.962349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:53.963293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:53.971322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.973464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.975562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:53.976654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:53.992280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:53.995871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:54.385929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:54.415404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f728dff-521e-42e0-b775-68f0ca6e5266 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1493 microversion: 2.1 time: 0.515495 Aug 30 17:51:54.419706 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2372/4990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:53 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1493 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:54.654399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:54.655457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:54.663037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:54.663906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:54.664584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:54.665562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:54.666253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:54.666774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:54.830931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:54.839646 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2aaebc0-4421-41d3-adda-81f84150b148 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.188761 Aug 30 17:51:54.851948 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2373/4991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:54 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:51:54.859748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:54.860535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] [instance: 099dbd08-b3b7-440a-bc93-c6dedaf2c06e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:54.867801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:54.868396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:54.868834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:54.869568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:54.869964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:54.870380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:54.885554 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] HTTP exception thrown: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Request method failure captured: Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e HTTP/1.1 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk0vQs37pR8nOldzcdG6r7z0joLnoOL34gMtG-nRnJ3e6o1gXF9EZclQeCWPpaUNVk_c4gqpdQEZnHJlWlcmbAbT-VkLVfiGsdpx57c5scmNS3Ulz2TwuhcmOFeQ74ejlJWjofeTE8b8fLfFJBPA4oa2eyznrJo7MNWXYk7eJbeYnOw Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d039d9401f6443a8229a96ccceab620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d039d9401f6443a8229a96ccceab620"}]}] Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersTestJSON-466807475 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 6d039d9401f6443a8229a96ccceab620 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersTestJSON-466807475 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersTestJSON-466807475-project Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 91e86d7db7a54b6d8046c3d496584bd1 Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersTestJSON-466807475-project Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '099dbd08-b3b7-440a-bc93-c6dedaf2c06e'} Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:54.887346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] Returning 404 to user: Instance 099dbd08-b3b7-440a-bc93-c6dedaf2c06e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40ef7b48-8ab3-4ab4-88a8-41c67a1819ff tempest-ServersTestJSON-466807475 tempest-ServersTestJSON-466807475-project] 10.222.0.50 "GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e" status: 404 len: 111 microversion: 2.1 time: 0.035718 Aug 30 17:51:54.894881 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2374/4992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:54 2022] GET /compute/v2.1/servers/099dbd08-b3b7-440a-bc93-c6dedaf2c06e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:51:55.070393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:55.082514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-79c057b1-36e0-4fed-aef1-414095454829 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1517 microversion: 2.1 time: 1.123729 Aug 30 17:51:55.097203 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2619/4993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:53 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1517 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:55.108074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:51:55.111337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:55.122897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.123869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.124619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.129469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.130300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.130981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.167074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'flavor' on Instance uuid 2367f7f9-2633-4030-ab63-74a0a255411e {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:51:55.312669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54c93d39-53db-4df7-86ad-fcfa931e5f8d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action" status: 200 len: 32 microversion: 2.1 time: 0.210257 Aug 30 17:51:55.314276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2375/4994] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:51:55 2022] POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:51:55.326693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:55.327525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:55.339419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.340822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.343923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.345076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.345805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.346536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.437340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:55.438038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:55.448254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.452277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.452967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.453879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.454500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.455119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.834978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:55.843744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5d2212b-0eb1-4ecf-9de6-6b070cab63b1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.520491 Aug 30 17:51:55.844630 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2620/4995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:55 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:55.865177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:55.866173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:55.874464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.875338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.876217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:55.877347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:55.878312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:55.879904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:56.018318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:56.033595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-326ce63c-f3fa-47af-935e-cda344eaae97 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1493 microversion: 2.1 time: 0.599864 Aug 30 17:51:56.034845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2376/4996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:55 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1493 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:56.285675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:56.305411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ff614a9-dd56-4c2f-b105-9ed717909b8d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.444911 Aug 30 17:51:56.306762 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2621/4997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:55 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:56.870164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:56.870920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:56.881016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:56.885961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:56.886505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:56.887263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:56.887755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:56.890872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:57.062009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:57.064250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:57.072531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:57.073690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:57.074504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:57.075862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:57.076655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:57.077633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:57.512107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:57.528225 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a0ac0e1-b1d7-472c-a688-27ea9ac75dd7 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1499 microversion: 2.1 time: 0.474055 Aug 30 17:51:57.529720 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2622/4998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:57 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1499 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:57.537283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:57.538232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:57.557165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:57.557795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:57.558523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:57.559530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:57.560220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:57.560882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:57.996996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:58.011738 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ed23449-326b-4fc7-ae94-efd86b14bb84 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 1.149455 Aug 30 17:51:58.012553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2377/4999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:56 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:58.021396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:58.022192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:58.055389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:58.059558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:58.060561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:58.062243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:58.063364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:58.067323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:58.097959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:58.106786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-33087fa7-0a7b-418f-a883-9f95413ac4f3 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.574897 Aug 30 17:51:58.109423 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2623/5000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:57 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:58.113670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:51:58.192162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:58.251884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9756100c-f646-41f3-b5e4-7d354e094868 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 204 len: 0 microversion: 2.1 time: 0.237200 Aug 30 17:51:58.253678 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2378/5001] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:51:58 2022] DELETE /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:51:58.263423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:58.264350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:58.275073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:58.275595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:58.276043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:58.276752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:58.277202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:58.277623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:58.639290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:51:58.829268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:58.844136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-857f61e1-bd63-4fee-a276-93e78ddb7b12 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.585189 Aug 30 17:51:58.847876 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2624/5002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:58 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:59.045068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:59.046392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:59.071159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.071398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.075982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:59.080860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.080860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.080860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:59.133585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:59.134204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:59.146502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.148994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.150344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:59.152560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.155728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.156467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:59.408511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:59.422816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac8e977f-4abb-4c42-ab33-31a6768ac753 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.387196 Aug 30 17:51:59.423795 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2379/5003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:59 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:59.714702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:51:59.724597 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-930ccbb7-6f4e-4fd0-9909-d5bd92e02c4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.597556 Aug 30 17:51:59.725195 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2625/5004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:59 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:51:59.872733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:51:59.873995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:51:59.885407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.887296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.887945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:51:59.891503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:51:59.892215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:51:59.892767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:00.284446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:00.311909 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03110785-df71-4233-8229-1924a026475e tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.445238 Aug 30 17:52:00.313778 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2380/5005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:51:59 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:00.447200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:00.447876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:00.463845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:00.464654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:00.465266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:00.466158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:00.466800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:00.467396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:00.745836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:00.750705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:00.774304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:00.774304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:00.789374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:00.790546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:00.791765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:00.792245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:01.258799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:01.270708 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d115035f-cbe3-4b56-a910-4fb3520b6cff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1665 microversion: 2.1 time: 0.529181 Aug 30 17:52:01.272631 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2381/5006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:00 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1665 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:01.342194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:01.344872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:01.360378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:01.361342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:01.361961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:01.365172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:01.365866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:01.367226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:01.507591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:01.524270 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9d1a974-2a88-4797-a3be-90a8d8b7b3d4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 1.079751 Aug 30 17:52:01.525798 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2626/5007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:00 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:01.723816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:01.733058 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a01282d7-2ef1-4a50-ba7a-fb5ff0b001f9 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1505 microversion: 2.1 time: 0.397517 Aug 30 17:52:01.733696 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2382/5008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:01 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:02.169500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3caf912b-44ff-42df-865a-7b2f74770d19", "name": "network-vif-deleted", "tag": "c0120007-6612-4285-9c20-8e9daf49b543"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:02.195507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.196007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.196429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.266403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] Creating event network-vif-deleted:c0120007-6612-4285-9c20-8e9daf49b543 for instance 3caf912b-44ff-42df-865a-7b2f74770d19 on n-h1-852771-11 Aug 30 17:52:02.286699 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6b27f087-341d-4329-85c1-b1d962951b37 req-a5dcfad7-8371-46ac-b555-a5dc470928a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120900 Aug 30 17:52:02.289528 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2627/5009] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:02.295286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:02.296175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:02.308662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.321777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.325097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.328626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.329965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.333912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.553027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:02.554457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:02.577695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:02.580260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.580917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.581369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.583084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.583771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.584388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.924875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:02.939177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e112d43-689c-49ba-a5dc-7b54ef49d2f4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1669 microversion: 2.1 time: 0.646116 Aug 30 17:52:02.952992 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2383/5010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:02 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1669 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:02.965969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:02.966960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:02.974937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.975816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.976495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:02.977467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:02.978156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:02.978815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:03.018756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:03.020807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:03.021486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:03.022174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lazy-loading 'fault' on Instance uuid 3caf912b-44ff-42df-865a-7b2f74770d19 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:52:03.054464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:03.065164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d9b87c3-acda-4ec5-ba90-d871fe127285 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.518538 Aug 30 17:52:03.080506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2628/5011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:02 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:03.098554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:03.110271 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c137b34d-a030-4106-8f21-e178548b1e46 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 200 len: 1303 microversion: 2.1 time: 0.155802 Aug 30 17:52:03.119902 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2384/5012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:02 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:04.089548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:04.090240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:04.106777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.107665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.108699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.109066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.109574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.110012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.134907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:04.136479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 3caf912b-44ff-42df-865a-7b2f74770d19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:04.169891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.170621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.172043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.172938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.175801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.180909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.228743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] HTTP exception thrown: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Request method failure captured: Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 HTTP/1.1 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk29Sj91wgJ4l1xu5--mcFJnV1Q28i15yD3-_8A3ZU5fZXeafCZEsD6kAooey4obOPy0DEdu5DIbWyqH9tC9tMN_p5tyZijZLBgfnZRZEe2Ec6I1Ad_dvC6yEfDrxsG3mfAwgovonx837XxIKPch1_kzmEYdis4sirFKHhcMkyQRekE Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: d45dcdf5ca3845ce89881e9fe215a084 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d45dcdf5ca3845ce89881e9fe215a084"}]}] Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: d45dcdf5ca3845ce89881e9fe215a084 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerRescueTestJSON-48797540-project Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 3ac1df3fd32a4753ac0978c7d11b80fc Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerRescueTestJSON-48797540-project Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '3caf912b-44ff-42df-865a-7b2f74770d19'} Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:04.243058 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:04.248795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Returning 404 to user: Instance 3caf912b-44ff-42df-865a-7b2f74770d19 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:52:04.256012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb2c3841-0522-4904-81ff-9ab20041740d tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19" status: 404 len: 111 microversion: 2.1 time: 0.121569 Aug 30 17:52:04.256898 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2385/5013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:04 2022] GET /compute/v2.1/servers/3caf912b-44ff-42df-865a-7b2f74770d19 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:52:04.285604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:04.286032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:04.313124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.313623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.314071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.314794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.315254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.315718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.409941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:52:04.645373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78ad2610-9f9f-42f7-b6af-766fbcd5bd24 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 204 len: 0 microversion: 2.1 time: 0.372548 Aug 30 17:52:04.649087 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2386/5014] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:52:04 2022] DELETE /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:52:04.669646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:04.671013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:04.678610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.680391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.682492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.683407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:04.684583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:04.685189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:04.750250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:04.771248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-845ab6cd-0e12-4a65-86dd-e48788e5b888 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.677491 Aug 30 17:52:04.772734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2629/5015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:04 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:05.032765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:05.043934 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a8beeaf-47ae-4d66-9bfc-07eaeebbe858 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1493 microversion: 2.1 time: 0.389557 Aug 30 17:52:05.045470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2387/5016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:04 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1493 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:05.522324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a7ae998-1cd9-41a6-bb9e-16068866d2cc tempest-ExtensionsTest-1485083614 tempest-ExtensionsTest-1485083614-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:05.523971 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a7ae998-1cd9-41a6-bb9e-16068866d2cc tempest-ExtensionsTest-1485083614 tempest-ExtensionsTest-1485083614-project] 10.222.0.50 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.188525 Aug 30 17:52:05.525999 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2630/5017] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:52:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:05.538652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1ea2d04-ba1c-44fa-ae75-da878f35c174 tempest-ExtensionsTest-1485083614 tempest-ExtensionsTest-1485083614-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:05.541652 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1ea2d04-ba1c-44fa-ae75-da878f35c174 tempest-ExtensionsTest-1485083614 tempest-ExtensionsTest-1485083614-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010851 Aug 30 17:52:05.542841 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2388/5018] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 17:52:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:52:05.801138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:05.802233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:05.810564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:05.811439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:05.812276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:05.813748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:05.814832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:05.816855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:06.066496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:06.068092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:06.101042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:06.102110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:06.107879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:06.112547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:06.114010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:06.120174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:06.421725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:06.458228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ab25e7c-6f9b-4901-bd05-3998284ca469 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.664796 Aug 30 17:52:06.460170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2631/5019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:05 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:06.643903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:06.651749 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91f9e0b4-2711-458a-b072-97407e29ec04 tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1493 microversion: 2.1 time: 0.589571 Aug 30 17:52:06.652324 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2389/5020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:06 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1493 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:07.491240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:07.491915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:07.513619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:07.520187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:07.520774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:07.521639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:07.528279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:07.530953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:07.675151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:07.676501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:07.690501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:07.690501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:07.691388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:07.691849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:07.692503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:07.699783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:08.016058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:08.030258 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83be242d-4c25-4d26-8c1e-fb319b35deec tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.540302 Aug 30 17:52:08.033363 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2632/5021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:07 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:08.228912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:08.259056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f403d8e-b571-48c2-84f7-7669c20d20ac tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1493 microversion: 2.1 time: 0.587688 Aug 30 17:52:08.261476 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2390/5022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:07 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1493 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:08.952834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de7af36-70e0-4cb7-bc48-46ef1b5e20d9", "name": "network-vif-deleted", "tag": "8cd54b83-bf1d-4f56-b9d7-027c360d5fb6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:08.983991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:08.985187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:08.987972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:08.993137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:09.014100 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] Creating event network-vif-deleted:8cd54b83-bf1d-4f56-b9d7-027c360d5fb6 for instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 on n-h2-852771-11 Aug 30 17:52:09.030391 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9df5d01d-adfe-4b57-92d9-2fd98df8a047 req-fa10752f-f897-4aad-a337-d01d2d88184b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081121 Aug 30 17:52:09.034038 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2633/5023] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:09.056237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:09.057890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:09.074075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:09.077582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:09.078281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:09.079371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:09.080080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:09.082512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:09.284265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:09.285644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:09.293261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:09.294136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:09.294759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:09.295703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:09.298513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:09.299174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:09.325021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:09.340224 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9717a428-7702-4491-b6b8-5e9a2113edbd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.290780 Aug 30 17:52:09.341132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2391/5024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:09 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:09.395822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:09.396722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:09.397399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:09.398070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lazy-loading 'fault' on Instance uuid 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:52:09.901539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac1df3fd32a4753ac0978c7d11b80fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45dcdf5ca3845ce89881e9fe215a084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:09.913773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58046181-3dc3-4b10-b535-7efa204f0b3f tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 200 len: 1304 microversion: 2.1 time: 0.635160 Aug 30 17:52:09.923641 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2634/5025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:09 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 1304 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:10.366054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:10.367393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:10.378104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:10.378596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:10.380982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:10.383661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:10.384143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:10.384951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:10.850735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:10.866907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fcc2f13-9af8-435d-abf1-ee8462f485c3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.507652 Aug 30 17:52:10.867812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2392/5026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:10 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:10.937417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:10.938313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] [instance: 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:10.957478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:10.958455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:10.959229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:10.960508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:10.961315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:10.962055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:10.984482 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] HTTP exception thrown: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Request method failure captured: Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 HTTP/1.1 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk29Sj91wgJ4l1xu5--mcFJnV1Q28i15yD3-_8A3ZU5fZXeafCZEsD6kAooey4obOPy0DEdu5DIbWyqH9tC9tMN_p5tyZijZLBgfnZRZEe2Ec6I1Ad_dvC6yEfDrxsG3mfAwgovonx837XxIKPch1_kzmEYdis4sirFKHhcMkyQRekE Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: d45dcdf5ca3845ce89881e9fe215a084 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d45dcdf5ca3845ce89881e9fe215a084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d45dcdf5ca3845ce89881e9fe215a084"}]}] Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: d45dcdf5ca3845ce89881e9fe215a084 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueTestJSON-48797540 Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueTestJSON-48797540-project Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 3ac1df3fd32a4753ac0978c7d11b80fc Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueTestJSON-48797540-project Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8de7af36-70e0-4cb7-bc48-46ef1b5e20d9'} Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:10.986688 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. Aug 30 17:52:10.992070 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:10.994420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] Returning 404 to user: Instance 8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:52:10.995775 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be4cd788-8432-4753-9a4c-73773c0d5f9c tempest-ServerRescueTestJSON-48797540 tempest-ServerRescueTestJSON-48797540-project] 10.222.0.50 "GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9" status: 404 len: 111 microversion: 2.1 time: 0.063471 Aug 30 17:52:10.996949 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2635/5027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:10 2022] GET /compute/v2.1/servers/8de7af36-70e0-4cb7-bc48-46ef1b5e20d9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:52:11.889365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:11.890607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:11.904684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:11.906771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:11.908107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:11.909335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:11.910968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:11.912056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:12.557978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:12.575266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d59717e4-4414-4cac-8eaa-1b588c535354 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.688997 Aug 30 17:52:12.591992 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2393/5028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:11 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:13.602184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:13.602814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:13.615652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:13.621076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:13.621879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:13.623566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:13.626142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:13.627370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:14.154717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:14.168344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c61f4957-d96f-4de9-a60c-0e6f0b201c92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.571254 Aug 30 17:52:14.185272 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2636/5029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:13 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:15.192271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:15.193056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:15.211321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:15.212511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:15.213335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:15.215558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:15.216948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:15.218058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:15.632316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:15.643785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c668398c-686c-4b31-a5e1-37511701f5fa tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.456654 Aug 30 17:52:15.660343 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2394/5030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:15 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:16.673131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:16.673853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:16.693917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:16.694510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:16.695027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:16.695878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:16.699414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:16.700062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:17.631950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:17.647634 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cccabbc-878f-4ae9-912f-2e6e73b3c614 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.980500 Aug 30 17:52:17.652620 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2637/5031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:16 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:18.678135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:18.679346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:18.699319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:18.700129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:18.700866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:18.703209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:18.706916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:18.707607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:18.716652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:19.396788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:19.416950 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c129493-b2d0-4c04-b4cd-c3dd3548f734 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.747337 Aug 30 17:52:19.428669 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2395/5032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:18 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:20.455154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:20.456093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:20.463132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:20.463801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:20.464251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:20.464989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:20.465457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:20.465896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:21.189974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:21.203730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ddaf2e1-b112-4f87-aa41-7b4d53577d8b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.753724 Aug 30 17:52:21.206203 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2638/5033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:20 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:21.383349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a09fb5f-c998-4186-ab67-69bccc6e306e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: .version_select at 0x7f2d93a75e50>, body: {"keypair": {"name": "tempest-keypair-78191214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6u5Mq3vqEOmtwQJjDdNCODZpHWpFnh3jSzID7JsllMoKUI7tcBVXIydVOM2jGu3Hz5FgF5eOzrrht1TdkyU6QyPyZiU5ol+VqGz9kxzC0KbhKKchd9fKR8SiLnyL4aDg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:21.391317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:21.430720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6a09fb5f-c998-4186-ab67-69bccc6e306e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:21.450765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6a09fb5f-c998-4186-ab67-69bccc6e306e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:21.523957 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a09fb5f-c998-4186-ab67-69bccc6e306e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.456342 Aug 30 17:52:21.525275 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2396/5034] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:52:21 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:22.224912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:22.226276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:22.236287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:22.242800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:22.243607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:22.244604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:22.246052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:22.246827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:22.707749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:22.729966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50b00ce5-0324-42c6-9d9d-9f562eb60dde tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.509478 Aug 30 17:52:22.731443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2639/5035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:22 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:23.758797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:23.759914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:23.771601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:23.774915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:23.777172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:23.778056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:23.779237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:23.780949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:24.562025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:24.577379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d17636c6-2e32-4a02-8db1-8ce0769855f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.820521 Aug 30 17:52:24.587512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2397/5036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:23 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:25.602614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:25.603956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:25.614860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:25.622814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:25.623743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:25.624737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:25.626838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:25.628787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:26.429822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:26.443589 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dacd1b75-1186-4df6-a7dc-0152cb8930d3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.845348 Aug 30 17:52:26.444732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2640/5037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:25 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:27.360034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-225985282", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9c5be2-f5e4-49b8-9312-c995d1b4829c"}], "security_groups": [{"name": "tempest-securitygroup--547930195"}], "key_name": "tempest-keypair-78191214", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:27.469133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:27.470387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:27.489664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:27.492110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:27.497482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:27.498439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:27.498876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:27.499310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:27.973310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] validate_networks() for [('1b9c5be2-f5e4-49b8-9312-c995d1b4829c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:52:28.271866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:28.309102 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ff0e7d5d-58c8-490a-9952-dbca70909c47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.843988 Aug 30 17:52:28.319289 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2641/5038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:27 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:29.355148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:29.356231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:29.395145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:29.396045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:29.396711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:29.397693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:29.416115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:29.417164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:30.500466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:30.562301 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd235a76-88da-4e96-836d-bf0f0f4348a1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 1.205634 Aug 30 17:52:30.597671 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2642/5039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:29 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:31.307653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e2b0bc7-a82b-4246-bdab-cfaf98dd26df tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: .version_select at 0x7f2d9cc57040>, body: {"keypair": {"name": "tempest-keypair-970536495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG92RtHv9z15QXMG9T34eHl+Jsu4lHD9fFOHl8LyX6dvuWWPJWdrsRcXqvmecZShKMtxaaMER2AxEQmkD/p18+AssX+Be6npJUpF9RvMcXP+eLj+puSTeTmTDG7g82Jn9A=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:31.333517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9e2b0bc7-a82b-4246-bdab-cfaf98dd26df tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:31.355766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9e2b0bc7-a82b-4246-bdab-cfaf98dd26df tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for user dff3e8a1712d4dc5a7b96ddf7bae30f5 and project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:31.414554 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e2b0bc7-a82b-4246-bdab-cfaf98dd26df tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.267543 Aug 30 17:52:31.415187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2643/5040] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:52:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:52:31.473830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:31.613335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:31.614207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:31.631150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:31.632126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:31.632639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:31.633720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:31.634348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:31.635088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.207614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:32.217237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f407e122-0625-4363-b22a-435de9e1e68c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1523 microversion: 2.1 time: 0.610001 Aug 30 17:52:32.233056 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2644/5041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:31 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1523 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:32.241142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:32.244206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:32.250648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.251419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.253367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.254313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.255002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.255700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.315361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7cd153b6-0db2-4b3d-bfa2-6476db68eca6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080489 Aug 30 17:52:32.316844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2645/5042] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:52:32 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:52:32.412332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:52:32.412892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:52:32.413451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:52:32.413901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:52:32.414325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:52:32.424558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:32.425508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:32.440362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.441044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.441631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.442702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.443332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.443929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.446071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.446694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.449648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.451721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.454992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.455805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.494624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:32.503574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:32.526610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:52:32.529523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:52:32.541718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:52:32.598721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e865641-8596-416e-abda-723008362eda tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.243809 Aug 30 17:52:32.600572 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2398/5043] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:52:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 5246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:52:32.617986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a5f8ce1-b229-49c3-be3a-8bcdb8dc8399 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:32.619785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a5f8ce1-b229-49c3-be3a-8bcdb8dc8399 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:32.689829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:32.724580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d678002-41ed-4d50-8654-f32485789bff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 204 len: 0 microversion: 2.1 time: 0.304617 Aug 30 17:52:32.725701 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2646/5044] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:52:32 2022] DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:52:32.739366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:32.744991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:32.762287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.762917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.764392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:32.767448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:32.783421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:32.788786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:33.368024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a5f8ce1-b229-49c3-be3a-8bcdb8dc8399 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:33.375853 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a5f8ce1-b229-49c3-be3a-8bcdb8dc8399 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1239 microversion: 2.1 time: 0.767237 Aug 30 17:52:33.376456 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2399/5045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:32 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1239 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:33.387393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:33.400477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:33.414851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:33.415317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:33.415792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:33.416608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:33.416963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:33.417432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:33.477222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:33.488886 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2941a8da-d43e-451f-8ff2-9a63a7dfce31 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1675 microversion: 2.1 time: 0.756710 Aug 30 17:52:33.489501 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2647/5046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:32 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1675 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:33.949078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:33.967279 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-53558e68-2930-4aa8-abb0-42a83e090bc9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1503 microversion: 2.1 time: 0.583718 Aug 30 17:52:33.968582 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2400/5047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:33 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1503 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:33.993051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:33.993684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:34.001290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.002307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.003046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.003801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.004265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.004700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.400224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:34.400908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:34.429891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.432091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.434020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.434988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.437007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.442635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.565884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:34.578832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-426815d5-f6cd-47af-b08a-39af42aa6163 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1513 microversion: 2.1 time: 0.589568 Aug 30 17:52:34.587230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2648/5048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:33 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1513 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:34.604975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:34.605781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:34.633454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.634089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.635986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.638377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.644421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.645294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.667686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:34.700606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-779512cc-a8b2-40c2-ad6e-1a9d91e12ab6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1235 microversion: 2.1 time: 0.289629 Aug 30 17:52:34.724875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2401/5049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:34 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1235 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:34.739238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:34.743167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: b53f375c-c368-431d-8eed-c4805fb711cd] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:34.760937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/b53f375c-c368-431d-8eed-c4805fb711cd/action HTTP/1.1 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 14 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: {"rescue": {}} Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b53f375c-c368-431d-8eed-c4805fb711cd', 'body': {'rescue': {}}} Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:34.770081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. Aug 30 17:52:34.773833 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:52:34.775146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 404 to user: Instance b53f375c-c368-431d-8eed-c4805fb711cd could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:52:34.776245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f925df0-da79-4d9d-ad5d-6083627e23a3 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/b53f375c-c368-431d-8eed-c4805fb711cd/action" status: 404 len: 111 microversion: 2.1 time: 0.050233 Aug 30 17:52:34.785540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2402/5050] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:52:34 2022] POST /compute/v2.1/servers/b53f375c-c368-431d-8eed-c4805fb711cd/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:52:34.795967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:34.796900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:34.811179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.816612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.819202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:34.820213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:34.822534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:34.823989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:35.025140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf576798-8e61-4ba2-968e-9fcb8b217ffd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action" status: 202 len: 0 microversion: 2.1 time: 0.231321 Aug 30 17:52:35.027589 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2403/5051] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:52:34 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:52:35.057433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:35.067781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:35.093861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:35.094352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:35.094801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:35.104840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:35.105479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:35.107345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:35.472103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:35.484490 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b27c1bf0-3d2a-40c9-87bf-5e812eb24a60 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1675 microversion: 2.1 time: 0.895929 Aug 30 17:52:35.485104 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2649/5052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:34 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1675 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:35.631290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1161054713", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0487c3d-dbba-4112-b26b-4eb945dd9893"}], "security_groups": [{"name": "tempest-securitygroup--1897356188"}], "key_name": "tempest-keypair-970536495", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:35.791951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] validate_networks() for [('a0487c3d-dbba-4112-b26b-4eb945dd9893', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:52:36.508313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:36.508834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:52:36.509946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:52:36.510434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:52:36.510884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:52:36.511303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:52:36.530792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.531700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.534443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.536551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.537529 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7cbc9700-4763-4318-8fc4-ebc3776ad9c2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1518 microversion: 2.1 time: 1.505384 Aug 30 17:52:36.539378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.540691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.543287 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2404/5053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:35 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1518 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:36.562597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:36.563499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:36.568379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:36.590350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.592865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.598785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.601819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.603569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.604187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.628894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:36.641539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for user dff3e8a1712d4dc5a7b96ddf7bae30f5 and project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:36.671229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:52:36.677039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:52:36.788526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81b827db-d75b-4e55-a10d-c0a201b6a027 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.162966 Aug 30 17:52:36.789405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2650/5054] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:52:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 17:52:36.794364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a23528af-5996-4d0e-913b-7c155e16775b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: .version_select at 0x7f2d9cc57040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1376063299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyDlRIZt868foKqliDi41L2MGCoHy3k+OdHWzXt6uzvE/YvPMTL7dlss2SEH3NgzrkHZwHzUsbuTzTVUziEI7J+W90AZ6HpOsiFhQuxM50JXRmmRXU4lXTSYSew2DpInw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:36.816424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a23528af-5996-4d0e-913b-7c155e16775b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:36.823041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a23528af-5996-4d0e-913b-7c155e16775b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:36.838094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:36.855795 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b68441b-ca3e-4fe6-964f-07bf65e47ac0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1297 microversion: 2.1 time: 0.309151 Aug 30 17:52:36.860047 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2405/5055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:36 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1297 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:36.901603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:36.902327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:36.909202 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a23528af-5996-4d0e-913b-7c155e16775b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.118618 Aug 30 17:52:36.933243 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2651/5056] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:52:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:36.937022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.937526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.937966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.942624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:36.944401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:36.944895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:36.945337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:36.945697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:37.168783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:37.179995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:37.186905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:37.191107 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37a28024-9b23-4466-b28d-705d47d64439 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1281 microversion: 2.20 time: 0.256581 Aug 30 17:52:37.192299 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2652/5057] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:36 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:37.568816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:37.569412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:37.589402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:37.591224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:37.591950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:37.593798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:37.597022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:37.597489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:37.938523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:37.953956 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2255074-66b5-4dfc-b8c8-430fcf37ad49 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1675 microversion: 2.1 time: 1.080081 Aug 30 17:52:37.955430 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2406/5058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:36 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1675 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:37.988891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:37.990003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:38.008073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.010690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.013895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.014846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.015541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.016164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.287461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:38.300930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ac12a65-5107-4e90-acb8-7033f203d2c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1297 microversion: 2.1 time: 0.329802 Aug 30 17:52:38.303613 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2407/5059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:37 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1297 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:38.313595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:38.315150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:38.329625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:38.334098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.335569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.336581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.339511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.341024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.348270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.356550 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f5c1166-e2c9-4e08-af95-2920906752fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1498 microversion: 2.1 time: 0.782511 Aug 30 17:52:38.359625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2653/5060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:37 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1498 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:38.382172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:38.385148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:38.404729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.405265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.405724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.406492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.406950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.407496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.495188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'flavor' on Instance uuid 48313007-4ae9-453a-89c4-3d27094a8617 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:52:38.511706 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Cannot 'rescue' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state paused Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action HTTP/1.1 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 14 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: {"rescue": {}} Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'rescue' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state paused Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '48313007-4ae9-453a-89c4-3d27094a8617', 'body': {'rescue': {}}} Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48313007-4ae9-453a-89c4-3d27094a8617 in vm_state paused. Cannot rescue while the instance is in this state. Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state paused Aug 30 17:52:38.519573 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state paused Aug 30 17:52:38.522900 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:38.527332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 409 to user: Cannot 'rescue' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state paused {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:52:38.528657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-007fcf3f-bfaa-4945-a53e-2547609bc3f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action" status: 409 len: 144 microversion: 2.1 time: 0.152029 Aug 30 17:52:38.533970 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2654/5061] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:52:38 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action => generated 144 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 17:52:38.542943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:38.543865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:38.557491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.558489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.559295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.560373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.561105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.561744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.764040 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-39153f57-3d50-4de3-9bb1-653a9f065036 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action" status: 202 len: 0 microversion: 2.1 time: 0.227493 Aug 30 17:52:38.766234 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2655/5062] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:52:38 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:52:38.803794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:38.808467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:38.824986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.828071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.828708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.829593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:38.832510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:38.833313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:38.931616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:38.941475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:38.945787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:38.949245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc8a193a-40e3-4e40-b839-427718af8541 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1277 microversion: 2.20 time: 0.644386 Aug 30 17:52:38.951809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2408/5063] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:38 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1277 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:38.981327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:38.982530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:39.000530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:39.004946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:39.006044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:39.007008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:39.008419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:39.009917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:39.559752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:39.569368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d36ff40-544b-43a9-9a55-75702ad6b28d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1675 microversion: 2.1 time: 0.592820 Aug 30 17:52:39.575905 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2409/5064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:38 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1675 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:39.590516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:39.591398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:39.601446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:39.602184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:39.602766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:39.603656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:39.604287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:39.604886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:39.614286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:39.625088 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5e6b0a5-9039-46d0-81b8-eb5e332ae0df tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1505 microversion: 2.1 time: 0.837909 Aug 30 17:52:39.625963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2656/5065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:38 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1505 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:39.751239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:39.762062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4eb7e299-b9fe-46a7-8fd9-d561b1724c33 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1297 microversion: 2.1 time: 0.184761 Aug 30 17:52:39.774560 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2410/5066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:39 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1297 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:39.928117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeeea5c-d741-4d17-b89c-41590b4572db", "name": "network-vif-unplugged", "status": "completed", "tag": "5879cd82-e11f-4344-84c4-ea2847dc469a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:39.953345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:39.953820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:39.959104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:39.978608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:39.979730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:39.987618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] Creating event network-vif-unplugged:5879cd82-e11f-4344-84c4-ea2847dc469a for instance bbeeea5c-d741-4d17-b89c-41590b4572db on n-h1-852771-11 Aug 30 17:52:39.997657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.000609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.001255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.002175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-39c006d2-6bd1-4da7-9408-8e1c87096513 req-776af00f-9759-4531-be40-1846d14a5a45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223485 Aug 30 17:52:40.003231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.003379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2657/5067] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:40.005046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.007032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.401251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:40.426743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:40.431369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:40.435899 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0237c3b-3808-4d17-984e-979f193bc080 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1339 microversion: 2.20 time: 0.459621 Aug 30 17:52:40.436720 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2411/5068] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:39 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1339 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:40.598139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:40.599081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:40.614091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.616933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.623962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.625628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.627609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.628533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.646688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:40.647562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:40.663047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.669449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.670062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.671048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:40.671672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:40.672264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:40.932681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:40.947403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f425d297-8ce4-4e36-9b10-b880d99e616a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1607 microversion: 2.1 time: 0.354419 Aug 30 17:52:40.955188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2658/5069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:40 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1607 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:40.970041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:40.972580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:41.003427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.004305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.005388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:41.006592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.007345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.008623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:41.438299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:41.449361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8827d1de-9b2f-4437-bd4b-53d0a6aff22f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.489981 Aug 30 17:52:41.457146 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2659/5070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:40 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:41.463812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:41.464612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:41.476202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.476709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.477150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:41.477856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.478308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.478729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:41.567313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:41.578480 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78ea104f-1562-4490-be25-4aa746d317fb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1513 microversion: 2.1 time: 0.935873 Aug 30 17:52:41.586021 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2412/5071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:40 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1513 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:41.636054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:41.648697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:41.650141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:41.651271 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a30e3a27-70fe-4887-9200-d30dfb69010e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1339 microversion: 2.20 time: 0.191415 Aug 30 17:52:41.655807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2660/5072] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:41 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:41.973342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:41.974027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:41.984278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.992391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.993129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:41.994263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:41.994954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:41.995591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.142844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:42.152042 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71fb399c-c91e-4e72-8969-4be39c0deeb7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1607 microversion: 2.1 time: 0.183029 Aug 30 17:52:42.152643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2413/5073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:41 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1607 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:42.490521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:42.499835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:42.543225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:42.546471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:42.556422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeeea5c-d741-4d17-b89c-41590b4572db", "name": "network-vif-deleted", "tag": "5879cd82-e11f-4344-84c4-ea2847dc469a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:42.567993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.569241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:42.576276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:42.577483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.597353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:42.613041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:42.615329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:42.617741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.667854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] Creating event network-vif-deleted:5879cd82-e11f-4344-84c4-ea2847dc469a for instance bbeeea5c-d741-4d17-b89c-41590b4572db on n-h1-852771-11 Aug 30 17:52:42.682124 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0c892c44-0971-426a-a018-609dd92f760b req-d8ae1308-de86-450f-bdaf-5b358ccd5eee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130735 Aug 30 17:52:42.683634 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2414/5074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:52:42.700221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:42.701484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:42.726568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:42.727380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:42.728280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.736800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:42.742151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:42.742794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:42.835694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:43.050334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:43.069457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:43.073571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:43.077163 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-18062a1d-1be2-4259-867f-208aead136a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1339 microversion: 2.20 time: 0.388295 Aug 30 17:52:43.077763 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2415/5075] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:42 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1339 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:43.180850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:43.181481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:43.182724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:43.196553 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe1eb410-385b-4aa2-9c8a-83edbe21c9e7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.722327 Aug 30 17:52:43.200344 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2661/5076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:42 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:43.201091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:43.203330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:43.203947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:43.208030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:43.209663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:43.212302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:43.304731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:43.305622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:43.306117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:43.306879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lazy-loading 'fault' on Instance uuid bbeeea5c-d741-4d17-b89c-41590b4572db {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:52:43.372486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:43.631964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:43.652698 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cffe8e1e-b7a4-469f-bbf6-da89edb934f2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 200 len: 1328 microversion: 2.1 time: 0.476692 Aug 30 17:52:43.668982 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2416/5077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:43 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 1328 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:44.105570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:44.106308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:44.121709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.125536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.125993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.129969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.130622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.131211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.221132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:44.221918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:44.231634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.235297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.236365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.247778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.248602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.249408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.636240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:44.643346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:44.654773 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1be0bffa-7037-4932-96f1-8ecd7dbab85a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.437326 Aug 30 17:52:44.685725 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2417/5078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:44 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:44.693513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:44.696688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:44.718336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.724176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:44.726972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:44.727464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.728103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.728966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.729416 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a2b05c11-9392-4e85-ae40-c74c41498707 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.629111 Aug 30 17:52:44.730242 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2662/5079] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:44 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:52:44.731066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.732828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.747595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:44.750382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:44.809492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.817048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.817907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.822201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.824833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.825603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'flavor' on Instance uuid 48313007-4ae9-453a-89c4-3d27094a8617 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:52:44.825942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.886044 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db HTTP/1.1 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bbeeea5c-d741-4d17-b89c-41590b4572db'} Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:52:44.894118 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:52:44.897708 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0f9065f-d7af-4c2d-af45-810bba6f9d98 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 404 len: 111 microversion: 2.1 time: 0.163753 Aug 30 17:52:44.900010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2663/5080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:44 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:52:44.911935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a12f5d0-5ea8-40d4-b991-7bec7808af30", "tag": "146a3883-a2e1-4490-ad2a-e286bece63d3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:44.926862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:44.928207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:44.929093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:44.952317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] Creating event network-changed:146a3883-a2e1-4490-ad2a-e286bece63d3 for instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 on n-h1-852771-11 Aug 30 17:52:44.964055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4a4372e1-922d-4652-9e70-41f229b9300e req-46fa2289-e167-4904-abcb-4ecc4e372572 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063646 Aug 30 17:52:44.965007 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2664/5081] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:44.975271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1570485276", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "294d0776-1cec-437f-af98-82448a199af8"}], "key_name": "tempest-TestNetworkBasicOps-1376063299", "security_groups": [{"name": "tempest-secgroup-smoke-2063199418"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:44.985396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-18da14f0-2730-473d-91af-0868865912b4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action" status: 200 len: 32 microversion: 2.1 time: 0.298237 Aug 30 17:52:44.986533 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2418/5082] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:52:44 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:52:44.997514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc4f87e5-a454-4db2-b5e4-54d2fb47438d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '.version_select at 0x7f2d93a6fc10>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:45.066010 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc4f87e5-a454-4db2-b5e4-54d2fb47438d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611209402" status: 202 len: 0 microversion: 2.1 time: 0.076639 Aug 30 17:52:45.070709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2419/5083] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611209402 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:52:45.091986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:45.099283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:45.116102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:45.122569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:45.123301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:45.126938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:45.127987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:45.135040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:45.740780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] validate_networks() for [('294d0776-1cec-437f-af98-82448a199af8', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:52:45.838734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:45.854107 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8fa5c9c-5d93-47e1-a425-c10f51bf1609 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.781541 Aug 30 17:52:45.855410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2420/5084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:45 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:45.862955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:45.863950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:45.900363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:45.910472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:45.911839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:45.916054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:45.920038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:45.921826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:46.340579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:46.349772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2046be4-3271-477e-9583-80a427e19246 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.491772 Aug 30 17:52:46.350602 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2421/5085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:45 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:46.391878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:46.395688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:46.429134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:46.432235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:46.435620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:46.436658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:46.437314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:46.437925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:46.568796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:47.071582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:47.081358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:47.083034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:47.084828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2bb10b34-35fe-4f64-91a8-bfa5787baeff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.704444 Aug 30 17:52:47.085957 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2422/5086] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:46 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:47.092422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:47.110486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.111849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.112847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.129801 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] Creating event network-changed:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h1-852771-11 Aug 30 17:52:47.137303 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-88e6906b-4b39-406f-ac97-97368b665b30 req-37e63d5b-5005-4bc6-a2bf-2799ee1eb367 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049416 Aug 30 17:52:47.138562 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2423/5087] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:47.144400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:47.145658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:47.153608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.154423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.155609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.156771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.157399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.158846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.176220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:47.430209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:47.442876 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17a1fab0-5f42-40e6-a902-1a56773c844b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.302695 Aug 30 17:52:47.444475 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2424/5088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:47 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:47.451948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:47.455842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:47.471602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.472115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.472565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.473310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.473767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.474194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.602237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:52:47.604825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:52:47.605326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:52:47.607956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:52:47.608436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:52:47.637035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.637528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.637966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.638706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:47.639172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:47.639669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:47.702248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:47.711661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:47.738194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:52:47.740771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:52:47.838446 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6217e91-c359-4c3d-909c-7ef6e2179a82 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.871084 Aug 30 17:52:47.839224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2665/5089] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:52:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:52:47.854580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f17476f-786a-47e0-b1a9-81549420bdb2 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:47.858029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f17476f-786a-47e0-b1a9-81549420bdb2 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:47.950491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2f17476f-786a-47e0-b1a9-81549420bdb2 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:47.963167 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f17476f-786a-47e0-b1a9-81549420bdb2 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1249 microversion: 2.1 time: 0.115574 Aug 30 17:52:47.966376 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2666/5090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:47 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1249 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:48.051197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:48.053163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5af6125-1394-445d-8b92-bd34469e5844 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: .version_select at 0x7f2d99085ca0>, body: {"keypair": {"name": "tempest-keypair-286231068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVUOzWWOVY5+XKoIopwnuTgKbk8Z07TsMpRU5I41eacZ+fnzE3lC8vBgMEsU+tsU7MJ2fSqjsiEfZIBh7FJc/6ZYXmepwSdvBbUbxM7AfipahQP8MBQyvHOJHNwKJmy0A=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:48.072237 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c9ec97f-ea9e-4870-b234-f3d92f4f6b6a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.620900 Aug 30 17:52:48.072892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a5af6125-1394-445d-8b92-bd34469e5844 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for project beeb3b961b6b4a53914579236a779da1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:48.075029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2425/5091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:47 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:48.093371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a5af6125-1394-445d-8b92-bd34469e5844 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for user e6a13ec5aee742fc99051ec485f19b55 and project beeb3b961b6b4a53914579236a779da1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:48.110828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:48.114571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:48.115376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:48.136907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5af6125-1394-445d-8b92-bd34469e5844 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088226 Aug 30 17:52:48.142447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:48.143163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:48.143877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:48.144823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:48.145715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:48.145844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2667/5092] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:52:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:52:48.146479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:48.472893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:48.474695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:48.496189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:48.501104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:48.501937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:48.502756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:48.503223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:48.531689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:48.872214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:48.893201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:48.920373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:48.921857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad9a2d6f-d5ff-4555-a9cd-61fed397392e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.812613 Aug 30 17:52:48.923692 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2426/5093] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:48 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:48.990649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:48.991422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:49.002917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.003730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.005612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.006848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.010174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.011125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.204111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:49.214524 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d55eb7b-43ca-4dfd-976a-6e7f9bbf394f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1245 microversion: 2.1 time: 0.228480 Aug 30 17:52:49.232238 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2427/5094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:48 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1245 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:49.245612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:49.248572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:49.261633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.262554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.263323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.264212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.264816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.265200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:49.267818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.313037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ac1938b-0eac-4d30-beac-6984777f3843 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.853020 Aug 30 17:52:49.329750 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2668/5095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:48 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:49.503756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:49.514543 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19e0d982-05bc-4112-b7e2-9f1bf5dc529c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.280360 Aug 30 17:52:49.528310 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2428/5096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:49 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:49.797037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a12f5d0-5ea8-40d4-b991-7bec7808af30", "name": "network-vif-plugged", "status": "completed", "tag": "146a3883-a2e1-4490-ad2a-e286bece63d3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:49.815807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.819597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.820308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.851712 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] Creating event network-vif-plugged:146a3883-a2e1-4490-ad2a-e286bece63d3 for instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 on n-h1-852771-11 Aug 30 17:52:49.875348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1ea4f8fd-0df3-46dd-a75a-a01059846712 req-3afaf8f9-7283-4580-9975-4b75485f8931 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081930 Aug 30 17:52:49.876333 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2669/5097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:49.947052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:49.947759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:49.960624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.961448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.961908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:49.962647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:49.965034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:49.965515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.247089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:50.248188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:50.274043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.274545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.275161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.276106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.276718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.277349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.401047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.413011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b31bd7e-42f9-430d-bf19-d0b6b8e4ae40 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1307 microversion: 2.1 time: 0.176884 Aug 30 17:52:50.415151 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2670/5098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:50 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:50.421542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:50.424675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:50.444307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.446894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.446894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.447629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.448418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.449165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.526853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.541460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.543508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.545155 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8894eeaf-02b5-494c-8770-31cdc043a210 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.602440 Aug 30 17:52:50.546253 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2429/5099] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:49 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:50.552586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:50.553328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:50.561170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:50.563072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.564168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.564745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.565880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:50.566428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:50.566905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:50.770279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.779114 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53c1efb1-23f2-47cc-8f36-d73d46e0d943 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.362642 Aug 30 17:52:50.780281 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2671/5100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:50 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:50.918074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:50.933500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b027c9b9-ff0f-4970-a378-beb748c55d25 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1364 microversion: 2.1 time: 0.386113 Aug 30 17:52:50.934460 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2430/5101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:50 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1364 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:51.436360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:51.437035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:51.453174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.453943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.455108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:51.456319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.459763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.460592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:51.572235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:51.573615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:51.587013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.589722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.590651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:51.593441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.596560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.597337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:51.654152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:51.676644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:51.692393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d1c9031-0669-48f5-b832-921bf66e1c5e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1307 microversion: 2.1 time: 0.260129 Aug 30 17:52:51.696511 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2672/5102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:51 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:51.806258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:51.809084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:51.819417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.821695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.822366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:51.823708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:51.824377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:51.825006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:52.072452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:52.109968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:52.131123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:52.149856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:52.150105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98f01809-29a9-4d5c-b782-4b07769207d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.580516 Aug 30 17:52:52.153080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2431/5103] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:51 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:52.153284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:52:52.161271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:52.162355 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9bf171b3-42aa-494d-9927-d703a6c8f8c0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.362604 Aug 30 17:52:52.163111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:52.165506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2673/5104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:51 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:52.186116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:52.187462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:52.189704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:52.191009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:52.192669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:52.193148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:52.507096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-288631730", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2fa1c9f-d557-49bc-a165-bbf59c30c36f"}], "security_groups": [{"name": "tempest-securitygroup--530133999"}], "key_name": "tempest-keypair-286231068", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:52.659736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] validate_networks() for [('b2fa1c9f-d557-49bc-a165-bbf59c30c36f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:52:52.691077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:52.701787 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86b21d72-d94a-4a0c-a93b-4de86d030b5b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1554 microversion: 2.1 time: 0.547378 Aug 30 17:52:52.716256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2432/5105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:52 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1554 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:52.725740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:52.727186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:52.737310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:52.738060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:52.738652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:52.740384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:52.741042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:52.742331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.086119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:53.099267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0e8585e1-82a0-4b85-acfe-b839858ecada tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.381447 Aug 30 17:52:53.102249 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2433/5106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:52 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:53.109576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:53.110926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:53.120428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.121222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.122183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.124028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.124794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.125468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.253891 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0f46808-a040-4649-8dab-294db3d0bf64 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150290 Aug 30 17:52:53.255578 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2434/5107] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:52:53 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:53.260843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:53.261603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:53.270189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.270919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.276835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.277728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.278429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.279093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.730235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:53.741416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:53.742882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:53.748010 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2abf6737-5336-4304-b851-cf48455c42bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.491059 Aug 30 17:52:53.751561 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2435/5108] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:53 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:53.767729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:53.768653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:53.775792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.784286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.785013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.785984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.786630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.787250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.900673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:52:53.901214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:52:53.901611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:52:53.902589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:52:53.903074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:52:53.937788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.939096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.940104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.943738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:53.944429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:53.945019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:53.986975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for project beeb3b961b6b4a53914579236a779da1. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:52:53.993231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Getting quotas for user e6a13ec5aee742fc99051ec485f19b55 and project beeb3b961b6b4a53914579236a779da1. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:52:54.026278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:52:54.029774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:52:54.107642 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03c67d9b-1ad8-476a-981c-dd5a649504c7 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.604747 Aug 30 17:52:54.114625 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2674/5109] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:52:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:52:54.140640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "name": "network-vif-plugged", "status": "completed", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:54.163974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.164765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.165497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.182158 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] Creating event network-vif-plugged:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h1-852771-11 Aug 30 17:52:54.190303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3618ddb3-1d4c-49b1-9e5a-fb6d4ff9e3d0 req-b36f941d-8a19-48d4-8733-1f90570404b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074126 Aug 30 17:52:54.191267 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2675/5110] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:54.197240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d937df2d-f360-4f5b-8410-ea7049b578c0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:54.198101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d937df2d-f360-4f5b-8410-ea7049b578c0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:54.358995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d937df2d-f360-4f5b-8410-ea7049b578c0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:54.389787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d937df2d-f360-4f5b-8410-ea7049b578c0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1236 microversion: 2.1 time: 0.195354 Aug 30 17:52:54.403977 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2676/5111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:54 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1236 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:54.403977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:54.403977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:54.409633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.410284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.411122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.412299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.413385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.415788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.716134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:54.717647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:54.724070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f870c1b8-7656-4fca-8cf9-02c98dd51de5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.329744 Aug 30 17:52:54.728180 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2677/5112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:54 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:54.731739 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d6f137b2-e06b-4fbb-8c6a-c7a70a3f1a1a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.978334 Aug 30 17:52:54.737439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834aec5-9171-40b5-8887-a539cef97b9a", "tag": "7eac52bd-6fff-41e5-9e55-4a19b4303884"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:54.750304 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2436/5113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:53 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:54.757887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.758366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.761884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.772862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:54.773852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:54.784680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.785823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.786534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.787670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:54.788360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:54.789029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:54.805544 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] Creating event network-changed:7eac52bd-6fff-41e5-9e55-4a19b4303884 for instance 3834aec5-9171-40b5-8887-a539cef97b9a on n-h2-852771-11 Aug 30 17:52:54.817236 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0d393d84-9e69-476e-9d10-3cfe8171ef0f req-c1abc3bf-03d9-4510-b813-b4bb98a14a24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087582 Aug 30 17:52:54.817850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2678/5114] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:55.418949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:55.420502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:55.430882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.431688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.432131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:55.432843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.433528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.433961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:55.587973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:55.601631 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-acdc7971-2797-4fd5-8ef0-9f7717bf99c6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1232 microversion: 2.1 time: 0.192904 Aug 30 17:52:55.611864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2679/5115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:55 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1232 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:55.745271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:55.745887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:55.761093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.761671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.762022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:55.766167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.767242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.767809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:55.918988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:55.930948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:55.932677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:55.934060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8a9b6ac-52b1-4ea6-bade-b19e19c1dece tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 1.166244 Aug 30 17:52:55.934789 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2437/5116] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:54 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:55.962949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:55.963589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:55.978264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.980312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.981990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:55.982934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:55.983552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:55.984153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:56.232584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:56.247718 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aaa87f2b-8236-42e2-81ef-8e140a1c98e1 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.506182 Aug 30 17:52:56.261659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2680/5117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:55 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:56.320031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:56.328383 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1dbdfab-8bc4-479b-b7dd-e783d919b133 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.369321 Aug 30 17:52:56.332128 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2438/5118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:55 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:56.627239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:56.628452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:56.645276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:56.646054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:56.646654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:56.649117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:56.649770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:56.651239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:56.767563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:56.779198 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3431494-1469-4b23-b3aa-45afebffed4f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1288 microversion: 2.1 time: 0.156453 Aug 30 17:52:56.793239 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2681/5119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:56 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1288 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:56.890657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a12f5d0-5ea8-40d4-b991-7bec7808af30", "tag": "146a3883-a2e1-4490-ad2a-e286bece63d3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:52:56.909025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:56.909506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:56.909945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:56.928108 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] Creating event network-changed:146a3883-a2e1-4490-ad2a-e286bece63d3 for instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 on n-h1-852771-11 Aug 30 17:52:56.950716 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d26ce7fa-daf6-4f4f-b184-1c4d8e74ae00 req-bf7f0514-3343-4e65-9196-c9c855bfdc64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060823 Aug 30 17:52:56.958022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:56.959059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:56.964241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2439/5120] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:52:56.971131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:56.971672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:56.974492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:56.975157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:56.975681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:56.977329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.219344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:57.234650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:57.236804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:57.237962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42ee91ef-ef90-42c2-bef0-0ca670cd7bcb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1407 microversion: 2.20 time: 0.284972 Aug 30 17:52:57.238544 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2682/5121] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:56 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:57.271968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:57.272726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:57.285028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.285525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.285966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.286685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.287140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.287595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.353942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:57.354904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:57.367169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.368302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.370675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.393648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.396859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.397601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.769282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:57.782848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ab87542-1a5e-4c16-9e47-f118adc13c12 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.427972 Aug 30 17:52:57.784277 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2683/5122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:57 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:57.801276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:57.801899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:57.812118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.812620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.819126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:57.820109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:57.820591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:57.821029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:58.049887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:58.070703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c1811850-f285-45cc-9be6-065a0616b0f6 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1294 microversion: 2.1 time: 0.274276 Aug 30 17:52:58.072085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2684/5123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:57 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1294 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:58.230944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:58.243287 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bca84401-21fa-470d-865f-dd038235e10f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.975588 Aug 30 17:52:58.248029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2440/5124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:57 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:52:58.263004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:58.264106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:58.276369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:58.276866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:58.277310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:58.278025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:58.278479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:58.278902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:58.805780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:58.806389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:58.818598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:58.819310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:58.820229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:58.822486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:58.824157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:58.827588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:59.324373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:59.334049 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d353ed0-d5a8-4faf-9ef6-500f681a3666 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.532802 Aug 30 17:52:59.334655 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2441/5125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:58 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:52:59.348298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:59.349161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:59.367672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:59.368501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:59.369163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:59.370022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:59.370617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:59.371241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:59.681959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:59.699999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:59.704184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:52:59.706238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-861db9b9-40af-42bd-be9a-28a59444d1eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1599 microversion: 2.20 time: 1.448919 Aug 30 17:52:59.709906 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2685/5126] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:52:58 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1599 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:52:59.721756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:52:59.724004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:52:59.743453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:59.744207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:59.744985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:52:59.746109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:52:59.746713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:52:59.747283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.312316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:00.325341 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3db388ca-5f7d-414d-9f8b-a1e4098486ff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.984629 Aug 30 17:53:00.342192 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2442/5127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:59 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:00.360996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:00.362126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:00.369714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.374274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.374865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.376503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.378439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.379780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.527194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:00.543003 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8dba6e90-7276-437a-a987-57732779737c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.831877 Aug 30 17:53:00.548951 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2686/5128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:52:59 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:00.549532 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b6c74be5-fc96-4861-9dbd-49eb6bad168e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.205724 Aug 30 17:53:00.557923 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2443/5129] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:53:00 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:53:00.563884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:00.565962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:00.577702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.578208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.579242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.584249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.584958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.585459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.864220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:00.873375 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a5611b2-426f-4a70-9183-806f3e5b3e88 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1499 microversion: 2.1 time: 0.321835 Aug 30 17:53:00.880309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2687/5130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:00 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:00.903608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b024798d-be1c-412a-9eb1-99d01c8db2ab"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:00.907784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:00.924664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.951517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.952335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.953449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:00.954736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:00.955367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:00.988479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834aec5-9171-40b5-8887-a539cef97b9a", "name": "network-vif-plugged", "status": "completed", "tag": "7eac52bd-6fff-41e5-9e55-4a19b4303884"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:01.029364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.030614 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Cannot 'attach_volume' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state rescued Aug 30 17:53:01.033364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.033979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/os-volume_attachments HTTP/1.1 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 74 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: {"volumeAttachment": {"volumeId": "b024798d-be1c-412a-9eb1-99d01c8db2ab"}} Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'attach_volume' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state rescued Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '48313007-4ae9-453a-89c4-3d27094a8617', 'body': {'volumeAttachment': {'volumeId': 'b024798d-be1c-412a-9eb1-99d01c8db2ab'}}} Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48313007-4ae9-453a-89c4-3d27094a8617 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 17:53:01.036026 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state rescued Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state rescued Aug 30 17:53:01.040121 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:53:01.048443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 409 to user: Cannot 'attach_volume' instance 48313007-4ae9-453a-89c4-3d27094a8617 while it is in vm_state rescued {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:53:01.051403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-efbd5d93-d0e1-49b5-a2e5-24f8c52028a2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.150215 Aug 30 17:53:01.053942 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2444/5131] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:53:00 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/os-volume_attachments => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:53:01.061307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:01.069306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:01.084114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.084932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.085641 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] Creating event network-vif-plugged:7eac52bd-6fff-41e5-9e55-4a19b4303884 for instance 3834aec5-9171-40b5-8887-a539cef97b9a on n-h2-852771-11 Aug 30 17:53:01.086362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.088942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.089592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.090203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.092723 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-07a233c2-e7df-4cdc-a2c2-a9c5909db568 req-a1378d37-8874-4776-92a1-bd388e4eefd7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107405 Aug 30 17:53:01.093705 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2688/5132] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:01.240744 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-215187e1-4cbc-4736-8870-b5a4bf2555d9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action" status: 202 len: 0 microversion: 2.1 time: 0.182089 Aug 30 17:53:01.243111 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2445/5133] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:53:01 2022] POST /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:53:01.252042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:01.252912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:01.270309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.274355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.274944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.275818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.277584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.286695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.351661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:01.353240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:01.359466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.360492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.361359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.362735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.363439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.364081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.732978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:01.744864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eeab209e-8e25-427e-b919-5ae35b364801 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.398499 Aug 30 17:53:01.745446 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2446/5134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:01 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:01.755631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:01.756466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:01.782377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.782947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.783392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.784152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:01.784603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:01.785022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:01.841226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:01.851011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e38ef354-9324-4812-a8d4-ae84a3dd0fd7 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1507 microversion: 2.1 time: 0.603329 Aug 30 17:53:01.851612 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2689/5135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:01 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:02.083575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:02.092320 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-026c4535-4f6b-473b-8e9a-64f4d4059970 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1375 microversion: 2.1 time: 0.345707 Aug 30 17:53:02.096632 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2447/5136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:01 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1375 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:02.300039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ba1883-c3dc-4f3b-86f0-a30808e73636", "tag": "626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:02.343889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:02.345728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:02.348039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:02.377551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] Creating event network-changed:626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1 for instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 on n-h1-852771-11 Aug 30 17:53:02.394644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ae14845d-9463-4119-8e86-081c4ddaf87c req-ddeb3929-6825-4af1-b9c9-766672a6c686 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098773 Aug 30 17:53:02.394644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2690/5137] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:02.772881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:02.777526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:02.788867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:02.789720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:02.790332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:02.791390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:02.792100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:02.792674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:02.825810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:02.877692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:02.878853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:02.888454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:02.889269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:02.889876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:02.891935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:02.892898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:02.893518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.186103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:03.195811 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a330351-c20f-4d4b-908d-46aa486f1054 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1507 microversion: 2.1 time: 0.325080 Aug 30 17:53:03.197875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2691/5138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:02 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:03.205366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:03.221024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:03.222384 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8fe799a-5568-4acd-adf7-8a638c819183 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.459265 Aug 30 17:53:03.223950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:03.225845 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2448/5139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:02 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:03.253469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:03.254802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:03.255551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:03.256205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.257215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:03.257888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:03.258530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.289801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:03.290459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:03.291105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.325084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] Creating event network-changed:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h1-852771-11 Aug 30 17:53:03.332070 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e91ceed0-1ed7-4f90-8904-889d418b6ed6 req-beb3088e-659d-4e2f-a472-d5b5d5fe6a89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088385 Aug 30 17:53:03.333420 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2449/5140] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:03.454682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:03.464814 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8f4146f-8de9-4e69-bae9-219ff454ac06 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1546 microversion: 2.1 time: 0.264797 Aug 30 17:53:03.481700 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2692/5141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:03 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:03.488618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:03.489326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:03.505571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:03.506066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:03.506496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.507194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:03.507843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:03.508261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:03.747739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:03.760047 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3e6b847f-a5bd-46a4-a745-75a70e1e7128 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1546 microversion: 2.1 time: 0.275939 Aug 30 17:53:03.760651 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2450/5142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:03 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:04.217717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:04.218576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:04.232260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:04.246653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:04.247910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:04.252561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:04.253374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:04.256016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:04.259117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:04.261855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:04.262488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:04.263000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:04.264765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:04.265304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:04.268911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:04.269978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:04.272948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:04.366133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=20 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:04.585289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:04.596748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc1223e5-7d4b-419b-9ee4-52fe5a1e4b19 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1507 microversion: 2.1 time: 0.382388 Aug 30 17:53:04.598309 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2693/5143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:04 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:05.156298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:05.171319 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54026b10-7791-48e0-b094-c865af2c6ff9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.924084 Aug 30 17:53:05.172788 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2451/5144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:04 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:05.619187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:05.619821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:05.643461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:05.644196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:05.644807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:05.645901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:05.646516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:05.647089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:05.961644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:05.973950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:05.979215 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e4976f16-14d1-4feb-b80b-a935a0627e15 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1513 microversion: 2.1 time: 0.364726 Aug 30 17:53:05.983586 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2694/5145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:05 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:06.195235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:06.197714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:06.217176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:06.223961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:06.224523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:06.227699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:06.228376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:06.229764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:06.633201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:06.656145 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63105dd6-e512-43cd-be19-535d58caf4a1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.455576 Aug 30 17:53:06.673184 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2452/5146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:06 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:07.687410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:07.688880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:07.696897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:07.697759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:07.698378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:07.699250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:07.699885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:07.700468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:07.920996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834aec5-9171-40b5-8887-a539cef97b9a", "tag": "7eac52bd-6fff-41e5-9e55-4a19b4303884"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:07.977579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:07.978054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:07.978493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:08.014692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] Creating event network-changed:7eac52bd-6fff-41e5-9e55-4a19b4303884 for instance 3834aec5-9171-40b5-8887-a539cef97b9a on n-h2-852771-11 Aug 30 17:53:08.029463 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a73af40d-2d58-4447-9714-f68360afc297 req-220b9abb-ad68-462c-99f0-68a73d3f8e64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115423 Aug 30 17:53:08.030393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2453/5147] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:08.408324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:08.423750 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a4cf27a-9943-430a-85a2-40a6a0c0f752 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.741494 Aug 30 17:53:08.425210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2695/5148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:07 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:08.908998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78ec23d7-0b37-4d80-8c85-77fd2f9ca2d2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: .version_select at 0x7f2d93a5b310>, body: {"keypair": {"name": "tempest-keypair-145691730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKVAFWhDFn6ha8o14EsIG+Ez7RqBKgKYyBgGs2ScxgjfE5ERYoSE3jpe1HkEVJ3NutL3AxKH1Nch1MyQ/xpq+Jns11PpYQUyFV6Tk+2UU/1C8VOLb44Szdbl4FANU0Ktg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:08.933411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-78ec23d7-0b37-4d80-8c85-77fd2f9ca2d2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for project 184fc5cac74143e3aac59d817ea26afc. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:08.942768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-78ec23d7-0b37-4d80-8c85-77fd2f9ca2d2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for user 643142ee7f7e4128a4344fb4cad92b29 and project 184fc5cac74143e3aac59d817ea26afc. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:08.947765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ba1883-c3dc-4f3b-86f0-a30808e73636", "name": "network-vif-plugged", "status": "completed", "tag": "626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:08.966544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:08.967027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:08.967464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:08.979661 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78ec23d7-0b37-4d80-8c85-77fd2f9ca2d2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076868 Aug 30 17:53:08.980626 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2454/5149] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:53:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:09.025918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] Creating event network-vif-plugged:626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1 for instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 on n-h1-852771-11 Aug 30 17:53:09.043882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-17f11953-01e2-418a-af40-eeffb5bb2907 req-351ba48f-eae0-474c-bc13-5e1e96ce9a33 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099692 Aug 30 17:53:09.044863 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2696/5150] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:09.445464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:09.446208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:09.457025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:09.457518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:09.457939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:09.464829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:09.466012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:09.468575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:09.943415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:09.951967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99431c61-bd8b-46eb-ba92-8dc81c44d76a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1361 microversion: 2.1 time: 0.510583 Aug 30 17:53:09.980852 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2455/5151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:09 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1361 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:10.997556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:11.000256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:11.012666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:11.013350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:11.013926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:11.016186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:11.016791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:11.017455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:11.240494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-982884248", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdb89103-a105-480e-8a62-f5210819b757"}], "security_groups": [{"name": "tempest-securitygroup--241719922"}], "key_name": "tempest-keypair-145691730", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:11.302949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:11.314335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3763162-ee95-4839-b88f-d55a5a8d1389 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1548 microversion: 2.1 time: 0.321798 Aug 30 17:53:11.314964 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2697/5152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:10 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:11.339680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:11.340173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:11.346819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:11.347540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:11.348120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:11.349003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:11.349659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:11.350380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:11.378834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] validate_networks() for [('fdb89103-a105-480e-8a62-f5210819b757', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:53:11.447043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c32bfa6f-c8ca-45ad-9fd3-aa5b0726beff tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111282 Aug 30 17:53:11.447988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2698/5153] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:53:11 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:12.129235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:53:12.130106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:53:12.131633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:53:12.132156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:53:12.132615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:53:12.147698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:12.148179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:12.148607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:12.149390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:12.149751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:12.150653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:12.178302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:12.183919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Getting quotas for user 643142ee7f7e4128a4344fb4cad92b29 and project 184fc5cac74143e3aac59d817ea26afc. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:12.198033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:53:12.200471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:53:12.263422 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40a858ce-2296-4789-843a-a2a2bdd4fe92 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.027474 Aug 30 17:53:12.273511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2456/5154] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:53:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:53:12.278934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cd2dad6-87c7-4dd7-a714-b22a994d6fdc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:12.280234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cd2dad6-87c7-4dd7-a714-b22a994d6fdc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:12.441824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cd2dad6-87c7-4dd7-a714-b22a994d6fdc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:12.452058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cd2dad6-87c7-4dd7-a714-b22a994d6fdc tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1244 microversion: 2.1 time: 0.177349 Aug 30 17:53:12.454496 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2699/5155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:12 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1244 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:13.478075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:13.478857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:13.494036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:13.494574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:13.495030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:13.495941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:13.496405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:13.498624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:13.664783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ba1883-c3dc-4f3b-86f0-a30808e73636", "tag": "626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:13.676824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:13.677639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:13.678248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:13.708850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] Creating event network-changed:626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1 for instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 on n-h1-852771-11 Aug 30 17:53:13.717335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6e89c388-2413-40a2-a3a1-19c2a21570e9 req-e3f9f855-bbf3-4ade-a94b-6fdc036bb1a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057070 Aug 30 17:53:13.725879 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2700/5156] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:13.907444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:13.919359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-51ef00da-afb3-4699-86d6-ba5b69f798cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1296 microversion: 2.1 time: 0.447937 Aug 30 17:53:13.923217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2457/5157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:13 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1296 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:14.946222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:14.946958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:14.954660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:14.955523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:14.956334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:14.957278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:14.958287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:14.959205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:15.051632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:15.065168 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-650d42ee-2a5d-408d-903a-d89d454251a8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1302 microversion: 2.1 time: 0.124275 Aug 30 17:53:15.065821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2701/5158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:14 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1302 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:16.086134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:16.087838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:16.095429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:16.096179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:16.096841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:16.097766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:16.109211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:16.110255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:16.383229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:16.412248 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a9f3436-371f-43ba-842c-ee0a09e552e2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.329811 Aug 30 17:53:16.415751 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2458/5159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:16 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:16.595836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:16.608417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:16.609090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:16.609713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:16.623948 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] Creating event network-changed:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:53:16.630635 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ea052986-b77c-436d-a171-3e0d763fd452 req-c5b150eb-aceb-4558-b2a9-c84b314f3f8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 Aug 30 17:53:16.631869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2702/5160] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:17.434243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:17.435521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:17.443091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:17.443927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:17.444559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:17.445496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:17.446156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:17.446808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:17.674350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:17.683321 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-501111a0-79d7-4d0e-9c2a-35aeefc239e9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.252823 Aug 30 17:53:17.684062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2459/5161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:17 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:18.707154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:18.708563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:18.714715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:18.716715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:18.717486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:18.718135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:18.720060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:18.720760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:18.721465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:18.897477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:18.908079 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1c5fa63-34f4-4094-9fbc-0546a392368b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.205249 Aug 30 17:53:18.922493 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2703/5162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:18 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:19.929417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:19.930657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:19.943809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:19.944633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:19.945266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:19.946167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:19.946807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:19.947598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:20.137754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:20.146779 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e753f8c7-4dc7-412c-9f5b-55d9ffacbf54 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.221331 Aug 30 17:53:20.148137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2460/5163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:19 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:21.085668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "name": "network-vif-plugged", "status": "completed", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:21.097207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:21.098838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:21.099507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:21.114787 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] Creating event network-vif-plugged:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:53:21.121637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-db306839-f1e9-43e0-8bf2-6936284e26d6 req-fff186bf-741b-416c-b0ae-968a302ffaf0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038935 Aug 30 17:53:21.122868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2704/5164] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:21.168078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:21.169358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:21.181141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:21.195826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:21.197133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:21.197983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:21.198842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:21.199838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:21.200620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:21.500037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:21.513387 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-907298e1-df8e-4373-8bcd-0bb4cea80a33 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.349124 Aug 30 17:53:21.514331 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2461/5165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:21 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:22.533487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:22.537836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:22.538550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:22.549470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:22.549880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:22.550316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:22.551014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:22.551534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:22.552153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:22.787528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:22.796374 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d0390d7-6a15-47b8-9980-fd8ce8573a1b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1369 microversion: 2.1 time: 0.265545 Aug 30 17:53:22.808014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2705/5166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:22 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:23.818401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:23.819185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:23.822431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:23.824560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:23.830505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:23.831177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:23.831711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:23.832344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:23.832800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:23.833232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:23.977419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:23.987799 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9887d894-1dd9-45a7-9a94-97ae45b6356e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1564 microversion: 2.1 time: 0.173398 Aug 30 17:53:23.988824 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2462/5167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:23 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:24.008938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:24.009514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:24.016325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:24.017016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:24.017453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:24.018153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:24.018761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:24.019188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:24.139050 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f19738cc-0ec5-4706-9d3a-3f32a8ff6dd9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133954 Aug 30 17:53:24.139805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2706/5168] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:53:24 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:26.271460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:26.333555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:26.336379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:26.339444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:26.358105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] Creating event network-changed:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:53:26.366396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-23c6705b-cec4-43a5-835b-419542a654de req-f10d501f-bfed-415f-8fc7-848fcd096eb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098844 Aug 30 17:53:26.368323 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2463/5169] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:29.443418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:29.446266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:29.454539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:29.455255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:29.455873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:29.457212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:29.457821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:29.458410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:29.529801 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c0fcf9e6-4a57-4b29-bb61-f5f33bac27d4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a/action" status: 200 len: 24545 microversion: 2.1 time: 0.090218 Aug 30 17:53:29.532055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2707/5170] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:53:29 2022] POST /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a/action => generated 24545 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:53:29.782692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:29.784667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:29.792321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:29.793007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:29.794164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:29.795071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:29.796805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:29.797399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:29.825855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5f2779f-6701-4a0b-b258-4f3073fb760b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/ips" status: 200 len: 150 microversion: 2.1 time: 0.048457 Aug 30 17:53:29.826961 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2464/5171] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:53:29 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:32.382723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab6533a1-0036-466b-91b5-258d59c7f5de"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:32.385970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:32.395089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:32.395898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:32.396564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:32.397326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:32.397810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:32.398333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:32.698810 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-79250760-0165-465e-84d7-afc0f239aaa5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321034 Aug 30 17:53:32.706727 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2708/5172] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:53:32 2022] POST /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:36.570725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:36.571222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:36.578936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:36.579645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:36.580087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:36.580955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:36.581411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:36.581836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:36.590169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=75 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:36.626565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e467f42-9354-4966-8327-7ad7502b2e54 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/ips" status: 200 len: 151 microversion: 2.20 time: 0.059925 Aug 30 17:53:36.632609 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2465/5173] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 30 17:53:36 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:53:38.566768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:38.567949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:38.574369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:38.574849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:38.575462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:38.576355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:38.577774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:38.578265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:38.583094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:38.610284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lazy-loading 'flavor' on Instance uuid c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:53:38.819899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1048fac-a91b-41a2-a868-fbd3419f74c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/action" status: 202 len: 0 microversion: 2.20 time: 0.258464 Aug 30 17:53:38.820916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2709/5174] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:53:38 2022] POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:53:38.829919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:38.830707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:38.851176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:38.851717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:38.852159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:38.852869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:38.853325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:38.853753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:39.021421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:39.030169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:39.032593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:39.034179 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1aa62463-eeb4-4cd7-970c-38364d3ae7fe tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.208743 Aug 30 17:53:39.034855 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2466/5175] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:38 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:40.074484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:40.075771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:40.086463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:40.088215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:40.088848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:40.090166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:40.090813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:40.091733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:40.261101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:40.272964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:40.275167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:40.276736 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58b9dbe8-11c9-4eb4-8709-ba80396bce82 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.207966 Aug 30 17:53:40.292946 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2710/5176] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:40 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:41.303468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:41.305742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:41.312821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:41.313537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:41.313986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:41.314728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:41.315196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:41.315664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:41.525699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:41.535259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:41.536775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:41.537985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d7ec892-d5ec-4d10-b4ae-9a7797fbb486 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.239024 Aug 30 17:53:41.538838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2467/5177] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:41 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:42.563262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:42.564144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:42.571775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:42.572209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:42.572653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:42.573362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:42.574033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:42.574470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:42.743859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:42.753823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:42.755601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:42.757016 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2e8f75c-5a96-4a93-990a-5f1a68b8384d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.198772 Aug 30 17:53:42.757959 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2711/5178] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:42 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:53:43.785810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:43.787101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:43.794197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:43.794754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:43.795333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:43.797252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:43.797786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:43.798281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:43.939440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:43.948157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:43.949838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:43.951081 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8840d5ad-8d5e-4f35-811e-86230a22d3f1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.169191 Aug 30 17:53:43.952888 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2468/5179] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:43 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:44.974509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:44.975577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:44.986838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:44.987404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:44.987931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:44.991178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:44.991743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:44.993048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:45.327552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:45.341768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:45.349277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:45.351247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07bd2db7-a966-440a-8ee5-f6ac41b8c340 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.380713 Aug 30 17:53:45.358890 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2712/5180] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:44 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:46.005392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6403f27-71ed-4541-8f2c-049ca69aa415 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: .version_select at 0x7f2d93785700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1105643842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+AUo1zpPYdl+zGhGpW3uKALt0I112S0wYH1k1LCgWFJWaKnN2r2P3SA2OlmuTbvguYeVpJq2iFgsZVNFaIGQMX7h0K8cZXOyb/s9UAgJbt7mpPLFFoCPBtU8Oev4Kug=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:46.040983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f6403f27-71ed-4541-8f2c-049ca69aa415 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:46.048958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f6403f27-71ed-4541-8f2c-049ca69aa415 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:46.092779 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6403f27-71ed-4541-8f2c-049ca69aa415 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.091262 Aug 30 17:53:46.093681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2469/5181] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:53:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:46.385631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:46.387722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:46.416870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:46.417506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:46.449388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:46.468499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:46.472918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:46.498077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:46.870366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:46.885810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:46.887441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:46.892924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15d317a6-af4b-42f6-8cb2-1667871d42dd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.514184 Aug 30 17:53:46.893665 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2713/5182] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:46 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:47.594951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1560577-56ee-4e28-8dca-9b7ed705c829 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: .version_select at 0x7f2d93849820>, body: {"keypair": {"name": "tempest-keypair-1981014132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEB6x9HkpxgnhvikrgszeI/35LVW3DGI9OcyQgAj4ec/rF6hL8crh/wtt2N4uN/x83+BDZN+Ow54fMbpcsevuZuB+aTV/zlPZ8Na+qYseL2HmQI/ETrfkR4UD1zaytL8A=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:47.619752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d1560577-56ee-4e28-8dca-9b7ed705c829 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:47.642874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d1560577-56ee-4e28-8dca-9b7ed705c829 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:47.680621 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1560577-56ee-4e28-8dca-9b7ed705c829 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093694 Aug 30 17:53:47.682647 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2470/5183] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:53:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:47.921728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:47.922323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:47.930255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:47.931063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:47.931529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:47.932239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:47.933672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:47.934314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:48.125661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:48.130648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1320069732", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "82938c3d-32dd-41a7-8123-82cada34f6d7"}], "key_name": "tempest-TestNetworkBasicOps-1105643842", "security_groups": [{"name": "tempest-secgroup-smoke-912423575"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:48.148102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:48.149820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:48.152585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e505c17b-3c7b-47c7-a99b-f01bd65b087d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.235327 Aug 30 17:53:48.177875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2714/5184] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:47 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:48.335626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] validate_networks() for [('82938c3d-32dd-41a7-8123-82cada34f6d7', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:53:49.183223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:49.183773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:49.188502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=24 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:49.211550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.213093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.213412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:53:49.213853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:53:49.214758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:53:49.215568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:53:49.216699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:53:49.218724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.220238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.220959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.221744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.260469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.261233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.261825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.262706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.264554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.268148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.277824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ef37588-2ee3-4158-b21b-06f63e940de2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/ips" status: 200 len: 146 microversion: 2.1 time: 0.099421 Aug 30 17:53:49.287704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2715/5185] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:53:49 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/ips => generated 146 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:49.311731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:49.316203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:49.320015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:49.329720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:49.341486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.342039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.342480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.347046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:49.356701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:49.358722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:49.360863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:53:49.363425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:53:49.501088 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ee5719f-764d-4203-baa0-2c713638773a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.381285 Aug 30 17:53:49.519683 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2471/5186] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:53:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:53:49.531332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ab6c6a9-ae13-4a3a-8b83-a161bff17a97 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:49.532251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ab6c6a9-ae13-4a3a-8b83-a161bff17a97 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:49.632801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ab6c6a9-ae13-4a3a-8b83-a161bff17a97 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:49.645024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ab6c6a9-ae13-4a3a-8b83-a161bff17a97 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1249 microversion: 2.1 time: 0.116097 Aug 30 17:53:49.651652 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2472/5187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:49 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:49.868966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:49.885147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:49.889633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:49.892315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa4312b9-2dca-4c0e-a673-98aad467d899 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.601845 Aug 30 17:53:49.894969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2716/5188] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:49 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:50.366660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1007276676", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9c5be2-f5e4-49b8-9312-c995d1b4829c"}], "security_groups": [{"name": "tempest-securitygroup--1066046833"}], "key_name": "tempest-keypair-1981014132", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:50.537273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] validate_networks() for [('1b9c5be2-f5e4-49b8-9312-c995d1b4829c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:53:50.666350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:50.666980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:50.677683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:50.678253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:50.689288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:50.690218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:50.691309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:50.695510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:50.898843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:50.907018 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3ebb0831-e2ac-441d-8cc8-abe4b62b19e5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1245 microversion: 2.1 time: 0.244680 Aug 30 17:53:50.919726 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2717/5189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:50 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1245 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:50.919726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:50.919726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:50.959350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:50.962567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:50.964018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:50.964904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:50.967965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:50.968654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:51.260947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:51.280495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:51.286947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:51.289957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67bf6dfa-4403-4b2a-bbe8-be92b0615bca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.375868 Aug 30 17:53:51.293158 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2718/5190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:50 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:51.315312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:53:51.315799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:53:51.316257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:53:51.316738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:53:51.317361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:53:51.319470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:51.334595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:51.335384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:51.336077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:51.337097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:51.344618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:51.349213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:51.372770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:53:51.391596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:53:51.423828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:53:51.426384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:53:51.588851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ca801e8-d69c-4d04-b934-13431f264f68 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.226643 Aug 30 17:53:51.600207 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2473/5191] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:53:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:53:51.604546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce7ff55e-6771-4c52-9652-086170765a45 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:51.605188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce7ff55e-6771-4c52-9652-086170765a45 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:51.706143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ce7ff55e-6771-4c52-9652-086170765a45 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:51.714085 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce7ff55e-6771-4c52-9652-086170765a45 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1242 microversion: 2.1 time: 0.113456 Aug 30 17:53:51.717454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2719/5192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:51 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:53:51.933852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:51.934790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:51.942451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:51.943138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:51.943755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:51.944632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:51.945226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:51.946651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.047902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:52.064918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61de1c7e-ce50-4c05-915d-4eab23d264ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1307 microversion: 2.1 time: 0.135274 Aug 30 17:53:52.066011 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2474/5193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:51 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:52.321344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:52.322202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:52.336988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.338678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.341539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.342641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.348369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.349034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.589028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c233161-ca2d-4c35-a44c-8506c7626c35"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:52.592090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:52.599358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.600079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.600674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.601565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.602165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.602730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.655516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:52.679465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:52.681122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:52.682349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4fc1300b-dfd6-4195-b6ab-c69d209433cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.366556 Aug 30 17:53:52.682927 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2475/5194] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:52 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:52.742448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:52.743274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:52.755822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.757051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.758199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.759146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:52.759847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:52.760885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:52.861032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:52.869267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b88a233e-bcb6-45e5-85c9-8428201a50a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1294 microversion: 2.1 time: 0.131304 Aug 30 17:53:52.887191 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2476/5195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:52 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1294 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:53.090214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:53.092346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:53.125332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:53.126194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:53.126791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:53.127964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:53.130275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:53.133262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:53.254053 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2877ec3a-0f30-4851-9b4e-e6ab83ea4b4d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078182 Aug 30 17:53:53.258588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2720/5196] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:53:52 2022] POST /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:53.709149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:53.710520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:53.727178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:53.728399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:53.729058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:53.731123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:53.734153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:53.734990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:54.042572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:54.052441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:54.053022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:54.058025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:54.061431 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c7fc799f-0dba-41ed-8a02-60007816b3dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.979203 Aug 30 17:53:54.062112 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2cefa237-ff30-4f5b-9f94-1507a1bf08da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.358104 Aug 30 17:53:54.062628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2477/5197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:53 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:54.069609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:54.070355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:54.084003 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2721/5198] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:53 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:53:54.089638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:54.092901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:54.095876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:54.096636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:54.097123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:54.097532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:54.335256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:54.358862 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99709ef0-deea-473c-a2b1-bb539dd61f5e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1300 microversion: 2.1 time: 0.292714 Aug 30 17:53:54.363766 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2478/5199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:54 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:55.082165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:55.082834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:55.088038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:55.088655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:55.102803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.103294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.103759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.104470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.104923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.105348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.109908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.110404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.111013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.111912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.112519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.113090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.423380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:55.438739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cebca6f5-35a1-446b-933e-d7504f7416d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.360323 Aug 30 17:53:55.439349 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2722/5200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:55 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:55.456040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986", "tag": "5c053eeb-2412-43ed-8b10-b3e76ff7521f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:55.490399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.491132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.492102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.511407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] Creating event network-changed:5c053eeb-2412-43ed-8b10-b3e76ff7521f for instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 on n-h1-852771-11 Aug 30 17:53:55.518687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b20a464b-9987-429b-9e0d-98d606c09b51 req-40f04493-ead7-4724-84b5-618c5e33e1dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071194 Aug 30 17:53:55.519794 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2723/5201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:55.527461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:55.528265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:55.535593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.536229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.536733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.537503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:55.538192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:55.538758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:55.570574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:53:55.661520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:55.714753 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fb09ee7-bfba-447b-ac49-3465566a5a51 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1300 microversion: 2.1 time: 0.192372 Aug 30 17:53:55.731721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2724/5202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:55 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:55.960534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:55.983128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:55.984876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:55.986248 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4ab3e111-4f47-4533-a9fe-069e2e3d749a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1744 microversion: 2.20 time: 0.902092 Aug 30 17:53:55.986972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2479/5203] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:55 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1744 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:53:56.461230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:56.461859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:56.488032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:56.488724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:56.489701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:56.493142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:56.493746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:56.494300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:56.736712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:56.737322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:56.751721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:56.754386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:56.758407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:56.759468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:56.762124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:56.762861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:57.018145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:57.033020 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-74773dbe-cc41-4ea7-b791-44a47e3c5ebb tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.575382 Aug 30 17:53:57.049236 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2725/5204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:56 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:57.065875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:57.067182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:57.074305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:57.075811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:57.076989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:57.078672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:57.079291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:57.079904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:57.589300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:57.608748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:57.621264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:57.625242 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a9343d5-85e9-48e4-ad22-2c499fdb2034 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.574530 Aug 30 17:53:57.628894 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2726/5205] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:57 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:53:57.975136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:57.991667 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9dfc2bdc-27f4-432a-b9e8-2f70a42e36e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 1.252266 Aug 30 17:53:58.016575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2480/5206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:56 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:58.058454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:58.059716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:58.096781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:58.112500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:58.113137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:58.114185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:58.114739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:58.115398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:58.445534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "name": "network-vif-plugged", "status": "completed", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:58.473578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:58.474047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:58.479468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:58.552141 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] Creating event network-vif-plugged:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h1-852771-11 Aug 30 17:53:58.568113 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e07515d9-384f-4859-8d39-10485f83fe5a req-2ae901ef-7639-46a9-a0ae-401e7307cac1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121333 Aug 30 17:53:58.573686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2481/5207] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:53:58.655002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:58.657222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:58.676933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:58.679044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:58.681233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:58.687246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:58.696349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:58.697815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:59.093528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:59.106770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e902629-7e6a-4ce8-9e4b-973ee2dcdcfe tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 1.050250 Aug 30 17:53:59.126399 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2727/5208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:58 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:53:59.144870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3881c7d-66e5-4769-8564-c78b9b2a9dc7", "tag": "2645038b-ff80-4ce9-84a1-2a22c0295574"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:53:59.170320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:59.170991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:59.172598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:59.215176 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] Creating event network-changed:2645038b-ff80-4ce9-84a1-2a22c0295574 for instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 on n-h2-852771-11 Aug 30 17:53:59.229731 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-99faaecc-eace-419d-9703-d6121b09b972 req-88a8e735-d109-4c0e-a19b-572f5c41c1b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098499 Aug 30 17:53:59.231831 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2728/5209] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:53:59.245849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:53:59.253726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:53:59.271432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:59.273130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:59.273796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:59.274754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:53:59.275400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:53:59.276049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:53:59.606437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:59.631952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:59.633807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:59.635316 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fdfa19fa-c512-4505-b915-dfc874238fff tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.985283 Aug 30 17:53:59.642490 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2482/5210] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:53:58 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:53:59.795948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:53:59.804727 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65345cfb-0317-44c0-913e-58eabd12104b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 0.569881 Aug 30 17:53:59.832438 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2729/5211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:53:59 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:00.139585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:00.140429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:00.162265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.165016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.165701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:00.166623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.168025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.170761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:00.547846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:00.557945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1fceaa54-9fd8-4d2d-a91c-1092effbe0df tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.423278 Aug 30 17:54:00.573942 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2483/5212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:00 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:00.671220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:00.671866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:00.696535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.697517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.698567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:00.699781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.701226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.701868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:00.768984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5f7d4de-511a-47a9-8e43-0d27bec17634"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:00.772683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:00.785117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.785939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.786617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:00.787797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:00.788458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:00.789726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:01.362666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:01.407094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:01.522947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:01.540357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:01.541953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:01.543197 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d2490794-9e3b-4eb8-aaef-a2602a1252d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.881486 Aug 30 17:54:01.543845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2730/5213] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:00 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:01.558058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:01.558696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:01.577219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:01.578177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:01.579076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:01.624553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:01.625350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:01.625958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:01.640522 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-642a8a80-3f76-4347-a76f-e381b4d47477 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867872 Aug 30 17:54:01.657956 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2484/5214] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:54:00 2022] POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:01.695604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:01.697491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:01.724920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:01.725475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:01.725926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:01.752328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:01.752820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:01.753265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:01.761126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:02.198533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:02.224351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:02.227254 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-138831b6-1bfd-449e-a5e1-a091b8cefa70 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.563365 Aug 30 17:54:02.228084 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2485/5215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:01 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:02.527746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986", "name": "network-vif-plugged", "status": "completed", "tag": "5c053eeb-2412-43ed-8b10-b3e76ff7521f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:02.561166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:02.564598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:02.565279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:02.608657 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] Creating event network-vif-plugged:5c053eeb-2412-43ed-8b10-b3e76ff7521f for instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 on n-h1-852771-11 Aug 30 17:54:02.634574 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9a5961e6-d636-4139-a8f9-bf63f85d04c8 req-8dd9056b-f40f-47ad-ac39-e649db0a2187 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107678 Aug 30 17:54:02.636462 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2486/5216] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:02.673202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:02.675085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:02.703715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:02.708131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:02.708841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:02.714483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:02.725885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:02.729566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:02.907960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:02.920941 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1df0e707-6f17-497a-88db-99d55c0054df tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 1.375315 Aug 30 17:54:02.921856 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2731/5217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:01 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:03.239850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:03.249422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:03.250537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:03.254945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:03.259175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:03.263920 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e8b8d7ca-b203-4511-bcf6-dae94d860674 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.624335 Aug 30 17:54:03.264283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:03.264727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:03.265554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:03.266467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:03.267096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:03.268882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:03.270545 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2487/5218] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:02 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:03.656716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:03.682356 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72f652f1-72a0-40bf-a638-ba4eb8347727 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1374 microversion: 2.1 time: 0.437218 Aug 30 17:54:03.682958 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2732/5219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:03 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1374 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:03.942636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:03.944471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:03.953100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:03.956164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:03.957150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:03.960974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:03.961674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:03.964836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:04.299078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:04.299745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:04.325709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:04.328253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:04.328897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:04.331220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:04.331915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:04.333883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:04.456661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:04.466331 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3aaa1093-ab37-4657-ad05-f65533e73fc0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 0.527589 Aug 30 17:54:04.499517 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2488/5220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:03 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:04.702631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:04.709195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:04.723359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:04.724454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:04.725053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:04.726356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:04.728687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:04.729717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:04.796683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:04.834090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:04.835967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:04.843642 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8b6578d-4633-4287-9377-eeb6c264de89 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.549250 Aug 30 17:54:04.851845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2733/5221] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:04 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:05.009938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:05.026370 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-446685a9-cf52-49f5-8de9-27f93cd8b51b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1546 microversion: 2.1 time: 0.326344 Aug 30 17:54:05.029419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2489/5222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:04 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:05.052837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:05.053623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:05.063696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.064414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.065414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.068154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.070989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.073745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.408011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:05.422309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9e5424a5-f101-4f10-b633-1bc866f268d0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1546 microversion: 2.1 time: 0.374520 Aug 30 17:54:05.423298 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2734/5223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:05 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1546 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:05.505771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:05.506731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:05.516377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.517374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.518100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.519671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.520319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.521172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.535653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3881c7d-66e5-4769-8564-c78b9b2a9dc7", "name": "network-vif-plugged", "status": "completed", "tag": "2645038b-ff80-4ce9-84a1-2a22c0295574"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:05.557233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.561308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.562698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.598609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] Creating event network-vif-plugged:2645038b-ff80-4ce9-84a1-2a22c0295574 for instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 on n-h2-852771-11 Aug 30 17:54:05.617609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-176be607-6308-4543-934f-bbce7dacc454 req-5d116e00-1c7c-4983-880d-0e3475ffee5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083373 Aug 30 17:54:05.621192 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2735/5224] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:05.875744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:05.876983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:05.896970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.897676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.897801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:05.898796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:05.900814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:05.912777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf50e536-fbba-4df5-811f-473945677ba2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 0.410768 Aug 30 17:54:05.928314 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2490/5225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:05 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:05.928514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:05.929984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:06.189027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:06.202132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:06.203786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:06.206196 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60aa71fd-d7b2-4a44-ad62-7ccc1dfdba98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.335728 Aug 30 17:54:06.209716 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2736/5226] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:05 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:06.937755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:06.938373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:06.973132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:06.974043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:06.974757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:06.981425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:06.982171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:06.982731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:07.239008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:07.239570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:07.263468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:07.267266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:07.273515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:07.280027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:07.282404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:07.286972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:07.614552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:07.630522 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b8810f5a-45f2-4aea-858f-e282ce8a82a2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1368 microversion: 2.1 time: 0.699332 Aug 30 17:54:07.653001 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2491/5227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:06 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1368 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:07.731229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:07.741643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:07.753209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:07.757179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01743043-e42d-496b-8523-55b865f70145 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.522870 Aug 30 17:54:07.760384 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2737/5228] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:07 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:08.662036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:08.662819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:08.671734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:08.672223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:08.672672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:08.673367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:08.673821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:08.674247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:08.786106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:08.786753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:08.799279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:08.799795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:08.800235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:08.800965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:08.801423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:08.801852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:09.123746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:09.139186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:09.141299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:09.144338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-61237272-45d7-45c4-bc94-64c385e8227f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.362069 Aug 30 17:54:09.147512 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2738/5229] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:08 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:09.588294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:09.597914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-224a0b01-3a9c-42ed-8047-2e243fa66a71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1557 microversion: 2.1 time: 0.940737 Aug 30 17:54:09.603461 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2492/5230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:08 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1557 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:09.633619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:09.634399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:09.644378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:09.647194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:09.647922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:09.650127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:09.650815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:09.651989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:09.801104 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b376fd2a-f221-41bf-a3ec-55ea1cdbd272 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172043 Aug 30 17:54:09.810365 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2739/5231] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:54:09 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:10.174174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:10.175317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:10.183604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.184441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.185880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.186822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.187523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.188140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.512184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:10.518186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:10.534493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.534980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.535449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.538648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.539138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.539603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.589363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e423579b-d19d-4454-b49e-2e02b3081369 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081742 Aug 30 17:54:10.590552 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2740/5232] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:54:10 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:10.603747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:10.608867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:10.620832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.621492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.624097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.625191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:10.626464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:10.627570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:10.704830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a8fbd54-bc18-4901-b527-c6188ab4c43d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35" status: 200 len: 194 microversion: 2.1 time: 0.107363 Aug 30 17:54:10.707141 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2741/5233] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 17:54:10 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:11.869003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:11.888224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:11.889849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:11.891187 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4533ed6e-ae89-4f39-a991-00a2915e054e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 1.724785 Aug 30 17:54:11.904903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2493/5234] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:10 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:12.913956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:12.915288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:12.934129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:12.935746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:12.936782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:12.942355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:12.944365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:12.946635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:13.020263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3881c7d-66e5-4769-8564-c78b9b2a9dc7", "tag": "2645038b-ff80-4ce9-84a1-2a22c0295574"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:13.049385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:13.055186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:13.062464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:13.159093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] Creating event network-changed:2645038b-ff80-4ce9-84a1-2a22c0295574 for instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 on n-h2-852771-11 Aug 30 17:54:13.189060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c1567ee9-8a9f-43c2-8185-89fcba8fff12 req-ffb3a8d6-efb7-4871-a32a-1c0a06c885c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179393 Aug 30 17:54:13.195790 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2494/5235] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:13.425818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:13.433168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:13.441261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:13.444729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:13.452592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3b00a29-8c5e-4266-a55b-3660be2425bf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.542502 Aug 30 17:54:13.453633 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2742/5236] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:12 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:13.826083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5075f767-6741-404e-8cf9-2ee142fa8cd1"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:13.832522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:13.867396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:13.869488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:13.871251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:13.872549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:13.884911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:13.887315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:14.477106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:14.478428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:14.500899 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-77c7928b-e2f0-497a-8e3c-71e66a779672 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "POST /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682716 Aug 30 17:54:14.525068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2495/5237] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:54:13 2022] POST /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:14.529244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:14.531816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:14.532956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:14.534480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:14.536127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:14.539520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:14.925938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:14.937889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:14.943889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:14.945413 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ab6a8e60-cae5-4778-ada0-54a595297610 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.473371 Aug 30 17:54:14.948189 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2743/5238] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:14 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:15.973819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:15.974520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:15.991571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:15.992020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:15.992452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:15.993148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:15.993595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:15.994013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:16.277850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:16.295557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:16.297518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:16.298897 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-825cc97c-698c-4a33-9503-afa60ddb9253 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.329937 Aug 30 17:54:16.300728 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2496/5239] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:15 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:17.322676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:17.323986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:17.337033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:17.337532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:17.337973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:17.338691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:17.339143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:17.339593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:17.552157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:17.571796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:17.574409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:17.576256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ca6e5e8-f066-4879-9938-dcac839e8b1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.257957 Aug 30 17:54:17.591505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2744/5240] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:17 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:18.601940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:18.602667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:18.610818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:18.611399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:18.611913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:18.612697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:18.613331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:18.613964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:18.790135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:18.814121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:18.815946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:18.817374 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-af43846b-4841-481e-b3bd-7410a979c311 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.220545 Aug 30 17:54:18.818256 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2497/5241] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:18 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:19.846464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:19.847102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:19.856377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=62 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:19.860531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:19.861029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:19.861484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:19.862559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:19.862679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:19.875610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:20.002002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9398cacc-81ea-479e-b73e-cbca020e83e0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Action: 'create', calling method: .version_select at 0x7f2d93a00af0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-467431029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3tOOvNrSYCqVYmGoh58ygen5wV/gsS0XYfE6gXrI9LGyKmYchsnty2EKEpSmDP+YC2dmB9hoWc1mwTh8x46My7yigi/WYGSMw1kPeRXSSO72zGD4P/lAnImpvU6YQqHw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:20.020696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9398cacc-81ea-479e-b73e-cbca020e83e0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Getting quotas for project aed372f7bacf4af395d80a297448e18b. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:54:20.029084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9398cacc-81ea-479e-b73e-cbca020e83e0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Getting quotas for user 5e0c5383d81046e19d480c3816a78171 and project aed372f7bacf4af395d80a297448e18b. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:54:20.061403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:20.061840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9398cacc-81ea-479e-b73e-cbca020e83e0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.063735 Aug 30 17:54:20.067962 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2498/5242] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:54:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:20.073181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:20.075533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:20.077270 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0f660b6-f4b5-487e-af4a-62a04a70d56d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1739 microversion: 2.20 time: 0.240023 Aug 30 17:54:20.078265 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2745/5243] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:19 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:21.101892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:21.102545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:21.114989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.115493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.115932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.116633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.117078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.117496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.445630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:21.449303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:21.458032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.459053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.459932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.460818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.461468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.462188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.501114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'flavor' on Instance uuid 3552c53e-ede4-42de-8009-69f055d6365a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:21.530577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:21.540296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:21.541752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:21.550349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b31d6417-8f74-4153-9f03-c464f94f7c1a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1721 microversion: 2.20 time: 0.453192 Aug 30 17:54:21.553252 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2499/5244] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:21 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1721 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:21.700382 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fd45360-4fcc-4a0b-a0b6-817623ebe80a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/action" status: 200 len: 32 microversion: 2.1 time: 0.260381 Aug 30 17:54:21.702370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2746/5245] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:54:21 2022] POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:54:21.711337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:21.711983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:21.727423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:21.729018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.729502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.730383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.731905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:21.742020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:21.743120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:21.913677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:21.923768 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9dbf042a-db7c-459f-88b6-8ddc837f62e4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.216132 Aug 30 17:54:21.924688 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2500/5246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:21 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:22.362351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-957425232", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c6037bae-0b1e-4d26-8d3c-ffc8941fb189", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-467431029", "security_groups": [{"name": "tempest-secgroup-smoke-144749612"}], "networks": [{"uuid": "1a94fac5-a376-4e3f-88ee-0b77579ff7a9"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:22.506030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] validate_networks() for [('1a94fac5-a376-4e3f-88ee-0b77579ff7a9', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:54:22.576732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:22.580655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:22.595085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:22.595918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:22.596523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:22.597440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:22.598054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:22.598635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:22.781074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:22.794501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:22.797021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:22.798797 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e2a47f14-3332-4c0f-a62b-a78e5b7181cf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1721 microversion: 2.20 time: 0.227518 Aug 30 17:54:22.800390 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2501/5247] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:22 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:22.945439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:22.946365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:22.953439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:22.954225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:22.955025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:22.956089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:22.956795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:22.957439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:23.055872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:54:23.056804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:54:23.056804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:54:23.057181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:54:23.057604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:54:23.068454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:23.069808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:23.070454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:23.071396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:23.072219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:23.072866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:23.096485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Getting quotas for project aed372f7bacf4af395d80a297448e18b. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:54:23.103641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Getting quotas for user 5e0c5383d81046e19d480c3816a78171 and project aed372f7bacf4af395d80a297448e18b. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:54:23.117941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:23.127735 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62f1b329-8173-4f8a-bfab-833001f92963 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.186089 Aug 30 17:54:23.142968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2502/5248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:22 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:23.173815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:54:23.176094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6037bae-0b1e-4d26-8d3c-ffc8941fb189',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:54:23.357835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c575356f-059c-4549-8d7d-dc21d0082743 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.000110 Aug 30 17:54:23.358952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2747/5249] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:54:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:54:23.370098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b28a1e77-2270-44b0-a880-8dab3c58d959 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:23.370777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b28a1e77-2270-44b0-a880-8dab3c58d959 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:23.435915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b28a1e77-2270-44b0-a880-8dab3c58d959 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:23.443422 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b28a1e77-2270-44b0-a880-8dab3c58d959 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1097 microversion: 2.1 time: 0.077351 Aug 30 17:54:23.444005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2503/5250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:23 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1097 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:23.822943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:23.823646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:23.832782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:23.833432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:23.833992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:23.834989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:23.835847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:23.836495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:23.988605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:23.998748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:24.000411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:24.001852 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-218c1260-296f-4745-9aa3-cace5e92d32a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1724 microversion: 2.20 time: 0.183636 Aug 30 17:54:24.002623 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2748/5251] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:23 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:24.026515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f934a130-8d11-4237-a2e6-1dcd2f3a2072"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:24.030977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:24.039719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.040781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.041460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.042381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.043047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.044532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.081917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:24.150398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:24.151080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:24.158468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.158964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.159409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.160146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.176272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.177238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.507574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:24.518388 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be75aa06-a299-41c6-8891-c53bd42c2a26 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.372109 Aug 30 17:54:24.523670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2749/5252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:24 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:24.528642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "name": "network-vif-unplugged", "status": "completed", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:24.541507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.542141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.542751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.558517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] Unable to find a host for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0. Dropping event network-vif-unplugged {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:54:24.559449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-902ec6f9-680d-421b-8eec-4b642818fd50 req-558e1894-6116-4ed9-a390-6705a1749eac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038913 Aug 30 17:54:24.560076 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2750/5253] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:54:24.564585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:24.565189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:24.571157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.571733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.572169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.572889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.573520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.574957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.584226 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee6f2dd4-aeb5-4d7f-80b8-4f05ba8fb819 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.562567 Aug 30 17:54:24.585556 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2504/5254] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 30 17:54:24 2022] POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 188 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:54:24.648082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:24.657650 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68e1670a-31d8-4abd-8583-132a5e61b68e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1195 microversion: 2.1 time: 0.096603 Aug 30 17:54:24.658845 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2751/5255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:24 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1195 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:24.724431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:24.725026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:24.732499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.732985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.733420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.734113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.734560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.734985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.778234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122123) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 17:54:24.851236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25960112-2053-433c-9135-d282f9e343a1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/action" status: 202 len: 0 microversion: 2.20 time: 0.130741 Aug 30 17:54:24.851974 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2505/5256] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:54:24 2022] POST /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:54:24.860461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:24.861074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:24.868590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.869283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.869876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:24.870748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:24.871951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:24.872525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:25.056084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:25.071494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:25.073581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:25.076951 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02412b2c-ea14-4f7d-afe0-c948cb8911a8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1750 microversion: 2.20 time: 0.220493 Aug 30 17:54:25.078362 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2752/5257] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:24 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:25.546262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:25.547180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:25.560290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:25.561096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:25.561885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:25.562840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:25.566699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:25.567671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:25.678941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:25.680136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:25.694471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:25.696924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:25.697379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:25.699510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:25.701287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:25.703731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:25.845511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:25.859606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-042b8651-0c40-4cae-8df3-fd5bab93fe54 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1213 microversion: 2.1 time: 0.180725 Aug 30 17:54:25.861806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2753/5258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:25 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:26.058266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:26.073918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de9dab1e-8801-4827-9fd4-64b5381ad88e tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.534233 Aug 30 17:54:26.086137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2506/5259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:25 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:26.101829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:26.102783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:26.116154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:26.123009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:26.123707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:26.125369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:26.127413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:26.128733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:26.399350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:26.417748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:26.427570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:26.428891 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c429bc87-6684-4318-8fe7-9c3a6292f0bb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1750 microversion: 2.20 time: 0.331800 Aug 30 17:54:26.429490 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2754/5260] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:26 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1750 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:26.881204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:26.881819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:26.891271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:26.895159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:26.898896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:26.900872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:26.902884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:26.903914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.098308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:27.099796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:27.108002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:27.108952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:27.109604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.110687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:27.111416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:27.112569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.233853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:27.254405 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c4e0877-25a4-479d-9c12-3d311684b3ad tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.375728 Aug 30 17:54:27.256208 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2507/5261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:26 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:27.423799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:27.434371 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be84c2b5-1e9b-4b03-b6d2-fd860716158f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.339417 Aug 30 17:54:27.436161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2755/5262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:27 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:27.452404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:27.453333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:27.462009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:27.469131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:27.469814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.470712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:27.471321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:27.471951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.528329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:27.552123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:27.552658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:27.553074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:27.572306 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] Creating event network-changed:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:54:27.591057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-49acea78-baa1-48f9-8c35-d111ae3e06f8 req-73075cee-bb2d-4033-bec0-0c2be8f29f55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066336 Aug 30 17:54:27.592403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2756/5263] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:27.833244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:27.844934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:27.846426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:27.857759 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-20f73bff-d94d-4214-be7f-13faacb0c2b4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.399509 Aug 30 17:54:27.858424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2508/5264] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:27 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:28.278918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:28.280268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:28.292593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.293935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.294453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:28.295634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.296164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.296669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:28.457698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:28.458307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:28.458410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:28.467579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c596aa6e-cd6c-4257-94b3-e6f8321e8e15 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.193864 Aug 30 17:54:28.469226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2757/5265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:28 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:28.485123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.485875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.486500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:28.487503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.488091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.488780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:28.671673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:28.685600 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98611b93-9403-4184-8f0d-802b799641eb tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.231624 Aug 30 17:54:28.686384 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2509/5266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:28 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:28.883032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:28.883727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:28.892766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.893258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.893725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:28.895004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:28.895496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:28.895930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:29.047044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:29.055705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:29.057140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:29.058310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5a8de56-49d4-467a-954f-586fe924de08 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.181050 Aug 30 17:54:29.059506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2758/5267] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:28 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:29.488860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:29.489512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:29.497300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:29.497780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:29.498217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:29.498903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:29.499352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:29.499803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:29.645802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:29.653774 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c7b3773c-7e5f-4b7f-8fe6-f2d0770b0ee7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.168854 Aug 30 17:54:29.654353 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2510/5268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:29 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:29.713395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:29.714683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:29.727702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:29.728765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:29.729594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:29.731668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:29.732501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:29.733313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:29.764437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:29.907066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:29.915675 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b79deca-e49a-4bad-b6c3-463c4f568ec8 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.210701 Aug 30 17:54:29.916259 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2759/5269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:29 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:30.082050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:30.082789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:30.089024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.089503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.090568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:30.091436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.091915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.092367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:30.236217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:30.244887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:30.246714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:30.247909 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-efb1dae1-ed2a-4a48-8486-f914ec57ca65 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.169904 Aug 30 17:54:30.248484 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2511/5270] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:30 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:30.674410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:30.675032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:30.681097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.681576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.682009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:30.682689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.683138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.683600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:30.826246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:30.835456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ded0715-c81e-400e-811c-95203b4d1271 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.164875 Aug 30 17:54:30.836270 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2760/5271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:30 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:30.938283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:30.938844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:30.946687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.947180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.947967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:30.948820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:30.950532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:30.950976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:31.090963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:31.100215 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6502cb18-5b42-4326-9cd0-8940a1756f47 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.166571 Aug 30 17:54:31.100808 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2512/5272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:30 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:31.270297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:31.270933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:31.277091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:31.278287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:31.278988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:31.279827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:31.280377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:31.280880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:31.419131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:31.428175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:31.429646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:31.430827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3df96d7f-2c92-42e7-883f-9aebacb08417 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.164556 Aug 30 17:54:31.431391 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2761/5273] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:31 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:31.858533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:31.859171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:31.866622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:31.866622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:31.867074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:31.868035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:31.868487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:31.868906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:32.007089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:32.017357 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-053785d8-8e36-480d-842a-296b5f4cbd1e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.163923 Aug 30 17:54:32.017940 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2513/5274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:31 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:32.122830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:32.123461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:32.130693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:32.131177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:32.131638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:32.132338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:32.132906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:32.133518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:32.350163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:32.360141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ecb0b789-48bc-4422-8f57-227432f9e931 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.241782 Aug 30 17:54:32.360963 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2762/5275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:32 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:32.454650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:32.460007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:32.468250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:32.468923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:32.469489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:32.470575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:32.471223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:32.471796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:32.614082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:32.625650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:32.627220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:32.629072 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0acc950a-19e5-4382-9ea8-588593b493fd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.178301 Aug 30 17:54:32.629765 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2514/5276] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:32 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:33.039926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:33.040753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:33.047098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.047808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.048479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.049387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.049914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.050532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.086465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:33.115454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:33.259109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:33.274025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3eed458b-4d9e-4f2a-9bd5-e7bd91e67f84 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.237998 Aug 30 17:54:33.289501 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2763/5277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:33 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:33.383632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:33.384947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:33.393619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.394210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.394715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.395524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.396077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.396570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.445346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:33.566070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:33.576330 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5ac627d-d289-4d18-8ec4-d3839b9a1529 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.198144 Aug 30 17:54:33.577526 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2515/5278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:33 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:33.655118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:33.656113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:33.663789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.664386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.664951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.665747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.666481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.666905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.705532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:33.706055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:33.725705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.726445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.726883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.727777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.728374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.728946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.767776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:54:33.806286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:33.884650 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e8922ef-8f01-4037-b625-851f5da22835 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 204 len: 0 microversion: 2.1 time: 0.182204 Aug 30 17:54:33.889255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2516/5279] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:54:33 2022] DELETE /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:54:33.899963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:33.903758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:33.908723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:33.925490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:33.926994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:33.928554 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b5706ba-8f14-4fdc-809b-a3b2d88248b8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.278417 Aug 30 17:54:33.930069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.930852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.931446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.932837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:33.933515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:33.934213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:33.943081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2764/5280] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:33 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:34.093947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:34.104309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8536df3e-51af-4e49-b58d-76a646b514f4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1552 microversion: 2.1 time: 0.213388 Aug 30 17:54:34.120690 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2517/5281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:33 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:34.296400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:34.297689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:34.305766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.306795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.307402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.309171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.310028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.310624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.488263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:34.499917 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-609e536d-7867-4f60-bb8b-11e731c02bd1 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1280 microversion: 2.1 time: 0.209386 Aug 30 17:54:34.515798 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2765/5282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:34 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:34.608953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:34.609690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:34.624657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.625259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.625755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.626690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.627222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.632921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.802246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:34.811102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9047f74-b059-436b-8b5a-b69e0fbc5855 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.206312 Aug 30 17:54:34.812199 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2518/5283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:34 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:34.817318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:34.819858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:34.826803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.827298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.827780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.828486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.828949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.829382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.861918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c59acb5a-02a9-4f8e-91f9-716b324205c9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051588 Aug 30 17:54:34.862511 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2766/5284] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:54:34 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:34.951345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:34.952268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:34.958454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.958943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.959385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:34.960101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:34.960721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:34.961150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.129736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:35.130728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:35.146942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.147783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.148719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.153903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.154481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.156837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.165610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:35.187396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:35.188931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:35.190359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b573012c-5ddd-4abc-b554-47c9856d3a51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1752 microversion: 2.20 time: 0.243551 Aug 30 17:54:35.191000 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2519/5285] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:34 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:35.203736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:35.209213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:35.216776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.217044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.217486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.218234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.218723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.219193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.268823 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-380f5222-89e9-4714-8b0d-9b03f5be836c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35" status: 200 len: 194 microversion: 2.1 time: 0.070927 Aug 30 17:54:35.275056 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2520/5286] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 17:54:35 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:35.292689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:35.293732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:35.303744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.304332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.304767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.305483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.305938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.306373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.429412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:35.466334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lazy-loading 'services' on Instance uuid 60ba1883-c3dc-4f3b-86f0-a30808e73636 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:35.468056 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4415563-f426-4f5c-9e83-18bd8b9465dd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1552 microversion: 2.1 time: 0.320371 Aug 30 17:54:35.468740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2767/5287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:35 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1552 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:35.521092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:35.521972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:35.529037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.529785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.530381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.532501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.533123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.533730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.583907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37852a6f-3448-458d-bb3f-f33ab06e7a7a tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35" status: 202 len: 0 microversion: 2.1 time: 0.294059 Aug 30 17:54:35.585802 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2521/5288] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:54:35 2022] DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/8c233161-ca2d-4c35-a44c-8506c7626c35 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:35.736775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:35.750387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-14334c33-9cec-4ece-9c56-80f4ac0b11d8 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.232867 Aug 30 17:54:35.752234 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2768/5289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:35 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:35.832506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:35.834980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:35.844362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.845056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.845538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:35.846617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:35.847121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:35.847940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.104884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:36.115154 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee6a2072-4e53-4834-b93f-59e1f825afb5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.286650 Aug 30 17:54:36.125430 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2522/5290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:35 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:36.214058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:36.215175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:36.222513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.223059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.223817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.224699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.225274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.225889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.340637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986", "name": "network-vif-deleted", "tag": "5c053eeb-2412-43ed-8b10-b3e76ff7521f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:36.360737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.361397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.361988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.381869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] Creating event network-vif-deleted:5c053eeb-2412-43ed-8b10-b3e76ff7521f for instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 on n-h1-852771-11 Aug 30 17:54:36.402741 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e1018c34-d58e-4cbf-a5df-3de0a3c54d64 req-b9be5184-948f-4fbf-befd-4cdbbf4cde15 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066404 Aug 30 17:54:36.403458 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2523/5291] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:36.490356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:36.491063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:36.502501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.502996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.503430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.504165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.505165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.505165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.516077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:36.530283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:36.532094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:36.533494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37ce36cf-6171-41d3-9c0f-3566ed036e21 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.324704 Aug 30 17:54:36.534287 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2769/5292] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:36 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:36.565579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.566454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.567216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.567975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lazy-loading 'fault' on Instance uuid e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:36.625076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:36.639153 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b5ca504-cc52-44c4-bb87-ca409123b254 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 200 len: 1339 microversion: 2.1 time: 0.153273 Aug 30 17:54:36.640232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2524/5293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:36 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 1339 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:36.775749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:36.776470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:36.791025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.792116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.795962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:36.798330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:36.799021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:36.799791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.129022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:37.138701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:37.139345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:37.147964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b53ec2f8-feaf-4e7a-b032-85c4ae848bd0 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.377728 Aug 30 17:54:37.154859 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2770/5294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:36 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:37.155037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.155037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.155037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.155037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.155037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.155405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.312049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:37.321505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09361152-0412-40c2-8a5a-580938b6815f tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.187103 Aug 30 17:54:37.322201 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2525/5295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:37 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:37.557237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:37.558140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:37.565661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.566226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.566758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.567567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.568222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.568827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.662476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:37.663020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:37.672713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.673217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.673656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.677816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:37.678301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:37.678991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:37.696581 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] HTTP exception thrown: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Request method failure captured: Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 HTTP/1.1 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5Lmh2eFol9LoKl2l0kkHtl9JuLCebNeuO4hGMbbiWFXuGzp43VSvJ3Cs28Ogejj1Yr_AFo23jwRhw1GYSW7Ry897sY7Z6QeYigXvp86FwCZ5yhdtZOcvMDFU6E3Otlw7US75HVixOX4dMVHV8EfeV-OF7oMu6D7tKIsf3o6ziNYpQ Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fd3d6fa6581c450498bb5342679ba56e"}]}] Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ac8ef9389b8d4154adc7c88f552995c4 Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986'} Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:37.698260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Returning 404 to user: Instance e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1904d082-8948-4d91-a634-a8ee8f62522f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986" status: 404 len: 111 microversion: 2.1 time: 0.041328 Aug 30 17:54:37.705760 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2526/5296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:37 2022] GET /compute/v2.1/servers/e9ffdee0-7e38-4fbf-8a6b-549a7b4e6986 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:54:37.768658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:37.778933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:37.780771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:37.782162 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1c8e0e6-e051-46b0-97fc-cded5fcaddca tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.229058 Aug 30 17:54:37.783278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2771/5297] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:37 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:37.920896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-05d66f0b-88ca-449e-8b7e-ce309ea25da7 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '.version_select at 0x7f2d9380f8b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:37.974669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-05d66f0b-88ca-449e-8b7e-ce309ea25da7 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1105643842" status: 202 len: 0 microversion: 2.1 time: 0.067592 Aug 30 17:54:37.976504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2527/5298] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:54:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1105643842 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:38.098116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:38.111379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.112113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.112822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.126564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] Creating event network-changed:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h2-852771-11 Aug 30 17:54:38.132158 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b0967fb3-52c9-4a73-99d1-9fa1fc8947de req-9e8d127c-fce2-40b9-90ea-9ca3579a30a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226221 Aug 30 17:54:38.132793 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2772/5299] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:38.171320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:38.172729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:38.180109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.180853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.181546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.182538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.183300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.184345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.345763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:38.346642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:38.361573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.362631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.363076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.364016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.364786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.365280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.515276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:38.524670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8dda70e6-bce9-48ad-8304-4ad3f9fa1336 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.358896 Aug 30 17:54:38.526413 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2528/5300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:38 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:38.609629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:38.618769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-978b0584-b499-4ccd-9550-565df637bc90 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.277402 Aug 30 17:54:38.623747 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2773/5301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:38 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:38.821259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:38.821883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:38.834123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.834611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.835037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:38.841810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:38.843888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:38.844520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:39.223370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:39.237515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:39.248439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:39.249982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-05924892-5f61-428c-977c-bfa7c7cac7e4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.447724 Aug 30 17:54:39.251089 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2529/5302] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:38 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:39.547738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:39.548417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:39.563705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:39.564399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:39.566365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:39.569129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:39.572409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:39.575564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:39.646107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:39.646970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:39.656484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:39.659124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:39.659779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:39.660695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:39.662579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:39.665271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:39.896224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:39.913387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d7733bd-b387-4e77-9757-60607fe82205 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.371004 Aug 30 17:54:39.914001 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2774/5303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:39 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:40.285758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:40.286374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:40.294659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:40.295142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:40.295868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:40.296796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:40.297475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:40.298129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:40.411685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:40.425400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15689c25-0588-4968-8558-f9d5ebb1f3b2 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.783001 Aug 30 17:54:40.426005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2530/5304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:39 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:40.535523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:40.549109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:40.556192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:40.560526 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f77728c4-80d2-4725-bc68-990b5a0f4d9c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.287941 Aug 30 17:54:40.574127 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2775/5305] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:40 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:40.936872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:40.937727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:40.960116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:40.960714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:40.961265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:40.968452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:40.969018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:40.969777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.365742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:41.378336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2324168a-a390-46a4-a5d0-dff4a4c39546 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.445712 Aug 30 17:54:41.380030 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2531/5306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:40 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:41.451962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:41.452581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:41.463287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.466568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.467039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.467815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.468294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.468720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.590827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:41.591519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:41.603216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.604239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.608704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.609675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.610317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.610922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.771394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:41.774499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:41.787551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f361497d-f86a-4ab1-ba7c-19777701dfef tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.340063 Aug 30 17:54:41.789785 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2776/5307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:41 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:41.798651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:41.801725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:41.826081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.826844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.829774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.835776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:41.836350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:41.837417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:41.895150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:54:41.927055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:41.944298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:41.946035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:41.951149 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-da18eb17-926a-4ff7-9359-c7b6b8c031c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.365241 Aug 30 17:54:41.969915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2532/5308] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:41 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:41.976457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834aec5-9171-40b5-8887-a539cef97b9a", "tag": "7eac52bd-6fff-41e5-9e55-4a19b4303884"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:41.999256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.002135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.002754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.033328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] Creating event network-changed:7eac52bd-6fff-41e5-9e55-4a19b4303884 for instance 3834aec5-9171-40b5-8887-a539cef97b9a on n-h2-852771-11 Aug 30 17:54:42.033945 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ca793fe-6257-4063-8346-79b9adf3ab6e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 204 len: 0 microversion: 2.1 time: 0.241601 Aug 30 17:54:42.034800 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2777/5309] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:54:41 2022] DELETE /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:54:42.046055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:42.047078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:42.055757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.056441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.056867 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ee9b1a3f-c2b3-445a-a51b-751cb4ef4639 req-458ab552-844f-40cf-88fe-5d65c234b97f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084927 Aug 30 17:54:42.057084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.058693 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2533/5310] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:42.060220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.060850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.061201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.374236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:42.386749 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9ce1835-d584-404b-9695-261720ba8c80 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.347086 Aug 30 17:54:42.391261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2778/5311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:42 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:42.404930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:42.406163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:42.416046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.418636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.419626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.423790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.424955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.425491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.490170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:42.708464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:42.722322 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-508eef7b-0288-424a-bf9c-e3136907c30d tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.325619 Aug 30 17:54:42.723752 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2534/5312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:42 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:42.810197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:42.810814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:42.820109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.822359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.822819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.823816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.824457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.824869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.978678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:42.980591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:42.993565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.994112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:42.994616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:42.996116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:42.996646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.000081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.022929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.036365 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a951355-17ac-4212-901a-93deee02b329 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.230069 Aug 30 17:54:43.053456 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2779/5313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:42 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:43.239768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.250314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.255332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.257099 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3ddde26-8882-4b4c-acde-b9fd3bb4e30e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.283772 Aug 30 17:54:43.259764 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2535/5314] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:42 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:43.418418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:43.420205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:43.430508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.431703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.432597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.433273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.433837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.434358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.436060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:43.436601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:43.446769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.447287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.447786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.449404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.449872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.450409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.531689 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7c3657b-a4a3-4eaf-a8ca-eee79da39dd2 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/5075f767-6741-404e-8cf9-2ee142fa8cd1" status: 200 len: 194 microversion: 2.1 time: 0.106660 Aug 30 17:54:43.533269 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2536/5315] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 17:54:43 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/5075f767-6741-404e-8cf9-2ee142fa8cd1 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:43.560426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:43.561271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:43.569569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.570294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.570934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.571988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.572729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.573387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.694870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.710790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af800b1a-97c6-4e1e-9023-76dde2fab438 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.296592 Aug 30 17:54:43.713230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2780/5316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:43 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:43.724993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lazy-loading 'services' on Instance uuid 60ba1883-c3dc-4f3b-86f0-a30808e73636 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:43.744473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:43.745246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:43.761069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.761627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.762107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.762868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:43.763364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:43.763856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:43.866473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fda1bb03-d085-4770-8d6a-973d7ed1818f tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/5075f767-6741-404e-8cf9-2ee142fa8cd1" status: 202 len: 0 microversion: 2.1 time: 0.313586 Aug 30 17:54:43.868108 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2537/5317] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:54:43 2022] DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments/5075f767-6741-404e-8cf9-2ee142fa8cd1 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:43.969757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:43.999928 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d3c0e6e-6f46-4ba1-940a-d0897afd5fa7 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.259891 Aug 30 17:54:44.000765 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2781/5318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:43 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:44.061116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.061751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.068978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.069467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.069904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.070594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.071233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.071695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.217844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:44.226932 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-105df707-aa2c-4fae-8046-fc72a0cfb262 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.170186 Aug 30 17:54:44.227883 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2538/5319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:44 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:44.290438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.291159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.297495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.298123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.298651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.299444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.300345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.300996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.475384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:44.486404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:44.487886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:44.489082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4f42bb2a-847b-4925-ba29-f7b52ff8ae6d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.206594 Aug 30 17:54:44.490120 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2782/5320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:44 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:44.511975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.512567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.519926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.520414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.520841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.521535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.521973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.522386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.549359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83639b24-2822-45e3-b104-6d3bd611155d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/ips" status: 200 len: 149 microversion: 2.1 time: 0.041214 Aug 30 17:54:44.549951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2539/5321] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:54:44 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:44.561742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab6533a1-0036-466b-91b5-258d59c7f5de"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:44.564405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.570786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.571714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.571714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.572437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.572913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.573319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.661811 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/os-volume_attachments HTTP/1.1 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 74 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: {"volumeAttachment": {"volumeId": "ab6533a1-0036-466b-91b5-258d59c7f5de"}} Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': 'b3881c7d-66e5-4769-8564-c78b9b2a9dc7', 'body': {'volumeAttachment': {'volumeId': 'ab6533a1-0036-466b-91b5-258d59c7f5de'}}} Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:54:44.671093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 400 to user: Invalid volume: volume ab6533a1-0036-466b-91b5-258d59c7f5de is already attached to instances: 8a12f5d0-5ea8-40d4-b991-7bec7808af30 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-486ffa7f-e622-47be-9d78-6ffba771fbcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115232 Aug 30 17:54:44.674739 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2783/5322] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:54:44 2022] POST /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:54:44.681966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.682458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.689095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.689572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.689999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.690685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.691127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.691787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.723662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:54:44.743857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.744811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.753294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:44.756841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.757671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.759589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.761814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.763795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.764506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.803231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:44.824776 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9622bcdc-8454-426b-869a-18f3f256bf83 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 204 len: 0 microversion: 2.1 time: 0.145977 Aug 30 17:54:44.828642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2540/5323] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:54:44 2022] DELETE /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:54:44.835939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:44.836706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:44.847644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.848389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.848886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.849587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:44.850347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:44.850771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:44.940828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:44.950429 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57409b03-4b20-4efe-ae98-5cf399313cc0 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.213202 Aug 30 17:54:44.951020 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2784/5324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:44 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:44.993267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.002035 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-963d5bec-bba6-491c-97ea-9ed5a1ee3c8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.171243 Aug 30 17:54:45.016356 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2541/5325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:44 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:45.021725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:45.038143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:45.056416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.056922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.058252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.059709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.060180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.064181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.239230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.249814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:45.250136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e16506e7-5bd8-4fd7-8089-14aab6cfdd42 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.232136 Aug 30 17:54:45.250610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:45.251096 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2785/5326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:45 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:45.288716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.292644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.299109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.300196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.300675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.301102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.514336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:45.515533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:45.526453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.531161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.532390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.534493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.536059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.537903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.659027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.674379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f12f876e-b58d-42b6-be15-de37e2e41ba5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.429856 Aug 30 17:54:45.684429 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2542/5327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:45 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:45.813920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.826363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.830240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:45.831867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-957c21c1-3214-41fe-b48b-78fe4901dc23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.323057 Aug 30 17:54:45.836039 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2786/5328] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:45 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:45.972128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:45.973386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:45.980255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.980852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.981291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:45.981998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:45.982449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:45.982877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.026988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:46.028218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:46.042332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.043647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.044378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.045278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.050888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.051735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.193981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:46.204026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9df36355-a3c0-4f86-8df8-34274697ab07 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.235785 Aug 30 17:54:46.220127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2543/5329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:45 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:46.312981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:46.321989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84a4860f-b093-40a4-a0f5-ca78b3bfae57 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.300270 Aug 30 17:54:46.324698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2787/5330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:46 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:46.402919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:46.403964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:46.410441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.411423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.412055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.412939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.413381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.413979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.459466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "name": "network-vif-plugged", "status": "completed", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:46.483718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.484211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.484653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.514486 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] Creating event network-vif-plugged:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:54:46.529657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7f8552df-7809-4596-adcb-1a40b2555bf3 req-0ad95b6b-02b9-4edb-b4c0-04d0216325b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073858 Aug 30 17:54:46.530907 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2788/5331] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:46.622204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:46.632299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-30ef2b76-a9a2-4031-8f39-c5f160220156 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.234127 Aug 30 17:54:46.648040 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2544/5332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:46 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:46.697594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:46.698236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:46.710229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.710742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.711177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.711930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.712393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.712823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.859152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:46.859849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:46.866087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.866884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.867581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.868533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:46.869203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:46.869841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:46.947413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:46.970137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1a44b93-2890-41b9-b36a-b2d4d064d016 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.276571 Aug 30 17:54:46.971319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2789/5333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:46 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:47.169394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:47.195106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:47.195106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:47.195106 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-edec2dec-8d4c-45fb-a10c-d0c0ef04966f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.329297 Aug 30 17:54:47.195106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2545/5334] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:46 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:47.227364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:47.228791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:47.239363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.240174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.241315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.242696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.244058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.244972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.345684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:47.346670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:47.360066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.363610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.364132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.364941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.365471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.365965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.507953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:47.518987 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6cb21a21-8789-4239-b514-aa3854b500e4 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.295959 Aug 30 17:54:47.537581 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2790/5335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:47 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:47.654802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:47.663538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:47.679296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.680077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.681722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.682660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:47.684225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:47.684823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:47.747967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:47.758552 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cdeedde8-46e3-40b7-9e2d-bf4579b9bcf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.416556 Aug 30 17:54:47.759269 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2546/5336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:47 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:47.999051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:47.999910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:48.009351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.009767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.010203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.016336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.017358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.017963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.047399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.061914 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-810b4671-1427-4456-8294-cd144699407e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1268 microversion: 2.1 time: 0.406122 Aug 30 17:54:48.073995 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2791/5337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:47 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1268 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:48.207299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:48.207933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:48.223041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.223557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.224178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.225126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.225730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.226304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.253540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.262433 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d02a0cd4-9225-490f-8bfc-517ca58314cd tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.270102 Aug 30 17:54:48.266904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:48.267346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2547/5338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:47 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:48.446697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.457453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.458936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.461025 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-22c012b0-7d4a-4d93-be81-4b9ced8d1d44 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.257562 Aug 30 17:54:48.462112 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2792/5339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:48 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:48.546382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:48.546920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:48.559436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.560103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.560525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.561578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.561691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.562061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.714560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.722447 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-becfc0b0-ede5-4d7b-95b7-7a5255406acc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.180754 Aug 30 17:54:48.723048 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2548/5340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:48 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:48.780563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:48.781115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:48.787400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.788080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.788522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.789229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:48.789691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:48.790122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:48.929560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:48.937321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01bfaf04-4b84-42dd-ac79-b0e92e716abb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.161451 Aug 30 17:54:48.937926 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2793/5341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:48 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:49.085501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.086111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.092815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.093299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.093734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.094425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.094873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.095325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.097955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:49.232775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.240984 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11023782-d72f-4e18-b64b-9d8a2b4d2e4e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1458 microversion: 2.1 time: 0.159395 Aug 30 17:54:49.241586 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2549/5342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:49.262267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.263152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.270214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.270728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.271134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.271883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.272337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.272768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.293385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.294168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.300767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.301351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.301858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.302636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.303161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.303679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.422822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.433769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc974f2c-76c8-4214-8623-ddaa8c014b5a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1458 microversion: 2.1 time: 0.175946 Aug 30 17:54:49.449010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.449261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2794/5343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1458 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:49.458476 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d09a424-0ddc-4d37-89b6-7ac0cbf836d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.169403 Aug 30 17:54:49.459576 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2550/5344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:49.483428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.484078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.490264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.490760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.491201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.491920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.492374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.492800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.631867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.648604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.650103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.651867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2df7b0d8-3374-42cc-bbb9-f5eae1084bc5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.172312 Aug 30 17:54:49.652793 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2795/5345] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:49.744634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.745790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.754438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.754926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.755350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.756101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.756543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.756972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.905442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:49.913260 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f12c6150-89be-421a-8e13-4b0080057764 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1670 microversion: 2.1 time: 0.172466 Aug 30 17:54:49.914018 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2551/5346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:49.958900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:49.959808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:49.966843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.967328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.967782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:49.968481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:49.968933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:49.970281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.177569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:50.186962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-28de1beb-0124-4779-8112-25c60575026d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.232018 Aug 30 17:54:50.187589 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2796/5347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:49 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:50.484409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:50.485007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:50.501037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.501518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.501951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.502654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.503099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.503530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.674761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:50.675197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:50.681864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.682664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.683266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.684166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.684806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.685451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.798767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:50.809935 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5fd39a4-e672-4a03-aefc-d427784eee61 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.327516 Aug 30 17:54:50.825904 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2552/5348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:50 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:50.936763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:50.937647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:50.944539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.945617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.946226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:50.947097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:50.949039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:50.949645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.076494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:51.084998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:51.098218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:51.103419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:51.106840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-165f0cad-e13c-4e88-9b17-beb98d3e68da tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.436555 Aug 30 17:54:51.110261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2797/5349] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:50 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:54:51.116289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f189802-1fa0-45b4-abe4-a70a31760cd9 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1602 microversion: 2.1 time: 0.182918 Aug 30 17:54:51.131580 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2553/5350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:50 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1602 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:51.137674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834aec5-9171-40b5-8887-a539cef97b9a", "name": "network-vif-deleted", "tag": "7eac52bd-6fff-41e5-9e55-4a19b4303884"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:51.152204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.153104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.154034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.168080 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] Creating event network-vif-deleted:7eac52bd-6fff-41e5-9e55-4a19b4303884 for instance 3834aec5-9171-40b5-8887-a539cef97b9a on n-h2-852771-11 Aug 30 17:54:51.176524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9ecb2933-39fc-49f5-9f26-33e50128908d req-fa4e8c62-725b-4ddf-8648-96986be8c470 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062469 Aug 30 17:54:51.177391 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2798/5351] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:51.209983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:51.210818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:51.221298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.221782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.222210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.222904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.223345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.228072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.424613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:51.433421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f722abcb-61b7-4493-89ff-d5b26d378dc1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.226564 Aug 30 17:54:51.434502 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2554/5352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:51 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:51.667700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:51.670276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:51.677126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.677721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.678374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.679179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.679761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.680307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.724148 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3553900-2556-48bf-9292-2141072caa22 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060349 Aug 30 17:54:51.725293 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2799/5353] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:54:51 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:54:51.832336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:51.833618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:51.848685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.849526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.850135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.851199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.851867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.852477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.857150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:51.859515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:51.865975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.866747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.867419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.868370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.869034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.869667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.901677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65d09ebf-efd2-4e7d-a857-4162e604ebc4 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048840 Aug 30 17:54:51.908107 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2800/5354] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:54:51 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:54:51.974449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:51.975338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:51.991265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.992152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.992827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:51.993967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:51.995418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:51.996379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.026843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:54:52.157610 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be6ad754-fee4-4a2b-9abe-ae6c4c049682 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 204 len: 0 microversion: 2.1 time: 0.186622 Aug 30 17:54:52.159188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2801/5355] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:54:51 2022] DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:54:52.165547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:52.170037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:52.178432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.180629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.181174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.182461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.183147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.183910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.378390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.392560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d514168-f812-4556-8a26-67184670625d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.564092 Aug 30 17:54:52.393719 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2555/5356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:51 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:52.401036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:52.411436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:52.420662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.421915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.424872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.425820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.430026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.430637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.478792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.480587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.481362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.482129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lazy-loading 'fault' on Instance uuid 3834aec5-9171-40b5-8887-a539cef97b9a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:52.524292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.534003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.535445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.536656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bf7ddb27-3c39-494f-8aac-3b1bb35277c6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.376606 Aug 30 17:54:52.537561 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2802/5357] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:52 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:52.542142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:52.542876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:52.548762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.549365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.549807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.550501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.550955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.551381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.692603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.694752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:52.704728 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-639aaa2e-bf64-47db-b8ba-76ed197749c5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 200 len: 1339 microversion: 2.1 time: 0.309758 Aug 30 17:54:52.705676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-043633e8-03a2-4bd0-b2c7-29fefa9de26c tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1672 microversion: 2.1 time: 0.167099 Aug 30 17:54:52.719517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2803/5358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:52 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:52.719517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:52.721431 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2556/5359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:52 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 1339 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:52.723766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.728174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.728174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.740543 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] Creating event network-changed:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:54:52.746056 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1fc3d534-317b-4358-beef-ae57f6fb294f req-1928ddac-477f-43ab-a048-569862b1c075 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036904 Aug 30 17:54:52.747223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:52.750985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2804/5360] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:52.756119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:52.764464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.765772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.766622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:52.768901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:52.769583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:52.770220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.126611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:53.138615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66b06e63-ec64-4983-9e0e-067ab6574e5f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1682 microversion: 2.1 time: 0.415704 Aug 30 17:54:53.156397 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2557/5361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:52 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:53.422071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:53.423061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:53.433843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.434849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.435593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.437392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.438034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.438646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.562991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:53.564174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:53.581130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.581854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.582369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.584193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.586174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.589543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.692829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:53.706792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e44e31b6-0469-47d5-b513-3fce6189bcd1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1735 microversion: 2.1 time: 0.291040 Aug 30 17:54:53.713151 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2805/5362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:53 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:53.745586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:53.747848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: 3834aec5-9171-40b5-8887-a539cef97b9a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:53.755745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.757110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.757810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.760350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.761606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.761871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.778171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] HTTP exception thrown: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Request method failure captured: Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a HTTP/1.1 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5Lmh2eFol9LoKl2l0kkHtl9JuLCebNeuO4hGMbbiWFXuGzp43VSvJ3Cs28Ogejj1Yr_AFo23jwRhw1GYSW7Ry897sY7Z6QeYigXvp86FwCZ5yhdtZOcvMDFU6E3Otlw7US75HVixOX4dMVHV8EfeV-OF7oMu6D7tKIsf3o6ziNYpQ Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fd3d6fa6581c450498bb5342679ba56e"}]}] Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: ac8ef9389b8d4154adc7c88f552995c4 Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3834aec5-9171-40b5-8887-a539cef97b9a'} Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:53.780144 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. Aug 30 17:54:53.784762 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:53.786324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Returning 404 to user: Instance 3834aec5-9171-40b5-8887-a539cef97b9a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:53.787433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c6964568-9f76-4dd1-b99d-35c3352b5088 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a" status: 404 len: 111 microversion: 2.1 time: 0.049315 Aug 30 17:54:53.792433 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2806/5363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:53 2022] GET /compute/v2.1/servers/3834aec5-9171-40b5-8887-a539cef97b9a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:54:53.793512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:53.794459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:53.801845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.802343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.803207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:53.804208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:53.805907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:53.806557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.141122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:54.150107 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-940e1d3c-6c10-4c2e-80e1-81643a520df0 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1672 microversion: 2.1 time: 0.360815 Aug 30 17:54:54.150701 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2807/5364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:53 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1672 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:54.172658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:54.173700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:54.182156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:54.183749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:54.184191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.184902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:54.185354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:54.185776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.260835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:54.272393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:54.274445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:54.279275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:54.287131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8aa903cd-9a93-4e47-a5b7-59f7c1d03f85 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.731512 Aug 30 17:54:54.289389 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2558/5365] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:53 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:54.293489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f702ff02-5513-4e1e-b138-0394a77959be tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 200 len: 1614 microversion: 2.1 time: 0.125782 Aug 30 17:54:54.294601 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2808/5366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:54 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:54.327841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b23dfa5-2648-416c-9a30-4bf5f0d07807 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '.version_select at 0x7f2d936835e0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:54.351605 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b23dfa5-2648-416c-9a30-4bf5f0d07807 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1376063299" status: 202 len: 0 microversion: 2.1 time: 0.027088 Aug 30 17:54:54.353274 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2559/5367] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1376063299 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:54.732149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:54.732679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:54.748486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:54.748975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:54.749623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.750614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:54.751228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:54.751858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.779349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:54.861410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3881c7d-66e5-4769-8564-c78b9b2a9dc7", "name": "network-vif-deleted", "tag": "2645038b-ff80-4ce9-84a1-2a22c0295574"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:54.883973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:54.884474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:54.884895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:54.912084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] Creating event network-vif-deleted:2645038b-ff80-4ce9-84a1-2a22c0295574 for instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 on n-h2-852771-11 Aug 30 17:54:54.930818 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6e303e6c-f1fd-4e5b-94a0-c843a4cc1afa req-8fa3ac7a-be10-49ce-b9d3-d2f32fe3dcc1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073355 Aug 30 17:54:54.935451 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2560/5368] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:54:55.175373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:55.176115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:55.191509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:55.192704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:55.194174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:55.195851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:55.198385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:55.200386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:55.754146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:55.784623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79ed5783-8c7e-43e8-ab3d-ed61af4413e1 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1672 microversion: 2.1 time: 0.615746 Aug 30 17:54:55.787831 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2561/5369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:55 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1672 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:55.794175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:55.804455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:55.819344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:55.820507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:55.826658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:55.827731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:55.828377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:55.828956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.124143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:56.157591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:56.162113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:56.164520 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70d2059b-4ae7-4161-90f9-a3ac5d1d6444 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.375375 Aug 30 17:54:56.175529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2562/5370] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:55 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:56.193051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:56.193681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:56.222526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.223263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.223760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.228091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.231683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.232095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.265893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:56.281343 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:54:56.282344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4f71ddc1-f1a5-47c6-b05a-8aa99c55c990 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1715 microversion: 2.1 time: 1.554658 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 HTTP/1.1 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b3881c7d-66e5-4769-8564-c78b9b2a9dc7'} Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:56.285805 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:54:56.289847 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.291342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:56.293678 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4346e04a-aec0-40ce-a046-bb20a87c1daf tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 404 len: 111 microversion: 2.1 time: 0.124139 Aug 30 17:54:56.301546 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2563/5371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:56 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:54:56.307426 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2809/5372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:54 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1715 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:56.308614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4fcdd5ad-ddf9-4f53-b792-e4392aefd5c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '.version_select at 0x7f2d9380f8b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:56.369403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4fcdd5ad-ddf9-4f53-b792-e4392aefd5c6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981014132" status: 202 len: 0 microversion: 2.1 time: 0.066421 Aug 30 17:54:56.370924 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2564/5373] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981014132 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:56.494516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:56.498690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:56.505302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.506150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.506706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.507558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.511273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.511889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.705187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Cannot 'detach_volume' instance 3552c53e-ede4-42de-8009-69f055d6365a while it is in vm_state rescued Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments/e5f7d4de-511a-47a9-8e43-0d27bec17634 HTTP/1.1 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'detach_volume' instance 3552c53e-ede4-42de-8009-69f055d6365a while it is in vm_state rescued Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '3552c53e-ede4-42de-8009-69f055d6365a', 'id': 'e5f7d4de-511a-47a9-8e43-0d27bec17634'} Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3552c53e-ede4-42de-8009-69f055d6365a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3552c53e-ede4-42de-8009-69f055d6365a while it is in vm_state rescued Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.708456 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3552c53e-ede4-42de-8009-69f055d6365a while it is in vm_state rescued Aug 30 17:54:56.712771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:56.716860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 409 to user: Cannot 'detach_volume' instance 3552c53e-ede4-42de-8009-69f055d6365a while it is in vm_state rescued {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:56.721449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c91b6903-5401-4a73-ad17-8e7d53139827 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments/e5f7d4de-511a-47a9-8e43-0d27bec17634" status: 409 len: 152 microversion: 2.1 time: 0.231811 Aug 30 17:54:56.722052 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2810/5374] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:54:56 2022] DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments/e5f7d4de-511a-47a9-8e43-0d27bec17634 => generated 152 bytes in 233 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:54:56.732226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:56.733091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:56.743748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.744242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.744768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.745788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.759810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.761424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.806262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:56.806790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:56.842619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.843360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.849291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.850675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.854791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.858489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.945246 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98ff802d-4f4d-47cb-ac8f-eff399631103 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.217945 Aug 30 17:54:56.959074 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2565/5375] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:54:56 2022] POST /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:56.981098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:56.982642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:56.994430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.996027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.996948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:56.997888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:56.999213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:56.999919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:57.173672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:57.193351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b01804b4-dbe4-4e5d-9e62-d2b4638c676e tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1605 microversion: 2.1 time: 0.387616 Aug 30 17:54:57.194780 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2811/5376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:56 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1605 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:54:57.221748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}, {"name": "network-changed", "server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:57.240658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:57.241494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:57.242157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:57.257916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Creating event network-changed:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:54:57.258794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] Creating event network-changed:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:54:57.265332 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5dd24900-f9e4-47b5-8426-79e0a3ab9c77 req-ab5587e9-d11e-41af-88e7-6b2749bacb17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065612 Aug 30 17:54:57.266291 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2812/5377] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:57.284751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:57.290625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:57.299393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:57.300071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:57.300618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:57.301436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:57.302003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:57.302548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:57.733946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:57.747346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:57.748948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:57.750171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23cecf37-d1fd-4612-8d55-6d85da24facd tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.481505 Aug 30 17:54:57.756905 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2813/5378] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:57 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:57.834922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ba1883-c3dc-4f3b-86f0-a30808e73636", "name": "network-vif-deleted", "tag": "626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:54:57.862793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:57.863643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:57.864274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:57.881432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] Creating event network-vif-deleted:626a1bbb-a91c-4ef1-88a3-6d2da42a0bf1 for instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 on n-h1-852771-11 Aug 30 17:54:57.887356 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-810d9197-04e1-45aa-9c4b-19193dab82c4 req-8d48d217-6585-4165-a61b-8cd1dda97e6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055611 Aug 30 17:54:57.888552 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2814/5379] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:58.219385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:58.221861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:58.257978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:58.261200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:58.262566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:58.265542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:58.266148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:58.266930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:58.359426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:58.360365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:58.361775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:58.362457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lazy-loading 'fault' on Instance uuid 60ba1883-c3dc-4f3b-86f0-a30808e73636 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:58.389900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:58.399355 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7922e4fe-13b1-4e85-a8fb-614d7d9970e1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1723 microversion: 2.1 time: 1.435953 Aug 30 17:54:58.409043 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2566/5380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:56 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1723 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:58.528959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a13ec5aee742fc99051ec485f19b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb3b961b6b4a53914579236a779da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:58.544338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-545eb619-150e-4e31-b35c-deb544e69022 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 200 len: 1326 microversion: 2.1 time: 0.325862 Aug 30 17:54:58.548431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2815/5381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:58 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 1326 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:54:58.782503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:58.783148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:58.793107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:58.796862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:58.797585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:58.798559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:58.799019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:58.799448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.086001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:59.088016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:59.097266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.098834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.099592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.101285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.102873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.103626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.275451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:59.288261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:54:59.299410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:59.310747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:54:59.321274 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c4ed5aa-00b8-4043-83a1-efdac012b19b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.542772 Aug 30 17:54:59.321957 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2567/5382] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:54:58 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:54:59.370231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'services' on Instance uuid 8a12f5d0-5ea8-40d4-b991-7bec7808af30 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:54:59.434826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:59.435450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:59.451760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.452267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.452702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.461007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.461555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.462041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.535869 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fb892fc-92cb-4c00-8ee1-f7b89d2c1824 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments/ab6533a1-0036-466b-91b5-258d59c7f5de" status: 202 len: 0 microversion: 2.1 time: 0.456708 Aug 30 17:54:59.537897 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2816/5383] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:54:59 2022] DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments/ab6533a1-0036-466b-91b5-258d59c7f5de => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:54:59.548638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:59.552477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:59.561752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.562617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.564057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.565164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.565877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.566662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.620745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df463e4d-9282-422e-9012-fd204268c65a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076663 Aug 30 17:54:59.627510 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2817/5384] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:54:59 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:54:59.639766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:59.643680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:54:59.662186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.663386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.664146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.665473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:54:59.667783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:54:59.669582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:54:59.709136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 HTTP/1.1 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '60ba1883-c3dc-4f3b-86f0-a30808e73636'} Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:54:59.714245 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:54:59.719305 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:54:59.721316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:54:59.724315 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1af35653-542f-47a4-a864-deda962e78a9 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 404 len: 111 microversion: 2.1 time: 0.093381 Aug 30 17:54:59.728148 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2818/5385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:59 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:54:59.741803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de68a8b0-d0b3-41d2-b28d-31ed470229bf tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '.version_select at 0x7f2d9370aaf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:54:59.793770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de68a8b0-d0b3-41d2-b28d-31ed470229bf tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286231068" status: 202 len: 0 microversion: 2.1 time: 0.058550 Aug 30 17:54:59.794527 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2819/5386] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286231068 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:55:00.318551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:00.335167 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d62085a0-88f9-41b4-bc8d-6ead0f54e1ae tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1723 microversion: 2.1 time: 0.908853 Aug 30 17:55:00.351505 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2568/5387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:54:59 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1723 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:00.375941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:00.378443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:00.404373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:00.405732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:00.406889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:00.408505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:00.419531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:00.420433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:00.638870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:00.643048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:00.653882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:00.654711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:00.655450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:00.656423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:00.657077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:00.659360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:00.732679 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f23662fc-f918-427a-8a90-f9ce07b116ca tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099093 Aug 30 17:55:00.733820 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2569/5388] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:00 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:01.160111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:01.183640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:01.185721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:01.187510 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-694a47b2-827b-4970-ac35-e2418f32e5d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.836991 Aug 30 17:55:01.188345 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2820/5389] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:00 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:01.367614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:01.368252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:01.393966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:01.394475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:01.395118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:01.397920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:01.398656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:01.399244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:01.602563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "name": "network-vif-plugged", "status": "completed", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:01.632211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:01.632693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:01.633398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:01.686280 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] Creating event network-vif-plugged:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h2-852771-11 Aug 30 17:55:01.710991 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5faa2b36-5051-4429-93dd-077a0441f949 req-f3e3bf1e-7ceb-4001-bb3b-8b3135855ec8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111812 Aug 30 17:55:01.723067 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2821/5390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:01.748429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:01.758062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:01.778887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:01.780117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:01.781906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:01.784989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:01.787600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:01.788212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:01.872006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b57d3d62-217d-4b46-88b8-cccb6eea0424 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124950 Aug 30 17:55:01.872777 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2822/5391] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:01 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:02.198898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:02.213772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:02.214842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:02.229850 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee35bb64-7077-4c96-a24b-1a1eded481f0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1723 microversion: 2.1 time: 0.858767 Aug 30 17:55:02.231671 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2570/5392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:01 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1723 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:02.245365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:02.245365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:02.245365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:02.245365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:02.245365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:02.247769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:02.885478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:02.888531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:02.904597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:02.905097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:02.907236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:02.910317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:02.914045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:02.914938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:02.978067 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e06be6a-d862-4f77-9a25-ea2138e71f99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097295 Aug 30 17:55:02.988803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:02.991457 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2571/5393] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:02 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:03.000332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:03.003105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:03.004505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2684e1d5-73d8-4e3b-bffc-f7207e5619e1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.795065 Aug 30 17:55:03.005316 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2823/5394] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:02 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:03.265057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:03.265760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:03.286487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:03.286989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:03.287433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:03.289264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:03.292064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:03.296472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:03.584999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:03.599417 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4107ea25-4b29-4343-b4df-8df0910d7221 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1729 microversion: 2.1 time: 0.350163 Aug 30 17:55:03.600691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2572/5395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:03 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1729 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:03.628886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:03.629299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:03.640832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:03.641470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:03.641913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:03.642683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:03.653689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:03.654152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:03.848556 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05d3cd2c-115b-475e-b5e9-5eb644518064 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231316 Aug 30 17:55:03.856256 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2824/5396] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:55:03 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:03.993927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:04.010974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:04.029978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:04.030752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:04.031589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:04.034744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:04.036655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:04.038729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:04.041849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:04.042719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:04.059016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:04.060331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:04.061364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:04.063819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:04.066973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:04.067650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:04.148078 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b816f2bd-e5ad-447b-a700-6fbc1dc314ee tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159577 Aug 30 17:55:04.149815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2573/5397] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:03 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:04.578530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:04.596531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:04.599175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:04.601909 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7609a3a8-0a23-4bea-8003-dbcdd92be226 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1808 microversion: 2.20 time: 0.576121 Aug 30 17:55:04.602594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2825/5398] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:04 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1808 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:05.163756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:05.167571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:05.187557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:05.188155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:05.190313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:05.191346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:05.194795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:05.195494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:05.298991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a4a89e6-65b7-4495-88a0-8485d388e7fd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141040 Aug 30 17:55:05.308779 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2574/5399] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:05 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:05.530821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:05.553971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:05.557946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:05.560719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:05.575647 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] Creating event network-changed:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:55:05.582059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-932bbafe-36e4-47d1-8386-a5922c47ea17 req-00b2a524-0133-400a-b2c0-9a07f8be1ade service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055552 Aug 30 17:55:05.583258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2826/5400] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:05.629184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:05.630177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:05.642601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:05.646585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:05.647501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:05.648470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:05.649147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:05.649820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:06.117223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:06.143604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:06.148104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:06.149704 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f4830c7-e842-41f5-98c2-272ac26e24ec tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1795 microversion: 2.20 time: 0.528262 Aug 30 17:55:06.152643 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2575/5401] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:05 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1795 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:06.321125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:06.324365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:06.344012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:06.344969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:06.345632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:06.346577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:06.347272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:06.348002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:06.412187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d681e08-e6d5-43b5-8ab0-d4899e2b6856 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095548 Aug 30 17:55:06.413421 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2827/5402] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:06 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:07.426767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:07.438639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:07.439763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.440442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.440885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.441954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.442597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.443629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.543412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e9259a1-f903-4f48-9a1c-2f3c9507a0cb tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120826 Aug 30 17:55:07.544137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2576/5403] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:07 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:55:07.600813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:07.627662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.627662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.627662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.634053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:07.634552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:07.644503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.644995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.645588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.646450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.646962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.647391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.659957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] Creating event network-changed:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:55:07.678614 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-519dfff4-b082-4d1c-bee8-216e4a1170c8 req-378e2d80-5cb8-401e-b037-d117c674f391 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081701 Aug 30 17:55:07.688347 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2828/5404] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:07.708360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:55:07.887518 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-34a4ed21-3fb5-4643-b8ac-a608875e7ca1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 204 len: 0 microversion: 2.1 time: 0.257155 Aug 30 17:55:07.891671 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2577/5405] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:55:07 2022] DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:55:07.899330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:07.900099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:07.903168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:07.912278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.913471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.914361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:07.915310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:07.917930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:07.918868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:08.247205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:08.264551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b80005a-2cd6-4c96-ab43-98796e969390 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1679 microversion: 2.1 time: 0.371040 Aug 30 17:55:08.267825 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2829/5406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:07 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1679 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:09.288982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:09.289694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:09.315442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:09.316174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:09.316699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:09.317455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:09.317883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:09.318251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:10.646909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:10.657529 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c554e639-4f46-474d-b4a0-955de2e0c7b3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1679 microversion: 2.1 time: 1.372731 Aug 30 17:55:10.660009 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2578/5407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:09 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1679 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:11.686605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:11.687917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:11.704351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:11.706620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:11.707524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:11.708524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:11.712147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:11.713188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:11.767344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:11.990129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:12.000893 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12bb622f-cca6-4551-b542-63e1b86ece54 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1679 microversion: 2.1 time: 0.318063 Aug 30 17:55:12.002085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2830/5408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:11 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1679 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:12.872477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a12f5d0-5ea8-40d4-b991-7bec7808af30", "name": "network-vif-deleted", "tag": "146a3883-a2e1-4490-ad2a-e286bece63d3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:12.889360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:12.889827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:12.890377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:12.937576 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] Creating event network-vif-deleted:146a3883-a2e1-4490-ad2a-e286bece63d3 for instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 on n-h1-852771-11 Aug 30 17:55:12.953528 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7129f4d1-b6bc-4242-b6b9-75f3e041f616 req-982c2a0d-a24e-4995-9ed9-31571526701e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095460 Aug 30 17:55:12.959374 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2579/5409] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:13.028474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:13.030243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:13.049830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:13.050918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:13.053183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:13.055253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:13.057654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:13.060154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:13.186578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:13.187779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:13.188833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:13.189753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'fault' on Instance uuid 8a12f5d0-5ea8-40d4-b991-7bec7808af30 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:55:13.280478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:13.294677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae917271-0580-49d0-bd05-ad0d906e625d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 200 len: 1329 microversion: 2.1 time: 0.271801 Aug 30 17:55:13.296661 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2831/5410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:13 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 1329 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:14.031198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31a3504c-dac9-4ebf-a827-a5dca516c7bd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: .version_select at 0x7f2d9369ce50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1924820723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGMxrvCwBOU1kxFDjo/01Li44G6K4Ri34rHJTJRpQm+8lEVmjLqsVhID4fywytIer/jCG6ZscCysmhsxYpyXZuoJB8B557U6vxH2Mkdt8ncA4U1O4vTJ7gCvjgVp7aUFQ=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:14.052165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-31a3504c-dac9-4ebf-a827-a5dca516c7bd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:55:14.092192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:14.093914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-31a3504c-dac9-4ebf-a827-a5dca516c7bd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:55:14.207166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31a3504c-dac9-4ebf-a827-a5dca516c7bd tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.185890 Aug 30 17:55:14.215278 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2580/5411] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:55:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:14.325187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:14.327303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:14.348930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:14.349430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:14.350939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:14.355152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:14.357906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:14.360803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:14.412469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 HTTP/1.1 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8a12f5d0-5ea8-40d4-b991-7bec7808af30'} Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:14.421074 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:14.425030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:14.427714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d55eab09-ce26-4d23-86dd-0869d923c0e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 404 len: 111 microversion: 2.1 time: 0.107103 Aug 30 17:55:14.444309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11cc9579-b5e6-4bf7-a10f-09f4901ad5a6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '.version_select at 0x7f2d9380f3a0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:14.458884 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2832/5412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:14 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:14.508771 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11cc9579-b5e6-4bf7-a10f-09f4901ad5a6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78191214" status: 202 len: 0 microversion: 2.1 time: 0.074481 Aug 30 17:55:14.516818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2581/5413] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 30 17:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78191214 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:55:15.771136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bac90df5-59d7-4c1e-8dec-4b2c0ff7af99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: .version_select at 0x7f2d934a24c0>, body: {"keypair": {"name": "tempest-keypair-1663236148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfnFeD8Wp2ZdZoAmrg9bHGnH4m308WuXk625XkTsohiLd2+Z8mdMBF4wFeShTbJh7lYBJc0XezPs017Lw/80z96c28GUdt8lz1+awNLVNYMovNyKaqET+zGM5VnIPj3LQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:15.799367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bac90df5-59d7-4c1e-8dec-4b2c0ff7af99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:55:15.814467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-bac90df5-59d7-4c1e-8dec-4b2c0ff7af99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:55:15.872763 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bac90df5-59d7-4c1e-8dec-4b2c0ff7af99 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105853 Aug 30 17:55:15.877985 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2833/5414] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:55:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:16.571200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-802175582", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "bb3aa68e-6169-4ceb-9b5a-bf94f7b2bd5e"}], "key_name": "tempest-TestNetworkBasicOps-1924820723", "security_groups": [{"name": "tempest-secgroup-smoke-191791351"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:16.836834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] validate_networks() for [('bb3aa68e-6169-4ceb-9b5a-bf94f7b2bd5e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:55:18.155414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:55:18.156537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:55:18.157383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:55:18.158023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:55:18.158636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:55:18.171317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.171784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.172302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.173380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.173888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.174426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.198422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:55:18.209294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Getting quotas for user ac8ef9389b8d4154adc7c88f552995c4 and project fd3d6fa6581c450498bb5342679ba56e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:55:18.227752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:55:18.231203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:55:18.317882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-89a853b0-b1a8-4cb4-8e32-98d37b2de92b tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.753616 Aug 30 17:55:18.318828 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2582/5415] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:55:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:55:18.331448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ebe7ba07-f66d-48a7-84e2-8c37b0fc6697 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:18.332806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ebe7ba07-f66d-48a7-84e2-8c37b0fc6697 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:18.412161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ebe7ba07-f66d-48a7-84e2-8c37b0fc6697 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:18.421218 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ebe7ba07-f66d-48a7-84e2-8c37b0fc6697 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1248 microversion: 2.1 time: 0.093689 Aug 30 17:55:18.440786 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2834/5416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:18 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1248 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:18.597069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:18.597873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:18.611012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.611834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.612454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.613313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.616176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.616907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.651140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 HTTP/1.1 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '60ba1883-c3dc-4f3b-86f0-a30808e73636'} Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:18.653761 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.658526 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.662068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:18.663506 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-873f0f85-8eb4-404a-82ab-68d29ea3a860 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 404 len: 111 microversion: 2.1 time: 0.071576 Aug 30 17:55:18.664642 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2583/5417] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:55:18 2022] DELETE /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:18.673100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:18.673972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: 60ba1883-c3dc-4f3b-86f0-a30808e73636] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:18.681614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.682349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.683926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.685002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:18.685612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:18.686356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:18.713659 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 HTTP/1.1 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '60ba1883-c3dc-4f3b-86f0-a30808e73636'} Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:18.715566 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. Aug 30 17:55:18.719978 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:18.721200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance 60ba1883-c3dc-4f3b-86f0-a30808e73636 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:18.722335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a27931ed-7289-41ab-8f8e-2974c2c70e5d tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636" status: 404 len: 111 microversion: 2.1 time: 0.053752 Aug 30 17:55:18.723557 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2835/5418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:18 2022] GET /compute/v2.1/servers/60ba1883-c3dc-4f3b-86f0-a30808e73636 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:19.099651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1046349112", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9c5be2-f5e4-49b8-9312-c995d1b4829c"}], "security_groups": [{"name": "tempest-securitygroup--1238945733"}], "key_name": "tempest-keypair-1663236148", "user_data": "}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:19.253889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] validate_networks() for [('1b9c5be2-f5e4-49b8-9312-c995d1b4829c', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:55:19.444946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:19.445567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:19.482590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:19.483219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:19.487143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:19.493222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:19.495425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:19.495922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:19.657168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:19.668939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a40608d0-b76c-4284-a6ea-14577dbf0170 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1300 microversion: 2.1 time: 0.227902 Aug 30 17:55:19.684360 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2836/5419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:19 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1300 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:20.021067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:55:20.021938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:55:20.022631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:55:20.023242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:55:20.023948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:55:20.040006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:20.041945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:20.042564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:20.043520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:20.044141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:20.044764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:20.090345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:55:20.111886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:55:20.154634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:55:20.157738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:55:20.244912 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6465321a-53ea-4b46-892e-b52c704288e9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.150213 Aug 30 17:55:20.246217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2584/5420] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:55:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:55:20.258143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91b6a055-c2d8-4125-bce7-8a754f2456da tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:20.259221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91b6a055-c2d8-4125-bce7-8a754f2456da tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:20.401241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91b6a055-c2d8-4125-bce7-8a754f2456da tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:20.410094 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91b6a055-c2d8-4125-bce7-8a754f2456da tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1242 microversion: 2.1 time: 0.156384 Aug 30 17:55:20.411265 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2837/5421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:20 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:20.691716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:20.692621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:20.707506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:20.708591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:20.709813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:20.711851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:20.713343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:20.714203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:20.820988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:20.831670 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-017304e4-f967-48d6-8188-7ea01233514d tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1306 microversion: 2.1 time: 0.144193 Aug 30 17:55:20.848656 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2585/5422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:20 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:21.430654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:21.432100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:21.440148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:21.440951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:21.441494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:21.442381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:21.442942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:21.443472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:21.518663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:21.531343 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2762eeb-ad63-4d66-9a57-0a96e39ba4c0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1294 microversion: 2.1 time: 0.104614 Aug 30 17:55:21.547668 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2838/5423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:21 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:21.859292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:21.859942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:21.883589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:21.884401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:21.885071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:21.888504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:21.888989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:21.889432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:22.317342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:22.329369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1edc0919-a7b3-4f86-a377-104efa1ed33e tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.478559 Aug 30 17:55:22.339534 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2586/5424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:21 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:22.557795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:22.559217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:22.568303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:22.568799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:22.569310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:22.570296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:22.570854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:22.571447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:22.604866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db81bc28-c73a-4da8-a7fe-32d87dc82ad7", "tag": "a861f977-37c3-4f0b-83f0-8439b0f0baa6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:22.623395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:22.625283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:22.628871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:22.647104 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] Creating event network-changed:a861f977-37c3-4f0b-83f0-8439b0f0baa6 for instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 on n-h1-852771-11 Aug 30 17:55:22.665129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-eaf1dc04-d2f4-42dc-b231-8b36d6596d93 req-50127996-4f6b-403e-b230-b8347ef9557b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064685 Aug 30 17:55:22.672349 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2587/5425] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:22.703320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:22.719351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-116e6edb-b208-4030-bb30-08ea81dbc152 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1300 microversion: 2.1 time: 0.168208 Aug 30 17:55:22.720659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2839/5426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:22 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:23.362610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:23.363255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:23.381666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.385040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.385731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.387035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.388721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.389601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.401185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:23.461226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:23.466039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:23.478450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.480115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.482156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.504219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.509814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.514547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.563789 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db HTTP/1.1 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bbeeea5c-d741-4d17-b89c-41590b4572db'} Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:23.568626 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:23.572907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4af86003-836b-4013-815f-964274371141 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 404 len: 111 microversion: 2.1 time: 0.114357 Aug 30 17:55:23.575140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2840/5427] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:55:23 2022] DELETE /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:55:23.583252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:23.583901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] [instance: bbeeea5c-d741-4d17-b89c-41590b4572db] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:23.593164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.593649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.594077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.595081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.597136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.597671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.618804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] HTTP exception thrown: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Request method failure captured: Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db HTTP/1.1 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk2DXaBfjRn3DMbDY3S_67554cc87CwbCXQZYDflmx7czOqalZLQHkFu7OkCGcgNCCSIA33__lOrLooSCuS0NxK7gx-PrjO4QCcoOvLNP9CBbmkW8ui8lpecDpqOXUupNySo-gXrPUrznLLBs98spKCXlmQvyCOk89Q0pDroNFJDBXc Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beeb3b961b6b4a53914579236a779da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beeb3b961b6b4a53914579236a779da1"}]}] Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: beeb3b961b6b4a53914579236a779da1 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-923371647 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e6a13ec5aee742fc99051ec485f19b55 Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeTestJSON-923371647-project Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bbeeea5c-d741-4d17-b89c-41590b4572db'} Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:23.620405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] Returning 404 to user: Instance bbeeea5c-d741-4d17-b89c-41590b4572db could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:23.624253 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7f5a749-96fa-4657-8d6c-e4cb18166511 tempest-AttachVolumeTestJSON-923371647 tempest-AttachVolumeTestJSON-923371647-project] 10.222.0.50 "GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db" status: 404 len: 111 microversion: 2.1 time: 0.043747 Aug 30 17:55:23.629781 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2841/5428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:23 2022] GET /compute/v2.1/servers/bbeeea5c-d741-4d17-b89c-41590b4572db => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:23.678539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:23.688746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e20f3e13-eb1d-423a-be7d-f48bd644643f tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.331653 Aug 30 17:55:23.692295 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2588/5429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:23 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:23.742103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:23.744650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:23.752608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.753551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.754716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:23.755762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:23.756434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:23.757077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:24.202612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:24.210838 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee0af0e6-2de7-41cf-be14-5b15fc6d8508 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.473099 Aug 30 17:55:24.211460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2842/5430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:23 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:24.691134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471adb65-8648-4c0d-bb3a-ad1454364f6b", "tag": "24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:24.705729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:24.706603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:24.709420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:24.714063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:24.714676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:24.724754 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] Creating event network-changed:24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb for instance 471adb65-8648-4c0d-bb3a-ad1454364f6b on n-h2-852771-11 Aug 30 17:55:24.725283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:24.725776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:24.726208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:24.726911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:24.727362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:24.730684 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-eec79021-bd6c-45f3-afa3-34f3a6a77ab4 req-282d0655-e359-43c8-9ed5-9149f230e254 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Aug 30 17:55:24.731834 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2589/5431] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:24.733710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:24.983805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:24.995234 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df729c64-62f6-456c-bf00-fe9e7abe9844 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.285122 Aug 30 17:55:24.995860 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2843/5432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:24 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:25.233319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:25.234023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:25.246065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:25.246560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:25.246994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:25.247731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:25.248173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:25.260430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:25.861081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:25.877693 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b70ce2a7-d18c-483b-8aee-086bcea53113 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.648924 Aug 30 17:55:25.879801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2590/5433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:25 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:26.020890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:26.021920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:26.029363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:26.030037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:26.030707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:26.031658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:26.032204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:26.032692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:26.318655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:26.337581 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-985b5e7f-d1d5-4d38-b172-cd52d1306695 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.320852 Aug 30 17:55:26.339670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2844/5434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:26 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:26.901778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:26.902602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:26.913000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:26.916351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:26.917072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:26.920910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:26.921627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:26.922269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:27.360573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:27.366940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:27.367673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:27.383099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:27.384648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:27.385509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:27.386513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:27.387126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:27.392755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:27.420825 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e12e6da2-dfbe-4684-b378-014622f4bc8c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.524061 Aug 30 17:55:27.421445 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2591/5435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:26 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:27.669928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:27.678979 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1655161e-d4a2-4417-9622-f860b80ec6b5 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.320984 Aug 30 17:55:27.683804 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2845/5436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:27 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:28.408099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:28.408706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:28.427987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:28.433889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.441835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.442296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.443051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.443527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.443950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.458453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.465034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.489578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.538010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] Creating event network-changed:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:55:28.548397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:55:28.573696 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0a95403b-4fd3-40ea-816e-6c876c2d5ed7 req-668a9d65-c210-423f-ba73-058b86cd2b62 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148626 Aug 30 17:55:28.574379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2846/5437] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:28.585134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:28.588128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:28.603217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.603976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.604412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.605116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.605562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.605983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.738174 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92ff3dcf-3357-422c-a90c-a4a9683310bc tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 204 len: 0 microversion: 2.1 time: 0.334051 Aug 30 17:55:28.744537 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2592/5438] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:55:28 2022] DELETE /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:55:28.757807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:28.759630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:28.775869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.776377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.779007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.779782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.780245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.782830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.814284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:28.843508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba15b848-80e7-4f01-8f12-3d9f7eed40bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.266634 Aug 30 17:55:28.844427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2847/5439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:28 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:28.860672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:28.861557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:28.887608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.888428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.889068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:28.890264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:28.890918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:28.892046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:29.090933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:29.104347 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc77cc5c-7589-4e4a-9eef-14316c3e5766 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1582 microversion: 2.1 time: 0.258177 Aug 30 17:55:29.106188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2848/5440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:28 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1582 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:29.165852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:29.172423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db81bc28-c73a-4da8-a7fe-32d87dc82ad7", "name": "network-vif-plugged", "status": "completed", "tag": "a861f977-37c3-4f0b-83f0-8439b0f0baa6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:29.180979 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-054f232a-65c8-46c4-9515-1b36422b0896 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.434250 Aug 30 17:55:29.181717 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2593/5441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:28 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:29.204234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:29.205927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:29.206666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:29.221423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] Creating event network-vif-plugged:a861f977-37c3-4f0b-83f0-8439b0f0baa6 for instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 on n-h1-852771-11 Aug 30 17:55:29.227980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2e85861c-2d81-44e5-b34b-7402e03b8ae9 req-b9b31511-f189-4d25-86a8-2b642139c3a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059738 Aug 30 17:55:29.230223 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2849/5442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:29.865931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:29.866651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:29.878477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:29.881660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:29.882188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:29.882980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:29.884719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:29.885245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:30.061215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:30.128353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:30.128569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:30.129355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:30.149014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:30.149467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:30.149915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:30.150737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:30.153572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:30.154024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:30.223589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:30.245981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b29a5669-8071-47db-8e01-86b5ff8d5735 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.384050 Aug 30 17:55:30.260223 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2594/5443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:29 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:30.268957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:30.269667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:30.288608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:30.289598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:30.289977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:30.291219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:30.291926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:30.292917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:30.413855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:30.424251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:30.436989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18a9b284-caa7-43c9-b59b-dc12c347c71a tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1582 microversion: 2.1 time: 0.313199 Aug 30 17:55:30.438339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2850/5444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:30 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1582 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:30.695847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:30.704891 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3847760b-6af2-414b-979f-2134ed6401bc tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1373 microversion: 2.1 time: 0.440365 Aug 30 17:55:30.706284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2595/5445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:30 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1373 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:30.987971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c5304af-bee8-4f2b-a775-205a0398c591 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Action: 'create', calling method: .version_select at 0x7f2d934e7f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-268237023", "metadata": {"Type": "work"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:31.212964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd632ec-6836-4b94-8fff-8115f24bd2f9", "name": "network-vif-deleted", "tag": "b756d9c3-5a86-4478-8ba8-47fa38e7bc2f"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:31.224757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.225286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.225721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.239749 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] Creating event network-vif-deleted:b756d9c3-5a86-4478-8ba8-47fa38e7bc2f for instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 on n-h1-852771-11 Aug 30 17:55:31.245766 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-39fe7f61-311d-46c3-9e4b-0550d14fec83 req-da736a9a-04be-4bcb-83d5-1c1faad3be05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Aug 30 17:55:31.250075 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2596/5446] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:31.272134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:31.272902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:31.296360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.296930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.297466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.298426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.298850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.299358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.485843 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c5304af-bee8-4f2b-a775-205a0398c591 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.656582 Aug 30 17:55:31.494597 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2851/5447] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 17:55:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 666 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 17:55:31.500642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:31.501365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:31.514919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.515783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.516643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.519785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.520452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.522218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.543530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:31.559052 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9665b4e-ebbb-4d6a-a3d9-82949febcda1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.291238 Aug 30 17:55:31.562540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2597/5448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:31 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:31.570934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-294a1c46-b0fe-4fbd-8d63-69995f2d38a5 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d935dce50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:31.666565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-294a1c46-b0fe-4fbd-8d63-69995f2d38a5 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 352 microversion: 2.1 time: 0.102630 Aug 30 17:55:31.667210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2598/5449] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:31 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:31.705801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471adb65-8648-4c0d-bb3a-ad1454364f6b", "name": "network-vif-plugged", "status": "completed", "tag": "24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:31.721728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:31.738557 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5174d5db-18c6-4777-8ef2-73e04f34950b tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1228 microversion: 2.1 time: 0.237576 Aug 30 17:55:31.741736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.742463 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2852/5450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:31 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1228 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:31.748969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.753428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:31.754202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.763082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:31.775891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.776700 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] Creating event network-vif-plugged:24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb for instance 471adb65-8648-4c0d-bb3a-ad1454364f6b on n-h2-852771-11 Aug 30 17:55:31.781557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.782554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.784212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:31.788488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:31.789280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:31.789552 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1cb19aff-0136-40e1-b492-704d8a6957ba req-ec473372-4bc1-417d-a60c-42645c2b4b78 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087831 Aug 30 17:55:31.791564 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2599/5451] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:32.032000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:32.051323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-619e7f91-1d7b-4acf-80da-8f86f9ec6cb8 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1546 microversion: 2.1 time: 0.306535 Aug 30 17:55:32.056005 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2853/5452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:31 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:32.079065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:32.080185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:32.087678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.088589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.089212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.090091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.090701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.091299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.248339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:32.257289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14fccdad-e36c-4df3-80ba-1eb9c6854a18 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1546 microversion: 2.1 time: 0.183125 Aug 30 17:55:32.276511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2600/5453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:32 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:32.588947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:32.592368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:32.628135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.628629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.629065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.636299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.637526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.638141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.680446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9bed16ac-ac59-4f5b-bb31-c84210ef5f6f tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d936364c0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:32.764689 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9bed16ac-ac59-4f5b-bb31-c84210ef5f6f tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 352 microversion: 2.1 time: 0.088376 Aug 30 17:55:32.773769 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2601/5454] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:32 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:32.773769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:32.773769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:32.781587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.782091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.782532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.783242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:32.783741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:32.784169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:32.917723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:32.928721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3373962d-2438-4f79-9d0e-db2bb9c17b60 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1228 microversion: 2.1 time: 0.161805 Aug 30 17:55:32.943168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:32.943168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:32.944653 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2602/5455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:32 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:32.949511 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8f88ee3-785e-49f3-a305-f6bc0cb4ae80 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1368 microversion: 2.1 time: 0.366499 Aug 30 17:55:32.950103 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2854/5456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:32 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:33.781406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c780446-a6ed-4c94-a6e5-e7901df89ca5 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d938a70d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:33.848321 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c780446-a6ed-4c94-a6e5-e7901df89ca5 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 353 microversion: 2.1 time: 0.070783 Aug 30 17:55:33.848915 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2603/5457] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:33 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:33.863164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1739a279-a25b-4199-9ec8-fe102c73860b tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d934a20d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:33.936200 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1739a279-a25b-4199-9ec8-fe102c73860b tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 353 microversion: 2.1 time: 0.077569 Aug 30 17:55:33.937343 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2855/5458] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:33 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:33.950863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-59a6da86-e573-4a0f-8bac-6fd4a83e8ed7 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d9827cd30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:33.952909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:33.953860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:33.972494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:33.973267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:33.973936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:33.975904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:33.976727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:33.978298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:34.069205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:34.085015 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-59a6da86-e573-4a0f-8bac-6fd4a83e8ed7 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 202 len: 0 microversion: 2.1 time: 0.137976 Aug 30 17:55:34.085602 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2604/5459] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:55:33 2022] DELETE /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:55:34.099812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:34.106033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:34.106643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-138269af-4a7a-4617-9567-eae0c106cf5e tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1228 microversion: 2.1 time: 0.158539 Aug 30 17:55:34.124827 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2856/5460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:33 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:34.140371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b81fc9eb-7a04-401d-b84e-6ec8f10b273a tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d934ab550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:34.141620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:34.143274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:34.145433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:34.146520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:34.148579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:34.151815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:34.245401 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b81fc9eb-7a04-401d-b84e-6ec8f10b273a tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 352 microversion: 2.1 time: 0.117985 Aug 30 17:55:34.246821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2857/5461] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:34 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:34.613781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:34.631064 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6f68b62-c2c5-4352-aba8-2308454c7750 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1557 microversion: 2.1 time: 0.541275 Aug 30 17:55:34.632470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2605/5462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:34 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1557 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:34.654138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:34.654875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:34.663905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:34.665274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:34.666296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:34.667427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:34.668133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:34.668812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:34.773381 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13d74011-4276-4e3e-8577-a877f39da5a4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123974 Aug 30 17:55:34.779941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2858/5463] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:55:34 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:35.130831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:35.131417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:35.141806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:35.142292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:35.142728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:35.143434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:35.150004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:35.150469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:35.212722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db81bc28-c73a-4da8-a7fe-32d87dc82ad7", "tag": "a861f977-37c3-4f0b-83f0-8439b0f0baa6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:35.233691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:35.233849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:35.234598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:35.279496 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] Creating event network-changed:a861f977-37c3-4f0b-83f0-8439b0f0baa6 for instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 on n-h1-852771-11 Aug 30 17:55:35.288833 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2358df1d-1274-4249-950a-a5f64a89a7e3 req-b6860922-668f-40e4-bd98-bd5b4e06d45f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081552 Aug 30 17:55:35.292506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2859/5464] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:35.304667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-882f9e0c-f930-4074-bc33-2463fb9ba347 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d937bb670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:35.409502 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-882f9e0c-f930-4074-bc33-2463fb9ba347 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 352 microversion: 2.1 time: 0.115782 Aug 30 17:55:35.410268 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2860/5465] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:35 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:35.560491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:35.571130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7bafbd83-57c4-49fd-a7ad-479f2e0c3508 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1228 microversion: 2.1 time: 0.443982 Aug 30 17:55:35.589589 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2606/5466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:35 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1228 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:36.168713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471adb65-8648-4c0d-bb3a-ad1454364f6b", "tag": "24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:36.192766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:36.196464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:36.197227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:36.226125 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] Creating event network-changed:24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb for instance 471adb65-8648-4c0d-bb3a-ad1454364f6b on n-h2-852771-11 Aug 30 17:55:36.237197 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7ef72cbf-c92a-4517-9b5e-d5599d126631 req-4c09751d-aeca-468c-8626-68ed3a3ade81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073289 Aug 30 17:55:36.241008 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2861/5467] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:36.423903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d06923e1-51a2-40e1-8283-6989206777c0 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d9363d940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:36.531293 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d06923e1-51a2-40e1-8283-6989206777c0 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 200 len: 352 microversion: 2.1 time: 0.111382 Aug 30 17:55:36.531918 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2607/5468] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:36 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:36.597632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:36.598575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:36.611936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:36.612714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:36.613326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:36.614267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:36.614887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:36.615498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:36.805938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:36.818514 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c821bab8-fbec-405c-ad94-0992be17e9e5 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1228 microversion: 2.1 time: 0.225212 Aug 30 17:55:36.824535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2862/5469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:36 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:37.545961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb7fc1c6-31e7-4394-93a7-6245dd172ca9 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Calling method '.version_select at 0x7f2d935cf9d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:37.591928 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-fb7fc1c6-31e7-4394-93a7-6245dd172ca9 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] HTTP exception thrown: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb7fc1c6-31e7-4394-93a7-6245dd172ca9 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Request method failure captured: Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d HTTP/1.1 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk8STL6PDMhyqtZZbMhfu43Jw48lONP-vJh_z9ypSW8cXnnAd2lR3z5pb4clGoFu1kXgpOuIK4f5eux_5UsJZ9EHRkH4JjisZ-4gcPo1oJL2nBE1kGvqWOxa5GnpSsP4UUnhrHcshrgIaC_IVMvo7F-eCpxIklJpJ93Ysp1DpBLi5mg Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: de357edbdae44956bf852c0c55cb3036 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesGetTestJSON-1766304138 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de357edbdae44956bf852c0c55cb3036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de357edbdae44956bf852c0c55cb3036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de357edbdae44956bf852c0c55cb3036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de357edbdae44956bf852c0c55cb3036"}]}] Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesGetTestJSON-1766304138 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: de357edbdae44956bf852c0c55cb3036 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesGetTestJSON-1766304138 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesGetTestJSON-1766304138-project Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d7d4632fc6114a6fbfc28c936d95b061 Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesGetTestJSON-1766304138-project Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c0d0d615-3374-4fa8-9369-7bba0e369a6d'} Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. (HTTP 404) (Request-ID: req-014a8501-fbf8-4faa-bf69-c3be9360b24d) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:55:37.594431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fb7fc1c6-31e7-4394-93a7-6245dd172ca9 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] Returning 404 to user: Volume c0d0d615-3374-4fa8-9369-7bba0e369a6d could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fb7fc1c6-31e7-4394-93a7-6245dd172ca9 tempest-VolumesGetTestJSON-1766304138 tempest-VolumesGetTestJSON-1766304138-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d" status: 404 len: 109 microversion: 2.1 time: 0.054010 Aug 30 17:55:37.598468 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2608/5470] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:55:37 2022] GET /compute/v2.1/os-volumes/c0d0d615-3374-4fa8-9369-7bba0e369a6d => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:37.850455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:37.851052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:37.871083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:37.871601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:37.872049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:37.872766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:37.873222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:37.873838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:37.949561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:37.952229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:37.953107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:37.954843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lazy-loading 'fault' on Instance uuid ccd632ec-6836-4b94-8fff-8115f24bd2f9 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:55:37.995755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:37.996488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:38.009138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:38.010201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:38.011205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:38.012145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:38.012759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:38.014048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:38.025525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c5383d81046e19d480c3816a78171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed372f7bacf4af395d80a297448e18b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:38.035773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a720dabf-b3c6-49f2-bb2a-f86eb6e23c56 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 200 len: 1233 microversion: 2.1 time: 0.189372 Aug 30 17:55:38.036993 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2863/5471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:37 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 1233 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:38.155917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'services' on Instance uuid 3552c53e-ede4-42de-8009-69f055d6365a {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:55:38.282935 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd4f5547-036c-455b-b7ea-c66e8bb0d061 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments/e5f7d4de-511a-47a9-8e43-0d27bec17634" status: 202 len: 0 microversion: 2.1 time: 0.292304 Aug 30 17:55:38.286663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2609/5472] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:55:37 2022] DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments/e5f7d4de-511a-47a9-8e43-0d27bec17634 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:55:38.293362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:38.296024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:38.303462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:38.305793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:38.306855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:38.307825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:38.309087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:38.309842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:38.310558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:38.362467 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84f1c3af-d339-44c8-83f7-c28de79492e6 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073884 Aug 30 17:55:38.363731 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2864/5473] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:38 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:39.062614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.063460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] [instance: ccd632ec-6836-4b94-8fff-8115f24bd2f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:39.071049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.071922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.072468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.073354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.073918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.074567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.090672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] HTTP exception thrown: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Request method failure captured: Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 HTTP/1.1 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk4IAWoeDaAkmw9DlkBx_YRIWlsXHEmyesCiwiPJpSeN4z9hu-d-21eU4oSMnLMD0EQz_RS64GBbDSNbTl8THMKwvxuC97mJac1mbcYIrX9AmkCRMbVpkCizoQ82nkkgFahHpu7EqIUC8C1MLTfA283U6QvaAWm6J5hmb7u-UV6FH_w Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: aed372f7bacf4af395d80a297448e18b Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBackupRestore-65698172 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aed372f7bacf4af395d80a297448e18b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aed372f7bacf4af395d80a297448e18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aed372f7bacf4af395d80a297448e18b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aed372f7bacf4af395d80a297448e18b"}]}] Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBackupRestore-65698172 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: aed372f7bacf4af395d80a297448e18b Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBackupRestore-65698172 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBackupRestore-65698172-project Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 5e0c5383d81046e19d480c3816a78171 Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBackupRestore-65698172-project Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ccd632ec-6836-4b94-8fff-8115f24bd2f9'} Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:39.094713 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Returning 404 to user: Instance ccd632ec-6836-4b94-8fff-8115f24bd2f9 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36ebcd34-6063-4ff4-a80c-7d88db0d17fa tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9" status: 404 len: 111 microversion: 2.1 time: 0.036148 Aug 30 17:55:39.099622 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2610/5474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:39 2022] GET /compute/v2.1/servers/ccd632ec-6836-4b94-8fff-8115f24bd2f9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:39.245152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.245712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:39.255173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.256020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.256586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.257950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.259042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.259751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.291428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b94cbb8e-e049-45ab-9024-ac57d1479ae2 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] Calling method '.version_select at 0x7f2d93630790>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.326673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c49f7a1-9383-47ee-87f1-b38f953173d0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments/f934a130-8d11-4237-a2e6-1dcd2f3a2072" status: 200 len: 194 microversion: 2.20 time: 0.088454 Aug 30 17:55:39.334377 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2865/5475] 10.222.0.50 () {60 vars in 1454 bytes} [Tue Aug 30 17:55:39 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments/f934a130-8d11-4237-a2e6-1dcd2f3a2072 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:39.338274 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b94cbb8e-e049-45ab-9024-ac57d1479ae2 tempest-TestVolumeBackupRestore-65698172 tempest-TestVolumeBackupRestore-65698172-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-467431029" status: 202 len: 0 microversion: 2.1 time: 0.052446 Aug 30 17:55:39.339130 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2611/5476] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 30 17:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-467431029 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:55:39.377612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.381795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:39.403048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.405193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.407923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.408857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.409481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.410071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.416459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.418462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:39.421851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:39.433619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.434114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.434569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.435275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.436060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.436435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.442425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:39.454475 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e60fc1de-efa1-4651-a9a0-3428c976a2d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083314 Aug 30 17:55:39.455591 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2866/5477] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:39 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:39.573539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lazy-loading 'services' on Instance uuid c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:55:39.694331 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfbe08d6-3e8a-4970-8408-b0ec3ac2b303 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments/f934a130-8d11-4237-a2e6-1dcd2f3a2072" status: 202 len: 0 microversion: 2.20 time: 0.285077 Aug 30 17:55:39.694948 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2612/5478] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 30 17:55:39 2022] DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments/f934a130-8d11-4237-a2e6-1dcd2f3a2072 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:55:39.705729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:39.708493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:39.716137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.717116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.717795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.718826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:39.721054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:39.721871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:39.789115 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f995b55-08e2-458d-9b9a-d046993d74c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088346 Aug 30 17:55:39.795291 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2867/5479] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:39 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:40.470694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:40.480883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:40.493559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:40.494058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:40.494553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:40.495340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:40.495847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:40.496283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:40.574929 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4045ef95-5086-4b7c-aa99-3ce1b02d8a5c tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111473 Aug 30 17:55:40.576142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2613/5480] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:40 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:40.805624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:40.808967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:40.817992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:40.818966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:40.819941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:40.821286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:40.822119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:40.823009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:40.869544 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66bfc1c9-1d34-4ba8-af7b-ee0c66c323c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068300 Aug 30 17:55:40.870624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2868/5481] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:40 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:41.588443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:41.591256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:41.599771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:41.600267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:41.601006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:41.602635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:41.603294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:41.604165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:41.650041 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ecf8435-35d8-4113-9ed0-2596a2cca982 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065896 Aug 30 17:55:41.654699 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2614/5482] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:41 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:41.884367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:41.887455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:41.896981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:41.897467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:41.897901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:41.899209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:41.899712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:41.900349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:41.940137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2bd9fc19-14cc-488e-8623-f52b0813744b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061768 Aug 30 17:55:41.940614 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2869/5483] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:41 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:42.662792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:42.665958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:42.676346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:42.676992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:42.677484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:42.678656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:42.679267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:42.679791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:42.719562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-42b2f9fc-ef8d-4c24-9d14-7ee4d79e1058 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061596 Aug 30 17:55:42.720635 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2615/5484] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:42 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:42.953064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:42.955447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:42.966751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:42.967383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:42.967712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:42.968969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:42.969426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:42.970083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:43.009568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6c7d3ec1-db1b-4c4f-9ed6-4cff504a643c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060624 Aug 30 17:55:43.010634 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2870/5485] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:42 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:43.734039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:43.737653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:43.745071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:43.745871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:43.746592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:43.748084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:43.748710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:43.749152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:43.787782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d7caa40-6d33-441e-8104-89f6278474ca tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057437 Aug 30 17:55:43.793277 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2616/5486] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:43 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:44.022186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:44.025561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:44.033086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.033833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.034512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.035287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.036022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.036516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.071857 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f22ca430-ce43-4a54-ae17-daa5375b36d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053722 Aug 30 17:55:44.079644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2871/5487] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:44 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:44.800354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:44.803320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:44.811016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.811642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.812331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.813986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.814662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.815345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.848404 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76d1304b-ba4a-4075-9223-ac37c0599f76 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051965 Aug 30 17:55:44.849123 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2617/5488] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:55:44 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:55:44.934298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:44.936814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:44.942926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.943646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.944275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.944991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:44.945517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:44.945953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:44.973412 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Cannot 'reboot' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action HTTP/1.1 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 28 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: {"reboot": {"type": "HARD"}} Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: exception: Cannot 'reboot' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2367f7f9-2633-4030-ab63-74a0a255411e', 'body': {'reboot': {'type': 'HARD'}}} Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2367f7f9-2633-4030-ab63-74a0a255411e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:55:44.975502 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 409 to user: Cannot 'reboot' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e15c858-d5f4-4d12-add4-a754e43ff7d0 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action" status: 409 len: 145 microversion: 2.1 time: 0.047360 Aug 30 17:55:44.981733 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2872/5489] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:55:44 2022] POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action => generated 145 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:55:44.989754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:44.994113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:45.001015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.001502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.001961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.002658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.003103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.003853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.032212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Cannot 'rebuild' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action HTTP/1.1 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 65 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: exception: Cannot 'rebuild' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2367f7f9-2633-4030-ab63-74a0a255411e', 'body': {'rebuild': {'imageRef': '565db0f0-616b-43a3-8762-95a8e129a515'}}} Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2367f7f9-2633-4030-ab63-74a0a255411e in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:55:45.034037 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 409 to user: Cannot 'rebuild' instance 2367f7f9-2633-4030-ab63-74a0a255411e while it is in vm_state rescued {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fead5192-36e4-4477-816d-0222fcad8f64 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action" status: 409 len: 146 microversion: 2.1 time: 0.050201 Aug 30 17:55:45.038049 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2618/5490] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:55:44 2022] POST /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e/action => generated 146 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:55:45.046567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:45.047299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:45.054921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.055417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.055878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.056797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.057511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.057987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.084581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:45.088628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:45.093685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:55:45.098875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.099590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.099946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.100735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.101249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.101903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.142103 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be06baa8-11b6-47ef-ba02-6f2f45e08ad9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061263 Aug 30 17:55:45.146555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2619/5491] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:45 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:55:45.199109 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb40c1eb-ec13-4b3b-9125-bc1d9f68c9c1 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 204 len: 0 microversion: 2.1 time: 0.156410 Aug 30 17:55:45.200076 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2873/5492] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:55:45 2022] DELETE /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:55:45.208318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:45.209260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:45.216459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.217151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.218115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.219638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:45.220517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:45.221323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:45.677674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:45.688472 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-443d8074-55fa-46ab-8e21-94584ae5351d tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1689 microversion: 2.1 time: 0.484334 Aug 30 17:55:45.689966 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2620/5493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:45 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1689 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:46.155986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:46.159415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:46.168833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:46.169539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:46.169969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:46.171021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:46.173589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:46.174233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:46.208077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:46.222446 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81061113-18f3-4288-a140-7d590c94a18c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071728 Aug 30 17:55:46.223257 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2874/5494] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:46 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:55:46.713294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:46.714797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:46.722562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:46.723045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:46.723596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:46.724176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:46.724648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:46.725065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:46.875986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:46.887218 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86787106-d880-4c0d-b059-31bb64c6d4ed tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1689 microversion: 2.1 time: 0.178655 Aug 30 17:55:46.887903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2621/5495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:46 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:47.234982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:47.237205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:47.246036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:47.246526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:47.246964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:47.247709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:47.248813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:47.249249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:47.573996 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0be66cc6-3bc4-4aa2-b467-a3f9d78a5c51 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.343298 Aug 30 17:55:47.578982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2875/5496] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:47 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:47.908664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:47.909282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:47.916549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:47.917041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:47.917479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:47.918388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:47.918852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:47.919283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:48.075629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:48.086071 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d86e649-9e1e-49e9-8314-abe9e12ffe27 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1689 microversion: 2.1 time: 0.180791 Aug 30 17:55:48.087605 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2622/5497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:47 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:48.589192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:48.592976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:48.605150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:48.606201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:48.606954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:48.607927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:48.608560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:48.609391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:48.656585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fd3f433-43e9-44dd-8e9b-aec9fd68934d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073200 Aug 30 17:55:48.658020 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2876/5498] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:48 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:49.113498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:49.114112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:49.122001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:49.122500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:49.122971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:49.126196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:49.128027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:49.128607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:49.249226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:49.269250 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d81920f1-bb9b-4242-b037-2ae993f375f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1622 microversion: 2.1 time: 0.148381 Aug 30 17:55:49.269947 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2623/5499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:49 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:55:49.502157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3552c53e-ede4-42de-8009-69f055d6365a", "name": "network-vif-deleted", "tag": "ce75ab24-aec1-4697-b9e5-e6be1f60036f"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:49.542776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:49.545895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:49.548127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:49.632968 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] Creating event network-vif-deleted:ce75ab24-aec1-4697-b9e5-e6be1f60036f for instance 3552c53e-ede4-42de-8009-69f055d6365a on n-h2-852771-11 Aug 30 17:55:49.669837 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d798e0bc-d317-40e6-8165-8b5c51307338 req-18d3ceec-4392-4646-9185-c59f946b56b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175374 Aug 30 17:55:49.670868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2877/5500] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:55:49.675408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:49.678020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:49.692178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:49.693182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:49.695243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:49.697431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:49.699452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:49.700010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:49.770599 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f8d44927-dc00-448a-a974-043a9342d068 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104106 Aug 30 17:55:49.771855 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2624/5501] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:49 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:50.294361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:50.295376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:50.317038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:50.318687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:50.319413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:50.320534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:50.321672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:50.322425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:50.406589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:50.408079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:50.408862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:50.409693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'fault' on Instance uuid 3552c53e-ede4-42de-8009-69f055d6365a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:55:50.720782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:50.734579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-122abffa-471e-44df-a65c-983f7e6ada62 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 200 len: 1334 microversion: 2.1 time: 0.446780 Aug 30 17:55:50.735533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2878/5502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:50 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 1334 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:50.807828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:50.814437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:50.839889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:50.840725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:50.841334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:50.842236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:50.842857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:50.848283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:50.905510 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf99e0c6-1a5f-49ff-ad49-9376095130d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123820 Aug 30 17:55:50.906741 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2625/5503] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:50 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:51.755929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:51.757127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 3552c53e-ede4-42de-8009-69f055d6365a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:51.778891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:51.782233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:51.783100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:51.784067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:51.784542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:51.785150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:51.805415 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a HTTP/1.1 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '3552c53e-ede4-42de-8009-69f055d6365a'} Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:51.807969 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 404 to user: Instance 3552c53e-ede4-42de-8009-69f055d6365a could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:51.812675 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a5b9bc1-2312-4bcf-b6d4-aa2f198bf07b tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a" status: 404 len: 111 microversion: 2.1 time: 0.058017 Aug 30 17:55:51.822461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-72b3e29d-77a1-4da8-8de3-1d7c2d0018b5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '.version_select at 0x7f2d9827c670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:51.831569 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2879/5504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:55:51 2022] GET /compute/v2.1/servers/3552c53e-ede4-42de-8009-69f055d6365a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:55:51.873380 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-72b3e29d-77a1-4da8-8de3-1d7c2d0018b5 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145691730" status: 202 len: 0 microversion: 2.1 time: 0.052372 Aug 30 17:55:51.873380 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2626/5505] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145691730 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:55:51.920080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:51.922485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:51.936408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:51.936408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:51.936408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:51.944167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:51.946720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:51.949521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:52.046047 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52495c72-e677-415b-bb67-84011c889485 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.128103 Aug 30 17:55:52.046870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2880/5506] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:55:51 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:55:52.173119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:52.173684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:52.184883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:52.185378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:52.185814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:52.186508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:52.192073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:52.192718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:52.254597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:55:52.335710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:55:52.381018 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-13a51c11-ebcc-4ef6-9aae-04e79ee50280 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 204 len: 0 microversion: 2.20 time: 0.211168 Aug 30 17:55:52.382019 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2627/5507] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:55:52 2022] DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:55:52.390259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:52.390970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:52.402651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:52.403155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:52.403632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:52.404349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:52.404808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:52.405238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:52.644028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:52.654507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:52.656756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:52.658183 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2177c381-ec01-4d0b-8548-38417af662d6 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.272136 Aug 30 17:55:52.659456 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2881/5508] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:52 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:55:53.684878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:53.686449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:53.693754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:53.694484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:53.696132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:53.697030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:53.697665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:53.698295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:53.866089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:53.902707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:53.904316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:53.905548 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-710d84f3-1b79-4890-a519-d618a8d734e2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1723 microversion: 2.20 time: 0.227359 Aug 30 17:55:53.906120 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2628/5509] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:53 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:54.932631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:54.933308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:54.950160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:54.954620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:54.955630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:54.957170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:54.957829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:54.958680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:55.201627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:55.219851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:55.224943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:55:55.230058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb1b17cd-e4fb-4971-bc55-ab4f70d8746c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 200 len: 1655 microversion: 2.20 time: 0.302430 Aug 30 17:55:55.239554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2882/5510] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:54 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 1655 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:55:55.614795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0", "name": "network-vif-deleted", "tag": "e2e8fc39-96b6-4111-8e51-a10bec91ea76"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:55.643316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:55.644634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:55.646597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:55.678443 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] Creating event network-vif-deleted:e2e8fc39-96b6-4111-8e51-a10bec91ea76 for instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 on n-h2-852771-11 Aug 30 17:55:55.691775 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ab57d810-41b9-4d27-89c4-a4151928b652 req-a47d31cb-1e56-44a1-b17b-9d27deaec689 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076535 Aug 30 17:55:55.699604 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2629/5511] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:55:56.027141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:56.029555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:56.046015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:56.046521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:56.046966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:56.047735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:56.048201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:56.048631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:56.164765 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ce15285-d4f2-4382-a224-ea6027f334ef tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7/action" status: 200 len: 24579 microversion: 2.1 time: 0.141024 Aug 30 17:55:56.165718 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2883/5512] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:55:56 2022] POST /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7/action => generated 24579 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:55:56.261846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:56.262557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:55:56.274626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:56.275124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:56.275579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:56.276784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:55:56.277242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:55:56.277666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:55:56.309512 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 HTTP/1.1 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0'} Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:56.314478 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:55:56.319161 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:55:56.321633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:55:56.325350 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3233a891-091f-489e-9b4c-6d757de30ba0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 404 len: 111 microversion: 2.20 time: 0.068779 Aug 30 17:55:56.326122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2630/5513] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:55:56 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:55:56.335282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1419a7a5-ee8e-4401-9350-6504a80d629a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '.version_select at 0x7f2d934c5820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:55:56.363952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1419a7a5-ee8e-4401-9350-6504a80d629a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970536495" status: 204 len: 0 microversion: 2.20 time: 0.032906 Aug 30 17:55:56.364615 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2884/5514] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 30 17:55:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970536495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:55:57.598173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-718a170c-8762-4d18-8514-2307b2666a64 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: .version_select at 0x7f2d93630e50>, body: {"keypair": {"name": "tempest-keypair-1014801184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgChHLvwapibmw3F9cB5bjSkPpuoKLN+eHNpHWHvRugiZc88raajvLViFRPSybWk+qnxyOTiapGbtuAL2eFHKkgCFdRYnyFn3RiY7jIDuiHdFX16yiacn91sWSdJB7Zng=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:55:57.643758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-718a170c-8762-4d18-8514-2307b2666a64 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:55:57.662787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-718a170c-8762-4d18-8514-2307b2666a64 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for user dff3e8a1712d4dc5a7b96ddf7bae30f5 and project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:55:57.743918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-718a170c-8762-4d18-8514-2307b2666a64 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.144117 Aug 30 17:55:57.745068 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2631/5515] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 17:55:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 17:56:00.553379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-840899801", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0487c3d-dbba-4112-b26b-4eb945dd9893"}], "security_groups": [{"name": "tempest-securitygroup--1644202914"}], "key_name": "tempest-keypair-1014801184", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:00.751371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] validate_networks() for [('a0487c3d-dbba-4112-b26b-4eb945dd9893', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:56:01.486699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:56:01.487254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:56:01.487879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:56:01.488394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:56:01.488912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:56:01.502585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:01.503227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:01.503825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:01.504660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:01.505213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:01.505900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:01.527524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:56:01.535949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Getting quotas for user dff3e8a1712d4dc5a7b96ddf7bae30f5 and project 2a368ff1b3394dc3934a4b13ae62fc66. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:56:01.556191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:56:01.559082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:56:01.702900 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-57c9bb10-e2df-4137-b222-4674c07c598a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.155409 Aug 30 17:56:01.704367 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2885/5516] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 17:56:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 17:56:01.715863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:01.716715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:02.047302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:02.064220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:02.067590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:02.068737 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9043a828-120d-453f-9d37-52733631fc63 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1281 microversion: 2.20 time: 0.357028 Aug 30 17:56:02.079522 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2632/5517] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:01 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:02.696098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:02.698609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:02.710484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:02.714155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:02.714711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:02.717668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:02.718257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:02.718916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:02.815471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4e14c96e-133e-4a2f-ac5e-94713e2a964a tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "POST /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7/action" status: 200 len: 32649 microversion: 2.1 time: 0.126253 Aug 30 17:56:02.816619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2886/5518] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 17:56:02 2022] POST /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7/action => generated 32649 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:56:03.104538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:03.105274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:03.141600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:03.148155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:03.150153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:03.152308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:03.153616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:03.154595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:03.566942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:03.581762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:03.603683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:03.603683 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8049034e-246c-43b6-92ce-14ee25120a66 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1277 microversion: 2.20 time: 0.505612 Aug 30 17:56:03.610404 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2633/5519] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:03 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1277 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:04.637046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:04.637862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:04.661065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:04.662996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:04.666196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:04.666996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:04.669603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:04.670221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:04.834287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:04.852848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:04.855530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:04.857519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-19c82e14-9b73-450f-8807-95f5da4ededc tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1339 microversion: 2.20 time: 0.226428 Aug 30 17:56:04.876678 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2887/5520] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:04 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:05.882409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:05.883836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:05.903430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:05.904804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:05.905488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:05.906428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:05.907096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:05.907761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:06.061029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:06.075724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:06.077980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:06.094552 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-416d5a3a-b0be-411b-9009-515e5a02c639 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1339 microversion: 2.20 time: 0.216521 Aug 30 17:56:06.096562 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2634/5521] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:05 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:06.542792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:06.543326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:06.550700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:06.552478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:06.553122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:06.554600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:06.555225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:06.555922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:06.633322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:56:06.761149 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05ce85f5-8eb8-4bc0-b3f9-be4ac35c5126 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 204 len: 0 microversion: 2.1 time: 0.222624 Aug 30 17:56:06.762581 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2888/5522] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:56:06 2022] DELETE /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:56:06.769987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:06.770611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:06.779765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:06.780261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:06.780703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:06.781420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:06.781893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:06.782326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.120652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:07.121761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:07.138853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.139468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.139985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.140728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.141199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.141638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.454386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:07.468091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:07.470251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:07.471750 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93a2de3e-f8f6-4e57-959b-4f1167dccd9b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.356911 Aug 30 17:56:07.472842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2889/5523] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:07 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:56:07.479257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:07.480099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:07.488494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.489193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.489791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.490688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.491728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.492339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.544317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:56:07.660617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:07.672864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c271d2c9-b4fc-4c51-996e-524a7520eac9 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1509 microversion: 2.1 time: 0.906746 Aug 30 17:56:07.677169 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2635/5524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:06 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1509 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:07.695366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db81bc28-c73a-4da8-a7fe-32d87dc82ad7", "tag": "a861f977-37c3-4f0b-83f0-8439b0f0baa6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:07.712365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.715241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.717797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.742821 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] Creating event network-changed:a861f977-37c3-4f0b-83f0-8439b0f0baa6 for instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 on n-h1-852771-11 Aug 30 17:56:07.780081 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-42648480-cee4-45f1-b31c-17c5b03e4ba2 req-7cdc3532-def3-4610-ad1f-13c8cfc2384f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101295 Aug 30 17:56:07.780491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-251f80d6-8455-44ad-a6e7-d6c7093b2500 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 204 len: 0 microversion: 2.1 time: 0.306084 Aug 30 17:56:07.781321 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2636/5525] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:07.783650 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2890/5526] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:56:07 2022] DELETE /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:56:07.798302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:07.799112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:07.836601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.840082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.855347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:07.856379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:07.856997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:07.857581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:08.415726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:08.427415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a91a73c2-1e5f-4dfd-bdb1-c04b991bcb14 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1671 microversion: 2.1 time: 0.637625 Aug 30 17:56:08.429804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2637/5527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:07 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1671 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:08.505054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:08.517616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:08.540397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:08.543278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:08.545841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:08.546907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:08.547079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:08.547535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:08.547980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:08.590834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:08.706631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:08.709028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:08.735119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:08.735855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:08.737475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:08.738754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:08.752124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:08.753419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:08.816152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:08.843692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:08.846003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:08.848561 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5dce666-5b5f-4dbd-96b1-b313410bf1f0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.351849 Aug 30 17:56:08.850290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2891/5528] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:08 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:09.454219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:09.454850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:09.463176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:09.463953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:09.464588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:09.465471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:09.466090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:09.466683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:09.614625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:09.628016 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e410ab6-c998-4462-8e6c-b90693cb8d17 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1509 microversion: 2.1 time: 0.931339 Aug 30 17:56:09.628968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2638/5529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:08 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1509 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:09.710897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef9389b8d4154adc7c88f552995c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3d6fa6581c450498bb5342679ba56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:09.727018 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2a6d426-4ea7-4657-940b-27777ebb8067 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 200 len: 1671 microversion: 2.1 time: 0.276546 Aug 30 17:56:09.735571 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2892/5530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:09 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:56:09.786486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db81bc28-c73a-4da8-a7fe-32d87dc82ad7", "name": "network-vif-deleted", "tag": "a861f977-37c3-4f0b-83f0-8439b0f0baa6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:09.798534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:09.800885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:09.801578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:09.802192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:09.817259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] Creating event network-vif-deleted:a861f977-37c3-4f0b-83f0-8439b0f0baa6 for instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 on n-h1-852771-11 Aug 30 17:56:09.824586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-dd0c7024-ba82-4e16-b73f-880fef978a4c req-59bdfbcb-28c1-4d01-b220-55cadce98c88 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042186 Aug 30 17:56:09.825838 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2639/5531] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:09.874799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:09.875421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:09.882939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:09.883432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:09.883901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:09.884674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:09.885125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:09.885548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.095226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:10.105742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:10.107249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:10.108700 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d54e09ae-d8d9-4f85-9db4-4f946eb73a6c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.238269 Aug 30 17:56:10.109287 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2893/5532] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:09 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:10.659579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:10.660291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:10.677663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:10.678153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:10.678764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.679347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:10.683504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:10.683964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.754505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:10.761487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] [instance: db81bc28-c73a-4da8-a7fe-32d87dc82ad7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:10.775777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:10.776650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:10.777435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.778459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:10.779364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:10.779981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.813398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] HTTP exception thrown: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Request method failure captured: Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 HTTP/1.1 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5Lmh2eFol9LoKl2l0kkHtl9JuLCebNeuO4hGMbbiWFXuGzp43VSvJ3Cs28Ogejj1Yr_AFo23jwRhw1GYSW7Ry897sY7Z6QeYigXvp86FwCZ5yhdtZOcvMDFU6E3Otlw7US75HVixOX4dMVHV8EfeV-OF7oMu6D7tKIsf3o6ziNYpQ Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fd3d6fa6581c450498bb5342679ba56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fd3d6fa6581c450498bb5342679ba56e"}]}] Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkBasicOps-839230252 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: fd3d6fa6581c450498bb5342679ba56e Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkBasicOps-839230252 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: ac8ef9389b8d4154adc7c88f552995c4 Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkBasicOps-839230252-project Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'db81bc28-c73a-4da8-a7fe-32d87dc82ad7'} Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:10.815449 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. Aug 30 17:56:10.820085 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:10.822024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Returning 404 to user: Instance db81bc28-c73a-4da8-a7fe-32d87dc82ad7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:10.823402 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a777b99-28ec-490e-8c36-6cdc6e0b526c tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7" status: 404 len: 111 microversion: 2.1 time: 0.074537 Aug 30 17:56:10.824599 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2894/5533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:10 2022] GET /compute/v2.1/servers/db81bc28-c73a-4da8-a7fe-32d87dc82ad7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:56:10.847691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:10.870374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:10.873965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:10.875594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:10.903294 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] Creating event network-changed:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:56:10.911680 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6b99a3a8-3450-435f-ae56-e6d3fddc1b6f req-e7459973-675f-4b85-b81b-6ae902b54bd8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085270 Aug 30 17:56:10.912598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2895/5534] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:11.085046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be2136e6-3e87-452d-ab1e-9a8bcd8411f6 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] Calling method '.version_select at 0x7f2d9349c280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:11.166447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be2136e6-3e87-452d-ab1e-9a8bcd8411f6 tempest-TestNetworkBasicOps-839230252 tempest-TestNetworkBasicOps-839230252-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1924820723" status: 202 len: 0 microversion: 2.1 time: 0.086713 Aug 30 17:56:11.167644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2896/5535] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 17:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1924820723 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:56:11.174056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:11.179506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:11.190247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:11.190914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:11.192067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:11.193091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:11.197690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:11.198739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:11.453918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:11.471547 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab5ba884-9405-4abc-8403-ccea0421c852 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1509 microversion: 2.1 time: 0.817942 Aug 30 17:56:11.472229 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2640/5536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:10 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1509 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:11.517912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:11.548508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:11.586624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:11.598229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:11.603140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:11.605614 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06b3af58-be78-426f-97ae-668d27136beb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.436931 Aug 30 17:56:11.606195 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2897/5537] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:11 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:12.027501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:12.029101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:12.045344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.045846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.050158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.051107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.052696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.052982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.059979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:12.112676 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d1eb97f-b61c-4f9f-8a8c-7879ed32131a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/ips" status: 200 len: 148 microversion: 2.1 time: 0.090641 Aug 30 17:56:12.119415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2641/5538] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:56:12 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/ips => generated 148 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:12.496239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:12.497658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:12.517833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.520112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.521358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.524558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.527405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.528384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.629150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:12.629763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:12.648673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.649201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.649641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.650356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.668270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.668968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.704258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:12.706666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:12.710628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:12.712728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lazy-loading 'fault' on Instance uuid 2367f7f9-2633-4030-ab63-74a0a255411e {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:56:12.820022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:12.832712 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16ea062d-bf8f-456a-b86f-740ad01c476a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 200 len: 1312 microversion: 2.1 time: 0.343121 Aug 30 17:56:12.847772 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2898/5539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:12 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:12.976297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2367f7f9-2633-4030-ab63-74a0a255411e", "name": "network-vif-deleted", "tag": "c6ed2315-fd5e-4fb0-920c-44c6b15f1805"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:13.002815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:13.009163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:13.018845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:13.019743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:13.022967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:13.029365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:13.030973 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e1b47930-bc08-4895-8ec0-97c2e56cf0a5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.406653 Aug 30 17:56:13.032774 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2642/5540] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:12 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:56:13.043630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] Creating event network-vif-deleted:c6ed2315-fd5e-4fb0-920c-44c6b15f1805 for instance 2367f7f9-2633-4030-ab63-74a0a255411e on n-h2-852771-11 Aug 30 17:56:13.053157 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8b23951b-d265-406e-864e-2f2923c49a68 req-be93dc3c-2188-4d79-a161-678669e040ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078678 Aug 30 17:56:13.054091 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2899/5541] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:56:13.861253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:13.862019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 2367f7f9-2633-4030-ab63-74a0a255411e] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:13.873440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:13.877700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:13.878318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:13.880045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:13.887847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:13.888474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:13.927596 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e HTTP/1.1 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '2367f7f9-2633-4030-ab63-74a0a255411e'} Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:13.931260 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 404 to user: Instance 2367f7f9-2633-4030-ab63-74a0a255411e could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:13.937334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a521792f-3fb6-45f6-b3c7-4935c2e38d9a tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e" status: 404 len: 111 microversion: 2.1 time: 0.085951 Aug 30 17:56:13.939612 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2643/5542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:13 2022] GET /compute/v2.1/servers/2367f7f9-2633-4030-ab63-74a0a255411e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:13.950374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:13.952003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:13.959316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:13.961062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:13.962231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:13.963212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:13.963958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:13.964884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:14.016813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:56:14.057899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:14.058886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:14.078268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:14.085196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:14.085730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:14.086636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:14.087108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:14.087561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:14.293980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91288bda-942f-4355-8d86-302dcb8ce337 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "DELETE /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 204 len: 0 microversion: 2.1 time: 0.352153 Aug 30 17:56:14.299286 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2900/5543] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:56:13 2022] DELETE /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:56:14.310105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:14.310822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:14.322518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:14.323027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:14.329210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:14.330525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:14.331389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:14.339100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:14.738124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:14.758819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:14.763133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:14.765381 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ade9726-f57c-4ab3-961b-9a3935bb3a3d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.711995 Aug 30 17:56:14.766259 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2644/5544] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:14 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:14.824708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:14.837542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-63139dfd-19c7-47ad-91f2-62f1a3377814 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.533694 Aug 30 17:56:14.839383 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2901/5545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:14 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:15.201695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11c8f925-dcf6-4954-9641-516e1cc1b03f"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:15.204455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:15.221115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:15.221660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:15.222556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:15.224401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:15.225078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:15.248873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:15.795898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:15.797034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:15.813442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:15.814218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:15.815257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:15.816817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:15.817503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:15.818870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:16.190853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:16.214768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:16.229196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:16.231261 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-372773b3-b14a-48f8-85a8-54b299284d98 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.444023 Aug 30 17:56:16.238304 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2902/5546] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:15 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:16.247064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:16.248107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:16.258134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:16.258778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:16.259347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:16.260376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:16.260944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:16.261785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:16.504841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:16.522888 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fef92358-fa73-457c-ae3a-b465d575f4f4 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.278257 Aug 30 17:56:16.524220 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2903/5547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:16 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:17.259230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:17.260097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:17.286791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:17.287333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:17.295381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:17.296771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:17.298973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:17.302494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:17.542647 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5094cd3a-a4bc-4ebf-82cc-6bfc76cbeda4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.343919 Aug 30 17:56:17.544422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2645/5548] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:56:15 2022] POST /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 194 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:17.556923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:17.557646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:17.589264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:17.589769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:17.590206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:17.592152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:17.604349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:17.604890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:17.749004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:17.764323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:17.766325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:17.771135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09cdaf5e-84da-4af3-b9c0-a37df426de90 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.516689 Aug 30 17:56:17.773002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2904/5549] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:17 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:18.147743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:18.160344 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21060e18-09a4-4fb6-8158-c4d3028bdc42 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1519 microversion: 2.1 time: 0.613392 Aug 30 17:56:18.163567 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2646/5550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:17 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1519 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:18.797723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:18.798291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:18.815805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:18.816310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:18.816768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:18.817442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:18.817890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:18.818319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:19.185616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:19.186464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:19.199052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:19.200453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:19.202112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:19.203089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:19.203930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:19.204711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:19.425025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:19.444757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:19.446556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:19.448294 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f5e8548-9005-44fb-9c40-594aa916eec4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.657189 Aug 30 17:56:19.449436 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2905/5551] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:18 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:19.489890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643142ee7f7e4128a4344fb4cad92b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184fc5cac74143e3aac59d817ea26afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:19.513835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-620ff8d4-69a5-4260-8b33-5c7ad259d834 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 200 len: 1477 microversion: 2.1 time: 0.333306 Aug 30 17:56:19.517457 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2647/5552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:19 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:19.634409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48313007-4ae9-453a-89c4-3d27094a8617", "name": "network-vif-deleted", "tag": "59b98d90-3c36-4e1a-9f3d-666368fbc8af"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:19.651335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:19.651840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:19.652490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:19.683744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] Creating event network-vif-deleted:59b98d90-3c36-4e1a-9f3d-666368fbc8af for instance 48313007-4ae9-453a-89c4-3d27094a8617 on n-h2-852771-11 Aug 30 17:56:19.691448 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1cb51f92-bb96-4b78-a531-8b2260d94516 req-d47e95af-73cc-4e1a-b0ce-8dfcf11f4af5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061754 Aug 30 17:56:19.692485 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2906/5553] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:20.474869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:20.476122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:20.511988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:20.512635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:20.513292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:20.518791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:20.519221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:20.519708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:20.557103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:20.559948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] [instance: 48313007-4ae9-453a-89c4-3d27094a8617] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:20.581668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:20.584755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:20.585211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:20.586165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:20.586858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:20.587505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:20.638722 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] HTTP exception thrown: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Request method failure captured: Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 HTTP/1.1 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk4fTqh0kDFuVrDIVa9ZVtdTJF9D3_L9OSODZB3TFZePAdFnKAuteLHae7hmWgvJBWIJBA4ktEPJKroNi3nHMocuiQr38-W8itx_59MWFdyMk-p2pu5migxabFCDGxTUt-K8ST_sd4DF-esUpvp45wlBlklsE4TdnA_k5Eeo0oLdids Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/184fc5cac74143e3aac59d817ea26afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_184fc5cac74143e3aac59d817ea26afc"}]}] Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 184fc5cac74143e3aac59d817ea26afc Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780635569 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 643142ee7f7e4128a4344fb4cad92b29 Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780635569-project Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '48313007-4ae9-453a-89c4-3d27094a8617'} Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:20.649165 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. Aug 30 17:56:20.654167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:20.656329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] Returning 404 to user: Instance 48313007-4ae9-453a-89c4-3d27094a8617 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:20.660694 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50ffb1bc-b90f-4bcb-b98f-11f7d48cc491 tempest-ServerRescueNegativeTestJSON-1780635569 tempest-ServerRescueNegativeTestJSON-1780635569-project] 10.222.0.50 "GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617" status: 404 len: 111 microversion: 2.1 time: 0.118876 Aug 30 17:56:20.661918 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2907/5554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:20 2022] GET /compute/v2.1/servers/48313007-4ae9-453a-89c4-3d27094a8617 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:20.860449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:20.881012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:20.890076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:20.896430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:20.899060 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f202746-a451-4e52-a55d-eb0f1e91cc6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.429117 Aug 30 17:56:20.902773 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2648/5555] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:20 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:21.001340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "name": "network-vif-plugged", "status": "completed", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:21.023651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:21.029923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:21.030531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:21.069106 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] Creating event network-vif-plugged:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:56:21.082701 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2ccf6e42-802f-402d-bf6e-9a23f845b4c3 req-4ef3f08d-7d2a-495e-9005-d2d9204a6317 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084483 Aug 30 17:56:21.086159 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2908/5556] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:56:21.923077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:21.923726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:21.943769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:21.944547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:21.945177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:21.945929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:21.946390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:21.946817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:22.485917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:22.495821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:22.504965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:22.510253 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7539f21e-7a80-4869-b26d-dc4ade8dcae8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1407 microversion: 2.20 time: 0.587873 Aug 30 17:56:22.511458 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2649/5557] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:21 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:23.540938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:23.541812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:23.561183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:23.563598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:23.564278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:23.566680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:23.572187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:23.572647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:23.861379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:23.876094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:23.877724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:23.879010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85eee2a0-2fd6-42e6-b551-26dc138ae1d4 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1600 microversion: 2.20 time: 0.345760 Aug 30 17:56:23.890039 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2909/5558] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:56:23 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1600 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:56:23.922542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:23.923131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:23.938029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:23.938638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:23.939383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:23.940442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:23.941146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:23.941703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:24.126599 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.222596 Aug 30 17:56:24.140262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2650/5559] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 17:56:23 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:56:26.090768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:26.108859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:26.109351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:26.109791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:26.124439 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] Creating event network-changed:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:56:26.130278 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-aacd4ca0-8dc2-434b-9082-3d892e62fdf4 req-30a64f1f-be11-454d-ae3b-18e72061c458 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043246 Aug 30 17:56:26.135520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2910/5560] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:29.620008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:29.621134 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4134aaec-4bd7-449e-8626-394030a52caa tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001555 Aug 30 17:56:29.627998 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2651/5561] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 30 17:56:29 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 17:56:31.930348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3601d724-6e06-4146-bf00-ad10093ee684 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] Calling method '.version_select at 0x7f2d937f6af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:31.997167 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3601d724-6e06-4146-bf00-ad10093ee684 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.223287 Aug 30 17:56:32.003741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2911/5562] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:56:31 2022] GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a/defaults => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:32.012218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71dcfafe-137f-4b4f-b69f-2f213f593db9 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] Calling method '.version_select at 0x7f2d93683d30>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:32.104155 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71dcfafe-137f-4b4f-b69f-2f213f593db9 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a" status: 200 len: 371 microversion: 2.1 time: 0.098333 Aug 30 17:56:32.104742 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2652/5563] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:56:32 2022] GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:32.120869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5356f6ec-e2a0-4b6b-8ed7-944c5eb6281a tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] Calling method '.version_select at 0x7f2d93895b80>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:32.210185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5356f6ec-e2a0-4b6b-8ed7-944c5eb6281a tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.093386 Aug 30 17:56:32.211530 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2912/5564] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 17:56:32 2022] GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a/defaults => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:32.225514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e6b8b56-ce45-4dc5-b1e5-24b0ef022538 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] Calling method '.version_select at 0x7f2d93599160>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:32.304764 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e6b8b56-ce45-4dc5-b1e5-24b0ef022538 tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a" status: 200 len: 371 microversion: 2.1 time: 0.083790 Aug 30 17:56:32.305779 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2653/5565] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 17:56:32 2022] GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:32.318954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98575531-198e-4643-a78e-79fa5e71fa9c tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] Calling method '.version_select at 0x7f2d93895dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:32.417082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98575531-198e-4643-a78e-79fa5e71fa9c tempest-QuotasTestJSON-321659257 tempest-QuotasTestJSON-321659257-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a?user_id=085e1bcc273b4999a9d8a2e4c679d442" status: 200 len: 371 microversion: 2.1 time: 0.103451 Aug 30 17:56:32.417771 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2913/5566] 10.222.0.50 () {58 vars in 1323 bytes} [Tue Aug 30 17:56:32 2022] GET /compute/v2.1/os-quota-sets/5c74dc4b7bb94a498e7e1f56e17e402a?user_id=085e1bcc273b4999a9d8a2e4c679d442 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:34.509291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11c8f925-dcf6-4954-9641-516e1cc1b03f"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:34.512241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:34.519080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=11 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:34.522504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:34.523120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:34.523703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:34.524520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:34.525160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:34.525752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:34.650052 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments HTTP/1.1 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 74 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: {"volumeAttachment": {"volumeId": "11c8f925-dcf6-4954-9641-516e1cc1b03f"}} Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '471adb65-8648-4c0d-bb3a-ad1454364f6b', 'body': {'volumeAttachment': {'volumeId': '11c8f925-dcf6-4954-9641-516e1cc1b03f'}}} Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:56:34.652657 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 400 to user: Invalid volume: volume 11c8f925-dcf6-4954-9641-516e1cc1b03f is already attached to instances: 471adb65-8648-4c0d-bb3a-ad1454364f6b {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9fe52307-0e9d-41ee-b0ce-3ae2aa212c4b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149960 Aug 30 17:56:34.657546 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2654/5567] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:56:34 2022] POST /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:56:34.754877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:34.755934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:34.770221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:34.770739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:34.771980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:34.774220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:34.780134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:34.780835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:34.818207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:34.954064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-007dff81-99af-4b1d-a70b-cff5f65df025 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Action: 'create', calling method: .version_select at 0x7f2d935b09d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-561609494"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:34.973501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'services' on Instance uuid 471adb65-8648-4c0d-bb3a-ad1454364f6b {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:56:35.076097 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-182267b5-5c65-4a58-9250-318442628816 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments/11c8f925-dcf6-4954-9641-516e1cc1b03f" status: 202 len: 0 microversion: 2.1 time: 0.327124 Aug 30 17:56:35.077034 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2914/5568] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:56:34 2022] DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments/11c8f925-dcf6-4954-9641-516e1cc1b03f => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:56:35.088339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:35.096228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:35.116800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:35.117494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:35.118830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:35.120117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:35.121097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:35.121961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:35.197821 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9b2cf31c-b069-40f9-813a-fd652c73b380 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111525 Aug 30 17:56:35.202577 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2915/5569] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:35 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:56:35.588522 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-007dff81-99af-4b1d-a70b-cff5f65df025 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.808160 Aug 30 17:56:35.589591 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2655/5570] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Aug 30 17:56:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 810 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 17:56:35.602223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9502faee-b6da-4c47-8f10-73a3497f13fc tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d934a2550>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:35.702193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9502faee-b6da-4c47-8f10-73a3497f13fc tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 344 microversion: 2.1 time: 0.104376 Aug 30 17:56:35.703170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2916/5571] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:35 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:36.215619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:36.218350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:36.233366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:36.233867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:36.234300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:36.236146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:36.236291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:36.238819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:36.355600 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de32ad4c-2576-463c-9c90-9c8ecf52cc31 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144731 Aug 30 17:56:36.395647 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2656/5572] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:36 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:36.718637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-45e4e823-496b-4ce2-8dd8-f075050e4153 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d937f6280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:36.828118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-45e4e823-496b-4ce2-8dd8-f075050e4153 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 344 microversion: 2.1 time: 0.115128 Aug 30 17:56:36.828705 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2917/5573] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:36 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:37.371285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:37.374022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:37.390926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:37.391994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:37.396903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:37.398086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:37.398761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:37.399381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:37.475618 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5caf123e-d72d-4876-b657-53cb879d3fae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110949 Aug 30 17:56:37.481085 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2657/5574] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:37 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:37.844690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13b6158e-62e9-4b1d-9e30-73c5cb33ed7b tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d9386b700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:37.921363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13b6158e-62e9-4b1d-9e30-73c5cb33ed7b tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 345 microversion: 2.1 time: 0.082964 Aug 30 17:56:37.921975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2918/5575] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:37 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:37.937162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d68afbac-7413-4079-bb3c-d0b0924bb3a9 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Action: 'create', calling method: .version_select at 0x7f2d938a7c10>, body: {"snapshot": {"volume_id": "c2851e43-54fd-4cf7-944a-01d37cb15275", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-488482336"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:38.239135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d68afbac-7413-4079-bb3c-d0b0924bb3a9 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.307323 Aug 30 17:56:38.243530 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2658/5576] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Aug 30 17:56:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:38.253878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f82a38cf-08ff-4f3f-acd0-095712eb70c7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d934a2280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:38.310786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f82a38cf-08ff-4f3f-acd0-095712eb70c7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 286 microversion: 2.1 time: 0.060750 Aug 30 17:56:38.311370 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2919/5577] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:38 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:38.323344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a928a4f-7855-48db-9fd3-d0b0dbb517d0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935dbe50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:38.375543 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a928a4f-7855-48db-9fd3-d0b0dbb517d0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.055912 Aug 30 17:56:38.376106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2659/5578] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 17:56:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:38.388128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c535e8b-ecea-4b9b-b737-cd4589b4fc3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d93717670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:38.422657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c535e8b-ecea-4b9b-b737-cd4589b4fc3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 286 microversion: 2.1 time: 0.038705 Aug 30 17:56:38.423289 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2920/5579] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:38 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:38.488567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:38.491305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:38.498859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:38.499995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:38.501295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:38.502419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:38.503031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:38.504615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:38.547868 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-014ad129-7746-4f27-aa33-9d28b36cc4d7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062938 Aug 30 17:56:38.548753 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2660/5580] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:38 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:39.437248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88c6666e-e670-499f-aaa6-d954499009ea tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d93895af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:39.487418 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88c6666e-e670-499f-aaa6-d954499009ea tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 286 microversion: 2.1 time: 0.055839 Aug 30 17:56:39.488849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2921/5581] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:39 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:39.561795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:39.564164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:39.578292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:39.579127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:39.580296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:39.586889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:39.588810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:39.589274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:39.626548 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f6fb2ab-847c-4897-be81-dd2c33527dac tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069970 Aug 30 17:56:39.631691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2661/5582] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:39 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:40.501985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62268d5e-cc08-408a-90ed-11d110dce6ea tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d934a2700>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:40.639900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:40.642692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:40.651559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:40.652259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:40.652920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:40.653799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:40.654817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:40.655660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:40.664274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62268d5e-cc08-408a-90ed-11d110dce6ea tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 287 microversion: 2.1 time: 0.167053 Aug 30 17:56:40.665165 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2922/5583] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:40 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:40.677634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0d980e1-7635-432d-a67b-b1a6a8ca4465 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d996e84c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:40.733727 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5751a611-4348-4af7-bcc9-e09958d617ae tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098270 Aug 30 17:56:40.739056 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2662/5584] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:40 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:40.785185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0d980e1-7635-432d-a67b-b1a6a8ca4465 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 202 len: 0 microversion: 2.1 time: 0.111906 Aug 30 17:56:40.786140 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2923/5585] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 30 17:56:40 2022] DELETE /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:56:40.794380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a2d08d03-8549-40ed-9a03-c3448629416c tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935bcc10>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:40.856883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a2d08d03-8549-40ed-9a03-c3448629416c tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 286 microversion: 2.1 time: 0.066079 Aug 30 17:56:40.857741 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2663/5586] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:40 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:41.755703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:41.759273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:41.767006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:41.768877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:41.771227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:41.771227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:41.772271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:41.772964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:41.773926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:41.862717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-84626355-094f-46ab-a100-8e187e32acc9 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112660 Aug 30 17:56:41.875097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-530e70f7-28cc-4364-8490-7a0df1ee206a tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935b4f70>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:41.879849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2924/5587] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:56:41 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:56:41.934786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:41.935371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:41.940872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-530e70f7-28cc-4364-8490-7a0df1ee206a tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 200 len: 286 microversion: 2.1 time: 0.070923 Aug 30 17:56:41.941659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2664/5588] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:41 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:41.945973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:41.946574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:41.947079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:41.948267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:41.948674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:41.949202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:41.982137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:56:42.095044 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef9a68e3-9237-44bc-8b1c-4ea8e959b1c4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 204 len: 0 microversion: 2.1 time: 0.163926 Aug 30 17:56:42.096373 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2925/5589] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:56:41 2022] DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:56:42.109751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:42.110364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:42.123226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=44 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:42.125968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:42.126907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:42.127650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:42.129984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:42.130622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:42.131235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:42.298831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:42.353385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:42.364985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e1dfd11-c82d-4758-98ea-a315f618c890 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1681 microversion: 2.1 time: 0.262327 Aug 30 17:56:42.366057 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2665/5590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:42 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:42.954870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-821b13a7-8241-4b0c-af03-29b27acafdc0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d934c3820>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:42.962609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:56:42.986002 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-821b13a7-8241-4b0c-af03-29b27acafdc0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] HTTP exception thrown: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-821b13a7-8241-4b0c-af03-29b27acafdc0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Request method failure captured: Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 HTTP/1.1 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk9S8iVHvol4Pc4zhPPTwztIzaYEAc0fw4Bu3NbehVzkXjE52wlOd6jNAI0DtbhKF_jNRVYw34Bqq6fZpUUmKeVz9KaKesrA4IxlH9h_LUR6qlTmvIL0-dr_uMkKylEIubIvD_vHTlT-qE8N9MtpyCjNENcEoK9E268Sq7BNwqlrQK8 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc6045cf49e4251b3761e8b1eeb612d"}]}] Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 47a0337e59de4a90a27d85c5da95e2a5 Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: exception: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8fad45d5-e4b1-44ab-8eb8-8314d17fad00'} Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. (HTTP 404) (Request-ID: req-cf71ce8a-1d4f-4ac4-8726-4b32abcbcaeb) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:43.011086 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:43.016129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-821b13a7-8241-4b0c-af03-29b27acafdc0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Returning 404 to user: Snapshot 8fad45d5-e4b1-44ab-8eb8-8314d17fad00 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:43.019750 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-821b13a7-8241-4b0c-af03-29b27acafdc0 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00" status: 404 len: 111 microversion: 2.1 time: 0.067431 Aug 30 17:56:43.023901 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2926/5591] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 17:56:42 2022] GET /compute/v2.1/os-snapshots/8fad45d5-e4b1-44ab-8eb8-8314d17fad00 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:43.029058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d037f3d1-ffb5-4a57-9dc3-f99f6db3fd59 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935bc670>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:43.109188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d037f3d1-ffb5-4a57-9dc3-f99f6db3fd59 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 202 len: 0 microversion: 2.1 time: 0.082098 Aug 30 17:56:43.110276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2666/5592] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:56:43 2022] DELETE /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:56:43.119517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7cb71fd4-c3e6-49b3-b0cf-0f9d681f396c tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d939a54c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:43.186138 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7cb71fd4-c3e6-49b3-b0cf-0f9d681f396c tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 344 microversion: 2.1 time: 0.071422 Aug 30 17:56:43.186887 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2927/5593] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:43 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:43.389152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:43.390075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:43.398715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:43.399544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:43.400154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:43.401124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:43.401755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:43.402348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:44.005688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:44.017913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-77f0335d-e53f-49c8-a4f5-e5e5e9aa7155 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1681 microversion: 2.1 time: 0.632882 Aug 30 17:56:44.018500 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2667/5594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:43 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1681 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:44.203845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-205762c4-621d-4a78-a2b9-d92f7a579f2f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d93868310>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:44.308432 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-205762c4-621d-4a78-a2b9-d92f7a579f2f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 344 microversion: 2.1 time: 0.110613 Aug 30 17:56:44.309362 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2928/5595] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:44 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:45.042584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:45.043635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:45.055642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:45.059952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:45.061873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:45.064317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:45.065001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:45.067323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:45.082499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471adb65-8648-4c0d-bb3a-ad1454364f6b", "name": "network-vif-deleted", "tag": "24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:45.097472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:45.105172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:45.105633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:45.135834 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] Creating event network-vif-deleted:24f9bcf6-f8f1-417e-99ee-dbb7af4e25fb for instance 471adb65-8648-4c0d-bb3a-ad1454364f6b on n-h2-852771-11 Aug 30 17:56:45.147739 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-71c48673-0489-4e2b-8d4f-04fe901588fd req-0b90d82e-0100-4b5d-bde4-52e2b2626403 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246925 Aug 30 17:56:45.156448 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2668/5596] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:45.184273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:45.185432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:45.185899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:45.187958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'fault' on Instance uuid 471adb65-8648-4c0d-bb3a-ad1454364f6b {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:56:45.323194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8139fe2a-9b83-41e3-b28a-ff628c9a3009 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d9363adc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:45.374069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:45.385933 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ec31dd6-759a-4ae6-b387-9ff8683ea7a7 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 200 len: 1332 microversion: 2.1 time: 0.350011 Aug 30 17:56:45.386553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2929/5597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:45 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 1332 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:56:45.412985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8139fe2a-9b83-41e3-b28a-ff628c9a3009 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 200 len: 344 microversion: 2.1 time: 0.094045 Aug 30 17:56:45.413571 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2669/5598] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:45 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:46.410332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:46.411739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:46.429052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f924756-6104-498e-ad5e-18fca4638e3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935bc940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:46.432124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:46.432623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:46.433066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:46.433783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:46.434234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:46.434659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:46.475347 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-0f924756-6104-498e-ad5e-18fca4638e3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] HTTP exception thrown: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f924756-6104-498e-ad5e-18fca4638e3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Request method failure captured: Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 HTTP/1.1 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9S8iVHvol4Pc4zhPPTwztIzaYEAc0fw4Bu3NbehVzkXjE52wlOd6jNAI0DtbhKF_jNRVYw34Bqq6fZpUUmKeVz9KaKesrA4IxlH9h_LUR6qlTmvIL0-dr_uMkKylEIubIvD_vHTlT-qE8N9MtpyCjNENcEoK9E268Sq7BNwqlrQK8 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc6045cf49e4251b3761e8b1eeb612d"}]}] Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 47a0337e59de4a90a27d85c5da95e2a5 Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c2851e43-54fd-4cf7-944a-01d37cb15275'} Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. (HTTP 404) (Request-ID: req-46e8c960-ad66-4151-9528-05f7a8e1ae4e) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:46.478353 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f924756-6104-498e-ad5e-18fca4638e3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Returning 404 to user: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:46.483192 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f924756-6104-498e-ad5e-18fca4638e3f tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 404 len: 109 microversion: 2.1 time: 0.057189 Aug 30 17:56:46.486473 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:56:46.488429 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2670/5599] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:46 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b HTTP/1.1 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '471adb65-8648-4c0d-bb3a-ad1454364f6b'} Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.492365 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-31e4e55e-4e89-40e1-9367-e679aba43b06 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 404 len: 111 microversion: 2.1 time: 0.087679 Aug 30 17:56:46.497466 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2930/5600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:46 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:46.501692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0b72f95-6540-435d-947c-4e0ba3e43b93 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d9363adc0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:46.526612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ac1b9e2-cf58-4f2e-909f-f2baa0442ca5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '.version_select at 0x7f2d937bbee0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:46.539226 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a0b72f95-6540-435d-947c-4e0ba3e43b93 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] HTTP exception thrown: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0b72f95-6540-435d-947c-4e0ba3e43b93 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Request method failure captured: Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 HTTP/1.1 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9S8iVHvol4Pc4zhPPTwztIzaYEAc0fw4Bu3NbehVzkXjE52wlOd6jNAI0DtbhKF_jNRVYw34Bqq6fZpUUmKeVz9KaKesrA4IxlH9h_LUR6qlTmvIL0-dr_uMkKylEIubIvD_vHTlT-qE8N9MtpyCjNENcEoK9E268Sq7BNwqlrQK8 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc6045cf49e4251b3761e8b1eeb612d"}]}] Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 47a0337e59de4a90a27d85c5da95e2a5 Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c2851e43-54fd-4cf7-944a-01d37cb15275'} Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. (HTTP 404) (Request-ID: req-5d6518b3-92f7-4169-a9d5-b66944156713) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:46.540990 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0b72f95-6540-435d-947c-4e0ba3e43b93 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Returning 404 to user: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:46.545734 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0b72f95-6540-435d-947c-4e0ba3e43b93 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 404 len: 109 microversion: 2.1 time: 0.052123 Aug 30 17:56:46.551425 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2671/5601] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:56:46 2022] DELETE /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:46.559417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b4ef7c11-eb66-4043-9454-7e18f53dbed7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Calling method '.version_select at 0x7f2d935dc280>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:46.594578 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b4ef7c11-eb66-4043-9454-7e18f53dbed7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] HTTP exception thrown: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b4ef7c11-eb66-4043-9454-7e18f53dbed7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Request method failure captured: Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 HTTP/1.1 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9S8iVHvol4Pc4zhPPTwztIzaYEAc0fw4Bu3NbehVzkXjE52wlOd6jNAI0DtbhKF_jNRVYw34Bqq6fZpUUmKeVz9KaKesrA4IxlH9h_LUR6qlTmvIL0-dr_uMkKylEIubIvD_vHTlT-qE8N9MtpyCjNENcEoK9E268Sq7BNwqlrQK8 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc6045cf49e4251b3761e8b1eeb612d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc6045cf49e4251b3761e8b1eeb612d"}]}] Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: cfc6045cf49e4251b3761e8b1eeb612d Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-80796796 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 47a0337e59de4a90a27d85c5da95e2a5 Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-80796796-project Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c2851e43-54fd-4cf7-944a-01d37cb15275'} Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. (HTTP 404) (Request-ID: req-3600a495-aeba-45fc-ac7a-cff7442c369a) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:46.596947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b4ef7c11-eb66-4043-9454-7e18f53dbed7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] Returning 404 to user: Volume c2851e43-54fd-4cf7-944a-01d37cb15275 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:46.602945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b4ef7c11-eb66-4043-9454-7e18f53dbed7 tempest-VolumesSnapshotsTestJSON-80796796 tempest-VolumesSnapshotsTestJSON-80796796-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275" status: 404 len: 109 microversion: 2.1 time: 0.042889 Aug 30 17:56:46.606147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2672/5602] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:46 2022] GET /compute/v2.1/os-volumes/c2851e43-54fd-4cf7-944a-01d37cb15275 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:46.606793 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ac1b9e2-cf58-4f2e-909f-f2baa0442ca5 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663236148" status: 202 len: 0 microversion: 2.1 time: 0.098325 Aug 30 17:56:46.621197 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2931/5603] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663236148 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:56:48.394509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb532596-6824-4cde-ba5e-56cd7860c70d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: .version_select at 0x7f2d936169d0>, body: {"keypair": {"name": "tempest-keypair-2091812010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHqcaTjJaceEYfGZAO1hS9rjcySR+bTQnsf6VP2n74yIE3lMYzE2BZKlxBFCfe1plInPndgsdr4lQELNpkBXaq6mV1CBNjr5+tL4whEzeoJoO3s/nCXKBdvpAJzmsk2EA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:48.425566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bb532596-6824-4cde-ba5e-56cd7860c70d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:56:48.432355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bb532596-6824-4cde-ba5e-56cd7860c70d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:56:48.477690 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb532596-6824-4cde-ba5e-56cd7860c70d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088932 Aug 30 17:56:48.478506 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2673/5604] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 17:56:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:56:49.728520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1184318f-3866-4df9-b725-b2ca1ef83372 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Action: 'create', calling method: .version_select at 0x7f2d937a0790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1181721803", "metadata": {"Type": "work"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1184318f-3866-4df9-b725-b2ca1ef83372 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 122 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1181721803", "metadata": {"Type": "work"}}} Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1181721803', 'metadata': {'Type': 'work'}}}} Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:56:49.732391 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 17:56:49.737141 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.738495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1184318f-3866-4df9-b725-b2ca1ef83372 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:49.740064 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1184318f-3866-4df9-b725-b2ca1ef83372 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.155901 Aug 30 17:56:49.740818 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2932/5605] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 17:56:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:56:49.751236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef9d41e9-17b9-4c33-809d-279c7f00d148 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Action: 'create', calling method: .version_select at 0x7f2d9387c670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491556885", "metadata": {"Type": "work"}}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef9d41e9-17b9-4c33-809d-279c7f00d148 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 120 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491556885", "metadata": {"Type": "work"}}} Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1491556885', 'metadata': {'Type': 'work'}}}} Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '0' Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:56:49.756915 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef9d41e9-17b9-4c33-809d-279c7f00d148 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ef9d41e9-17b9-4c33-809d-279c7f00d148 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011772 Aug 30 17:56:49.761661 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2674/5606] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 17:56:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:56:49.775759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b56eb7d0-90bb-4db7-b528-ca02238914ca tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Action: 'create', calling method: .version_select at 0x7f2d937f6820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-383873619", "metadata": {"Type": "work"}}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b56eb7d0-90bb-4db7-b528-ca02238914ca tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 118 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-383873619", "metadata": {"Type": "work"}}} Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-383873619', 'metadata': {'Type': 'work'}}}} Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi '' Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:56:49.779974 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b56eb7d0-90bb-4db7-b528-ca02238914ca tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b56eb7d0-90bb-4db7-b528-ca02238914ca tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011162 Aug 30 17:56:49.790169 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2933/5607] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 17:56:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:56:49.795473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-476b12c4-f431-4fa7-935c-55d257389ffb tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Calling method '.version_select at 0x7f2d93541ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:49.827742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-476b12c4-f431-4fa7-935c-55d257389ffb tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] HTTP exception thrown: Volume tempest-invalid-1866594250 could not be found. Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-476b12c4-f431-4fa7-935c-55d257389ffb tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1866594250 HTTP/1.1 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume tempest-invalid-1866594250 could not be found. Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'tempest-invalid-1866594250'} Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1866594250 could not be found. (HTTP 404) (Request-ID: req-7933bfd6-d85f-4010-8063-023d354a4fd2) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:49.840879 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1866594250 could not be found. Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1866594250 could not be found. Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1866594250 could not be found. Aug 30 17:56:49.845714 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.849934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-476b12c4-f431-4fa7-935c-55d257389ffb tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 404 to user: Volume tempest-invalid-1866594250 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:49.850815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-476b12c4-f431-4fa7-935c-55d257389ffb tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1866594250" status: 404 len: 99 microversion: 2.1 time: 0.060045 Aug 30 17:56:49.855594 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2675/5608] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 17:56:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1866594250 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 17:56:49.872565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72ed627b-0b22-4d2f-b192-88252e858bf2 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014449 Aug 30 17:56:49.873307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2934/5609] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 17:56:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 17:56:49.886228 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5125c82-5406-48d7-8f91-96023186b17b tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006808 Aug 30 17:56:49.887419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2676/5610] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 17:56:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 17:56:49.897736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e477185-0a29-4b46-8539-17e23475a2b0 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Calling method '.version_select at 0x7f2d939a54c0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:49.939322 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7e477185-0a29-4b46-8539-17e23475a2b0 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] HTTP exception thrown: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e477185-0a29-4b46-8539-17e23475a2b0 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/os-volumes/477ee43e-6695-4314-bec9-71ac023dc10c HTTP/1.1 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: method: Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: exception: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '477ee43e-6695-4314-bec9-71ac023dc10c'} Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. (HTTP 404) (Request-ID: req-74190e55-b980-4761-8aef-da30bd3d63c5) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:49.943819 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. Aug 30 17:56:49.948633 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.953963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e477185-0a29-4b46-8539-17e23475a2b0 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 404 to user: Volume 477ee43e-6695-4314-bec9-71ac023dc10c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:49.955521 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e477185-0a29-4b46-8539-17e23475a2b0 tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/477ee43e-6695-4314-bec9-71ac023dc10c" status: 404 len: 109 microversion: 2.1 time: 0.062055 Aug 30 17:56:49.956170 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2935/5611] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:56:49 2022] DELETE /compute/v2.1/os-volumes/477ee43e-6695-4314-bec9-71ac023dc10c => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:56:49.966877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c25dfda8-ef80-4bfa-9747-b82fb063e1bf tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Calling method '.version_select at 0x7f2d93891af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:49.997562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c25dfda8-ef80-4bfa-9747-b82fb063e1bf tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] HTTP exception thrown: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c25dfda8-ef80-4bfa-9747-b82fb063e1bf tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Request method failure captured: Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/os-volumes/a511a766-47b7-4a2f-8555-e7799df954a8 HTTP/1.1 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk9hmqAbIHKprr_wFNVj93SGFNcqW_vtrLIRtsJikYV7H-sNxZyC-NXFSvkmrgzsvNpDsGpIUOuPWl9mWuS0IjufoZfNZmjY4xevlOTVMD0sfH7XqAGRiFvf6VTH4_2Vloow2bE44WRO6Nqto2xivW447KwKDcGQ7L0KXotr_l64ZeY Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c04e244ef40e46a9835cc31930702b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c04e244ef40e46a9835cc31930702b76"}]}] Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c04e244ef40e46a9835cc31930702b76 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesNegativeTest-230283942 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 1cb24817baf54c34a7b00590c2ab5714 Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesNegativeTest-230283942-project Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: method: Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: exception: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a511a766-47b7-4a2f-8555-e7799df954a8'} Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. (HTTP 404) (Request-ID: req-d8e8a2f2-09f2-43a0-8342-a66a19298b47) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 17:56:49.999681 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:56:50.005327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c25dfda8-ef80-4bfa-9747-b82fb063e1bf tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] Returning 404 to user: Volume a511a766-47b7-4a2f-8555-e7799df954a8 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:56:50.008565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c25dfda8-ef80-4bfa-9747-b82fb063e1bf tempest-VolumesNegativeTest-230283942 tempest-VolumesNegativeTest-230283942-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a511a766-47b7-4a2f-8555-e7799df954a8" status: 404 len: 109 microversion: 2.1 time: 0.043366 Aug 30 17:56:50.013190 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2677/5612] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:56:49 2022] GET /compute/v2.1/os-volumes/a511a766-47b7-4a2f-8555-e7799df954a8 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:56:50.868058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-620539030", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9c5be2-f5e4-49b8-9312-c995d1b4829c"}], "security_groups": [{"name": "tempest-securitygroup--536985191"}], "key_name": "tempest-keypair-2091812010", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:51.046003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] validate_networks() for [('1b9c5be2-f5e4-49b8-9312-c995d1b4829c', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:56:51.591923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:56:51.592573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:56:51.593068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:56:51.593488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:56:51.593909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:56:51.607436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:51.607976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:51.608421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:51.609163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:51.609777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:51.610516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:51.635654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:56:51.645489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Getting quotas for user f5b272d5fecd4319a2f8aad6f98912be and project 2cf3453f6c52492c8a2b01d2ad96e06a. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:56:51.659673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:56:51.663675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:56:51.727461 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa59f28e-1a96-4d0c-9285-ec66e96f7497 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.871716 Aug 30 17:56:51.728390 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2936/5613] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:56:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:56:51.742191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96f6253d-5798-4004-bb69-9befc46d6dc2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:51.743013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96f6253d-5798-4004-bb69-9befc46d6dc2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:51.821814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96f6253d-5798-4004-bb69-9befc46d6dc2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:51.830836 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96f6253d-5798-4004-bb69-9befc46d6dc2 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1241 microversion: 2.1 time: 0.094953 Aug 30 17:56:51.831587 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2678/5614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:51 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:52.853683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:52.856240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:52.872653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:52.873191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:52.873648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:52.874394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:52.875612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:52.877044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:52.996156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:53.005420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dae41f72-1acb-4fb1-bfce-02bf8b8af3ce tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1293 microversion: 2.1 time: 0.157649 Aug 30 17:56:53.006431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2937/5615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:52 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:54.029229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:54.032177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:54.073456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:54.073946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:54.074379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:54.076264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:54.076724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:54.077364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:54.213274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:54.230835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f686111a-756e-4957-8ff5-fe0251d5a6ab tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1299 microversion: 2.1 time: 0.207412 Aug 30 17:56:54.240924 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2679/5616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:54 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:55.256252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:55.257473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:55.288124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:55.288873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:55.289480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:55.290935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:55.291783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:55.293165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:55.469921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:55.481324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-175fc541-5b0f-4184-b364-afe5a07dd8b8 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.228492 Aug 30 17:56:55.491502 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2938/5617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:55 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:55.678140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488e94eb-fcaf-499b-af30-f847eb11b95f", "tag": "aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:56:55.705099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:55.705863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:55.722374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:55.747902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] Creating event network-changed:aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd for instance 488e94eb-fcaf-499b-af30-f847eb11b95f on n-h2-852771-11 Aug 30 17:56:55.752928 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d75ee0db-2ac0-4a4f-a4a6-fb0b52bba01c req-a90b35bd-2d52-4db6-91fa-ba0a9245d273 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081570 Aug 30 17:56:55.755686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2680/5618] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:56:56.506759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:56.507462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:56.523799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:56.524793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:56.525401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:56.527342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:56.529118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:56.530758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:56.841528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:56.858639 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db3e45f9-a4f6-4ef7-b099-c8519629e489 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.358002 Aug 30 17:56:56.860048 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2939/5619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:56 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:57.880954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:57.882810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:57.897213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:57.899816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:57.901287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:57.906995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:57.907753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:57.908412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:58.288223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:58.309258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0182c242-bae0-414b-8760-7d3a3cf6f221 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.433527 Aug 30 17:56:58.312911 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2681/5620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:57 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:56:59.337047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:56:59.337680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:56:59.367168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:59.367872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:59.368549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:59.369881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:56:59.370353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:56:59.370799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:56:59.658798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:56:59.685796 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8dc50fcf-7903-4eb5-9a69-1540da86878d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.354003 Aug 30 17:56:59.688353 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2940/5621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:56:59 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:57:00.262877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:00.265131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:00.277788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:00.279317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:00.282350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:00.283255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:00.284471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:00.285351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:00.319744 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25edc38a-21fd-4276-a282-edc91b2c5f11 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/ips" status: 200 len: 152 microversion: 2.20 time: 0.071207 Aug 30 17:57:00.321557 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2682/5622] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 30 17:57:00 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:57:00.712347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:00.714132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:00.741636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:00.742549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:00.743346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:00.744150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:00.744687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:00.745125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:01.264795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:01.276620 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a4a1f38-16c6-468e-8758-c2115769ab0e tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.570387 Aug 30 17:57:01.281003 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2941/5623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:57:00 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:57:02.303797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:02.304593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:02.312130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:02.327051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:02.327573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:02.328009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:02.328727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:02.329176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:02.329596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:02.688345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:02.696136 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-333f4108-68f2-490f-abd8-18068c406073 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.397663 Aug 30 17:57:02.697219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2683/5624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:57:02 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:57:03.471836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:03.472931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:03.482722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:03.483687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:03.489267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:03.489798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:03.490247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:03.490963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:03.491421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:03.499089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:03.528205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lazy-loading 'flavor' on Instance uuid 20ecc66c-a659-433d-90f8-1916b50392e8 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:57:03.726353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:03.729577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:03.751807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:03.753479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:03.755304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:03.756709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:03.759437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:03.761364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:03.959229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53ae98b9-3f38-4b56-8bad-403f4276b636 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/action" status: 202 len: 0 microversion: 2.20 time: 0.491483 Aug 30 17:57:03.960690 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2942/5625] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:57:03 2022] POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:57:03.976948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:03.978096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:04.014893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:04.015592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:04.017492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:04.020324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:04.020988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:04.021427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:04.166043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:04.203626 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e513ea4d-f06f-4f89-8178-8d533c338675 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.489335 Aug 30 17:57:04.205583 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2684/5626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:57:03 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:57:04.226146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488e94eb-fcaf-499b-af30-f847eb11b95f", "name": "network-vif-plugged", "status": "completed", "tag": "aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:04.254820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:04.268638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:04.271459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:04.298674 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] Creating event network-vif-plugged:aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd for instance 488e94eb-fcaf-499b-af30-f847eb11b95f on n-h2-852771-11 Aug 30 17:57:04.310824 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-fadaab79-fe8d-4738-9add-c007729be5b3 req-f50726b4-914e-42ab-bc48-9ec0a58398d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103416 Aug 30 17:57:04.332011 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2685/5627] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:04.491994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:04.494375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:04.509062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:04.510516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:04.522328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-70b6de1e-2ee1-4356-a310-b58fcdea6daf tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.557271 Aug 30 17:57:04.522954 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2943/5628] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:03 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:57:05.229375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:05.230438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:05.252247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:05.256891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:05.257353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:05.260436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:05.260957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:05.261412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:05.271604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=83 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:05.547302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:05.547949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:05.562936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:05.563442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:05.563905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:05.564626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:05.567734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:05.568182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:05.819231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:05.831012 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55eda8eb-8f3b-4615-b739-47bf532353bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1366 microversion: 2.1 time: 0.607448 Aug 30 17:57:05.832401 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2686/5629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:57:05 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1366 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:57:05.939421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:05.951896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:05.955283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:05.956611 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7a6acf9-7d8d-43a0-bdd5-c1e98488e806 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.414384 Aug 30 17:57:05.957855 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2944/5630] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:05 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:06.853197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:06.854514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:06.871842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:06.872619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:06.873896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:06.874849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:06.875557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:06.876199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:06.981331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:06.982043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:06.991737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:06.994075 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:06.995010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:06.998301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:06.999013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:07.000106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:07.142875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:07.153177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d0ed2172-43ea-49c2-8944-ad0057c93ba0 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1556 microversion: 2.1 time: 0.304431 Aug 30 17:57:07.170457 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2687/5631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:57:06 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1556 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:57:07.176821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:07.177382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:07.184326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:07.184861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:07.185531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:07.187449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:07.188737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:07.189405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:07.283824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:07.295094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:07.297110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:07.298729 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd8d7594-1d38-4325-8883-376bf6b2041f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.321963 Aug 30 17:57:07.299848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2945/5632] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:06 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:57:07.356515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45d0d78f-335b-4c31-9340-835772f3c72b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183656 Aug 30 17:57:07.357461 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2688/5633] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 17:57:07 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:08.322672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:08.323322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:08.334657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:08.335151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:08.342108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:08.343137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:08.343856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:08.344457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:08.822758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:08.841967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:08.847450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:08.857481 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-903e6093-8644-4f63-b8f7-d94136751a6a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.536501 Aug 30 17:57:08.861088 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2946/5634] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:08 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:57:09.302295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488e94eb-fcaf-499b-af30-f847eb11b95f", "tag": "aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:09.325197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:09.326562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:09.328352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:09.355102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] Creating event network-changed:aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd for instance 488e94eb-fcaf-499b-af30-f847eb11b95f on n-h2-852771-11 Aug 30 17:57:09.377267 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-0273e71f-5fda-41fa-9d9d-e5f730aaa543 req-62d96335-8fd6-4413-84e7-759669a2cbb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079352 Aug 30 17:57:09.382053 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2689/5635] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:09.888656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:09.889283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:09.903648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:09.904627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:09.909646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:09.911195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:09.911997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:09.912593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:10.265740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:10.281655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:10.285176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:10.287178 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2e4b3fa2-eef5-4aba-9bd3-c3d18094a46a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.403309 Aug 30 17:57:10.292476 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2947/5636] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:09 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:11.314235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:11.315044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:11.327443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:11.328859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:11.332532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:11.333417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:11.335794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:11.336353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:11.658686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:11.669580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:11.671991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:11.673866 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02a5f6e5-7e7e-4555-85bc-19a2be21b6b5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.363518 Aug 30 17:57:11.675575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2690/5637] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:11 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:12.696191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:12.696823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:12.699580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:12.705975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:12.706611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:12.707280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:12.708240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:12.708942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:12.709573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:12.948140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:12.957325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:12.958798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:12.960532 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9ee4d02-cf52-48bf-b3fe-0a5e513fcad2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.267803 Aug 30 17:57:12.961119 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2948/5638] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:12 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:13.984417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:13.985220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:13.988274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:13.996462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:13.997892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:13.998532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:13.999857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:14.000479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:14.001494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:14.232284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:14.243368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:14.245607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:14.246783 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f84df891-612d-4d03-bb46-870980f0b18a tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.266776 Aug 30 17:57:14.247679 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2691/5639] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:13 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:15.299460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:15.307874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:15.324251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:15.324912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:15.325375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:15.326205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:15.326735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:15.327179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:15.584685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:15.596441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:15.600757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:15.602938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-66cf308e-2e61-4758-91a0-864738d100cb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1745 microversion: 2.20 time: 0.326330 Aug 30 17:57:15.616829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2949/5640] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:15 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1745 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:16.631259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:16.631910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:16.661921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:16.663021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:16.664878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:16.668917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:16.669656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:16.670262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:16.943524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:16.952228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:16.953668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:16.954842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-651883d1-218d-426f-b594-bd735fbacd13 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.328882 Aug 30 17:57:16.957308 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2692/5641] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:16 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:17.984531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:18.001043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:18.015030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:18.015943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:18.016550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:18.017931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:18.018558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:18.019410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:18.261851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:18.299652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:18.305263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:18.308545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f414ae0-900a-4c29-b3c8-d48baa7d3c95 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.330120 Aug 30 17:57:18.318483 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2950/5642] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:17 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:18.957987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "name": "network-vif-plugged", "status": "completed", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:18.984279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:18.988476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:18.989615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:19.021974 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] Creating event network-vif-plugged:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:57:19.036111 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ea5677f4-fe0e-4e42-ae4a-a4d739427367 req-7768d1d1-1b2d-4aa8-bfba-1b6e4560cdce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084978 Aug 30 17:57:19.042278 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2693/5643] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:19.334612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:19.335968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:19.348318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:19.352271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:19.353041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:19.354078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:19.355050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:19.356986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:19.655595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:19.672615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:19.674764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:19.680142 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bc4068b-d7ba-4882-acd5-6054decafb17 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.348885 Aug 30 17:57:19.680969 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2951/5644] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:19 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:20.708374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:20.709824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:20.723831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:20.728390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:20.729712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:20.731917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:20.733455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:20.735526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:21.490429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:21.506928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:21.510199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:21.515151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d732aa5-490c-4875-81d3-a0973cbfd029 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.811438 Aug 30 17:57:21.519675 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2694/5645] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:20 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:22.542681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:22.544262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:22.557858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:22.562003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:22.562616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:22.564281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:22.564911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:22.566692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:22.961400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:22.972311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:22.976174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:22.986124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-946ca8b5-0b14-4c4c-97f0-32f6b1cc0801 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.439181 Aug 30 17:57:22.986812 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2952/5646] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:22 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:24.013629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:24.014248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:24.054447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:24.056804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:24.057495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:24.061277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:24.061991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:24.065289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:24.472980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:24.482225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:24.490050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:24.492768 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-355edaa7-a967-4ada-b475-e2326c8fc2c0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.482958 Aug 30 17:57:24.494504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2695/5647] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:24 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:25.522173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:25.523882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:25.541109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:25.541629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:25.542458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:25.543218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:25.543724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:25.544157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:25.902967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:25.915616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:25.917098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:25.922212 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d59787d-1293-4227-8323-00978774cbc2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.405032 Aug 30 17:57:25.923314 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2953/5648] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:25 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:26.950392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:26.951017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:26.959138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:26.959665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:26.960106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:26.960826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:26.961288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:26.961718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:27.284095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Calling method '.version_select at 0x7f2d93976f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:27.286101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:27.286598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:27.287045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:27.358133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:27.358984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:27.359702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:27.386863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:27.388006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:27.389135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:27.410122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d741258-9d69-49ca-a4ac-c8e3bee0adf6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1549257282-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.423017 Aug 30 17:57:27.412288 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2954/5649] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 17:57:26 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:27.441059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:27.468343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:27.486411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:27.494489 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92ebb5bc-c835-43c9-97ea-d3689a40d252 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.548031 Aug 30 17:57:27.495885 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2696/5650] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:26 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:28.521909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:28.522562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:28.537970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:28.538634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:28.539104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:28.540507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:28.540983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:28.541425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:28.960524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:28.982523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:28.984151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:28.985430 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43309061-a998-495f-bf6f-d4509fa0041e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.470102 Aug 30 17:57:28.985965 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2955/5651] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:28 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:30.014605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:30.016196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:30.029709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:30.031405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:30.033440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:30.036025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:30.036868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:30.038490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:30.479314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:30.503200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:30.506893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:30.509477 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5bcab96d-3b95-431e-8283-5700f048f367 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.501073 Aug 30 17:57:30.510741 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2697/5652] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:30 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:31.764412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:31.765857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:31.777355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:31.781298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:31.782507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:31.786405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:31.787037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:31.787764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:32.247853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:32.257853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:32.268054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:32.270936 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d49d42c-18e5-4f57-9209-4eadcf7bcce3 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.739844 Aug 30 17:57:32.273010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2956/5653] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:31 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:33.299242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:33.303420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:33.322337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:33.323252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:33.327651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:33.328781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:33.330257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:33.331593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:33.617400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:33.637526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:33.639870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:33.646340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31245717-84f4-4d6a-9e8f-ed8c7cfcb06f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.355672 Aug 30 17:57:33.648295 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2698/5654] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:33 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:34.670908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:34.672228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:34.686566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:34.688759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:34.689407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:34.693528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:34.698738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:34.699534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:35.008924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:35.017423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:35.026450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:35.027801 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bfb62485-c055-44b4-937c-385d76509820 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.361427 Aug 30 17:57:35.028319 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2957/5655] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:34 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:36.054274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:36.054949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:36.067945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:36.068451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:36.076147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:36.079731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:36.081439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:36.082001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:36.135322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=68 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:36.298242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:36.306859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:36.313923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:36.317925 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0aed3374-4a18-43a1-8c84-476665cde585 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1740 microversion: 2.20 time: 0.267714 Aug 30 17:57:36.322101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2699/5656] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:36 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:37.351963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:37.352818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:37.359273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:37.359917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:37.360419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:37.361126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:37.361807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:37.362251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:37.364976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=86 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:37.620678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:37.635718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:37.639654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:37.640928 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-954dbc2e-fcd4-4cd9-9fd9-da1290e5bc80 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1722 microversion: 2.20 time: 0.294266 Aug 30 17:57:37.646017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2958/5657] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:37 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:37.783305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:37.784387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:37.792385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:37.792885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:37.793344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:37.794089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:37.799804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:37.804290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:37.868227 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a7adf76-93ff-4870-8e36-6a0f77fbca52 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/ips" status: 200 len: 150 microversion: 2.1 time: 0.451098 Aug 30 17:57:37.868944 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2700/5658] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 17:57:37 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/ips => generated 150 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:38.676409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:38.679681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:38.696873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:38.698907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:38.699913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:38.701126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:38.701937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:38.702072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:38.910453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:38.920795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:38.926430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:38.929663 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62eb498e-05ae-42a7-a435-84c8e38331c5 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1722 microversion: 2.20 time: 0.263299 Aug 30 17:57:38.934780 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2959/5659] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:38 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:39.966536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:39.968008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:39.986678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.990125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.996105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:39.997115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.997593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.998034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:40.229211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:40.239943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:40.242180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:40.248569 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9076ea1-5d25-43bf-9ae2-b91e0e2fb09f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1665 microversion: 2.20 time: 0.284642 Aug 30 17:57:40.267693 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2701/5660] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:39 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1665 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:40.274758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63273230-3d86-49c3-b3aa-dca3e3587a01"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:40.277273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:40.294533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:40.295044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:40.295517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:40.303615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:40.304180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:40.304643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:40.496066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "175ff6e4-48f5-4947-9eb9-34f00137585a"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:40.498518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:40.509878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:40.510359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:40.510803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:40.511528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:40.511980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:40.512400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:40.916865 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d8f97eab-551f-42fb-9519-65ecbebb319b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.647672 Aug 30 17:57:40.918152 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2960/5661] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 30 17:57:40 2022] POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments => generated 188 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:57:41.160415 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8848bf84-8389-4772-9410-e99ea5cd1bdd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "POST /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668931 Aug 30 17:57:41.178831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:41.180097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:41.189828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:41.190442 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2702/5662] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 17:57:40 2022] POST /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:57:41.194631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:41.196117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:41.196995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:41.198749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:41.200352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:41.832987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "name": "network-vif-unplugged", "status": "completed", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:41.876720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:41.880087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:41.880544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:41.915586 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17f17b01-6289-4dc2-ada3-61be4aae5ff0 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments/63273230-3d86-49c3-b3aa-dca3e3587a01" status: 202 len: 0 microversion: 2.20 time: 0.747441 Aug 30 17:57:41.919507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2961/5663] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 30 17:57:41 2022] DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments/63273230-3d86-49c3-b3aa-dca3e3587a01 => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:57:41.936073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.compute.server_external_events [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] Unable to find a host for instance 20ecc66c-a659-433d-90f8-1916b50392e8. Dropping event network-vif-unplugged {{(pid=122123) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 17:57:41.937209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-737e5992-6c1c-4a51-b0d5-2a92ba2b709b req-d2d48467-abc6-4f80-92d2-d3082d94272a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.626768 Aug 30 17:57:41.937860 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2703/5664] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 628 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 17:57:42.051270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:57:42.052354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:42.064241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:42.068194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:42.068816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:42.069739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:42.071385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:42.072624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:42.178732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122124) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 17:57:42.369255 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b29b1872-e890-49d2-8400-cdcbf930d353 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/action" status: 202 len: 0 microversion: 2.20 time: 0.322648 Aug 30 17:57:42.370637 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2962/5665] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 17:57:42 2022] POST /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:57:42.379823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:42.380578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:42.403917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:42.404463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:42.404916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:42.405650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:42.406127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:42.416914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:43.071398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:43.104471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:43.106916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:43.135865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-766b9702-48a5-4199-a418-74a4450545c2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1673 microversion: 2.20 time: 0.735164 Aug 30 17:57:43.136745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2704/5666] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:42 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1673 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:44.187021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:44.191722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:44.211065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:44.249156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:44.251278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:44.251839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:44.252597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:44.253065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:44.260968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:44.707794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:44.731083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:44.743451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:44.744983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7182642c-1dda-4605-b895-c8768da15f7d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1675 microversion: 2.20 time: 0.586766 Aug 30 17:57:44.745992 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2963/5667] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:44 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1675 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:45.775185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:45.776432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:45.786063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=28 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:57:45.787967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:45.791999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:45.792653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:45.803913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:45.804576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:45.805719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:46.254622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:46.284598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:46.286317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:46.289803 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61d9757b-e4e6-4af1-9733-89d2498944d2 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.519646 Aug 30 17:57:46.290393 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2705/5668] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:45 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:47.324174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:47.324906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:47.342505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:47.343007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:47.343452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:47.347410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:47.349159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:47.352200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:47.854885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:47.870188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:47.874190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:47.878253 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-243df0a9-1df4-4a03-a797-bbe17db1f7a9 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.563870 Aug 30 17:57:47.885034 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2964/5669] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:47 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:48.910845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:48.912336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:48.933843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:48.935888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:48.936354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:48.944451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:48.945239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:48.946394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:49.397974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:49.417045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:49.433495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:49.436488 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd4abb90-50e6-40e5-83f3-fee400d72551 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.531253 Aug 30 17:57:49.444780 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2706/5670] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:48 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:50.472807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:50.474854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:50.508073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:50.508899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:50.509361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:50.513939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:50.514429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:50.514871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:51.060504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:51.089769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:51.091238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:51.098209 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee87901c-4beb-4aa0-89db-5e0a5080b165 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.629717 Aug 30 17:57:51.101741 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2965/5671] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:50 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:52.139781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:52.143361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:52.160151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:52.161130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:52.162539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:52.163510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:52.166138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:52.167460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:52.771522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:52.780367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:52.784783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:52.788763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6069877e-d477-4e45-a371-a49eb9941aa8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.662299 Aug 30 17:57:52.792970 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2707/5672] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:52 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:53.822718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:53.823444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:53.862278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:53.864241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:53.864951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:53.866053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:53.869727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:53.870432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:55.538368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:55.558322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:55.571437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:55.574689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-acf88752-0b00-4ca1-903e-755bc6e4bb8e tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 1.756625 Aug 30 17:57:55.577790 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2966/5673] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:53 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:56.606805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:56.612992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:56.636388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:56.637682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:56.639060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:56.641494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:56.644324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:56.646510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:57.126090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:57.150651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:57.158245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:57.162275 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82f81853-7132-4e67-a5f9-d0720fe28d38 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.561989 Aug 30 17:57:57.186127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2708/5674] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:56 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:58.194306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:58.195523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:58.212243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:58.218477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:58.219156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:58.226060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:58.229138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:58.231237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:58.718677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:58.734447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:58.738120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:57:58.745188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62eb16c5-01c9-4100-b296-5e19f6ff0c23 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.556184 Aug 30 17:57:58.760726 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2967/5675] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:58 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:57:59.774367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:59.774964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:57:59.786151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:59.787695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:59.788973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:59.789875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:59.790684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:59.791906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:00.052033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:00.061640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:00.063081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:00.077114 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61a381ee-1c22-43eb-93e8-f1e5093fb078 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.294855 Aug 30 17:58:00.082997 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2709/5676] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:57:59 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:00.891076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:00.892186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:00.906126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:00.907818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:00.908655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:00.909468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:00.909940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:00.910378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:00.931717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:01.023331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'services' on Instance uuid 488e94eb-fcaf-499b-af30-f847eb11b95f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:58:01.113307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:01.115638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:01.124370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b70ef3d0-6388-4b2e-a44f-be7bd45fd247 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments/175ff6e4-48f5-4947-9eb9-34f00137585a" status: 202 len: 0 microversion: 2.1 time: 0.237178 Aug 30 17:58:01.130238 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2968/5677] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 17:58:00 2022] DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments/175ff6e4-48f5-4947-9eb9-34f00137585a => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:58:01.139351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:01.143967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:01.144983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:01.145797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:01.146474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:01.147827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:01.148527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:01.149160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:01.152681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:01.153297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:01.154406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:01.155794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:01.156499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:01.157298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:01.203323 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7758122-b1d7-439f-892e-98f35459b463 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070799 Aug 30 17:58:01.205418 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2969/5678] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:01 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:01.581129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:01.592288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:01.600465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:01.602056 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4cf22759-74b0-4bfb-ad01-87e62296cf1b tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.501513 Aug 30 17:58:01.602902 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2710/5679] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:01 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:58:02.218216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:02.221332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:02.237186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:02.248673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:02.249503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:02.250487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:02.251286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:02.251934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:02.372361 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04ee3604-eb17-4632-b65c-26110c1a6dcd tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158309 Aug 30 17:58:02.375618 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2970/5680] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:02 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:02.628175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:02.629469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:02.642860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:02.648479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:02.649191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:02.650624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:02.652245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:02.653400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:02.982089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:03.002980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:03.010524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:03.017997 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2cd94303-acf4-4f81-907e-0fc40fd5c83f tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.390614 Aug 30 17:58:03.019329 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2711/5681] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:02 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:03.387251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:03.389582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:03.401758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:03.402079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:03.402563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:03.403272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:03.403754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:03.404182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:03.468409 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3826cc7f-f962-49d7-8ddf-17aa0856b346 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086024 Aug 30 17:58:03.476414 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2971/5682] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:03 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:04.044172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:04.044781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:04.055260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:04.059364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:04.059937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:04.060690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:04.061170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:04.061580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:04.398791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:04.408831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:04.410536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:04.412147 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dac8c9d1-528b-4a7a-9870-727f6d8138d1 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.371699 Aug 30 17:58:04.424427 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2712/5683] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:04 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:04.483211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:04.487654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:04.498941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:04.500125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:04.501102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:04.502073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:04.503505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:04.504280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:04.554347 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56793902-27f1-4b9b-a1f6-1bab1d7df61a tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077218 Aug 30 17:58:04.556666 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2972/5684] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:04 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:05.437707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:05.440505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:05.464521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:05.465453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:05.466836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:05.468973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:05.471578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:05.472142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:05.549986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "name": "network-vif-plugged", "status": "completed", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:05.573743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:05.574238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:05.575785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:05.602808 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] Creating event network-vif-plugged:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:58:05.639970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4d8c8d30-53c0-4d87-84f3-c71254345027 req-1c99b509-6904-4b98-9c69-e15ec6faa921 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095879 Aug 30 17:58:05.641151 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2973/5685] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:58:05.669829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:05.696909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:05.703286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:05.704484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:05.704930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:05.705641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:05.706092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:05.706515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:05.792443 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42c405e6-09cf-4b2b-b705-0b7c645b7af6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147363 Aug 30 17:58:05.793357 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2974/5686] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:05 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:05.844969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:05.858075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:05.865380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:05.869907 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e845a6f-c3c9-4040-84ac-5ebc1fe1987d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.436980 Aug 30 17:58:05.870722 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2713/5687] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:05 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:06.805777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:06.808442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:06.815572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:06.816361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:06.817198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:06.817981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:06.818498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:06.819127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:06.851697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71516ce4-cd80-4052-8b76-dedf9957ad30 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Aug 30 17:58:06.852368 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2975/5688] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:06 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:06.898683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:06.904126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:06.916857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:06.924901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:06.925518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:06.926538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:06.928750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:06.929237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:06.934665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:07.115674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:07.127441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:07.129636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:07.131443 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cca5b85e-21bc-4c97-ac19-9583d55e1138 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1731 microversion: 2.20 time: 0.237531 Aug 30 17:58:07.146234 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2714/5689] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:06 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:07.865718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:07.869126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:07.877993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:07.878797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:07.879235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:07.880406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:07.880827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:07.881165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:07.915440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56775683-6bd8-4bb5-ae8e-1096b7a35f40 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054204 Aug 30 17:58:07.916771 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2976/5690] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 17:58:07 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:58:07.986959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:07.987459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:07.994702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:07.995198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:07.995708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:07.996418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:07.996876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:07.997306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:08.027546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:58:08.154216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:08.156237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:08.166927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad85b09b-3002-4b68-97bf-218bdb98ea4d tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 204 len: 0 microversion: 2.1 time: 0.183242 Aug 30 17:58:08.171932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:08.172114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2715/5691] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:07 2022] DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:58:08.172300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:08.172300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:08.172300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:08.172300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:08.174235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:08.186158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:08.190879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:08.201959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:08.204009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:08.204740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:08.208401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:08.209269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:08.211132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:08.402384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:08.411936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-338d105a-c99f-4d2b-8723-021fcca4961f tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1681 microversion: 2.1 time: 0.236413 Aug 30 17:58:08.413115 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2716/5692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:08 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:08.478841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:08.491998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:08.494173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:08.495676 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eaa3344c-9619-4a5a-9988-9e83403bd7ae tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1718 microversion: 2.20 time: 0.345587 Aug 30 17:58:08.496539 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2977/5693] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:08 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1718 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 17:58:09.441483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:09.442870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:09.458178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:09.458760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:09.459933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:09.460715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:09.462370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:09.463048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:09.651207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:09.659727 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ddcfe85b-5023-475f-8704-8f504993c1e1 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1681 microversion: 2.1 time: 0.227007 Aug 30 17:58:09.662235 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2717/5694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:09 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:10.696108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:10.697844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:10.717938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:10.718673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:10.719311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:10.720289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:10.720944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:10.722668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:10.952924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:10.981672 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-418acd9d-7da0-418a-9957-751e1d6c99f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1681 microversion: 2.1 time: 0.294564 Aug 30 17:58:10.992736 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2978/5695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:10 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:11.837671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488e94eb-fcaf-499b-af30-f847eb11b95f", "name": "network-vif-deleted", "tag": "aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:11.868896 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:58:11.869552 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 17:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 30 17:58:11.905662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:11.906244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:11.908177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:11.936743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] Creating event network-vif-deleted:aa2d5fa7-dd2e-48a9-85e1-a78febf3bacd for instance 488e94eb-fcaf-499b-af30-f847eb11b95f on n-h2-852771-11 Aug 30 17:58:11.942914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e8c65268-4b7f-457f-8d2b-7b0b44ff92e6 req-77362559-dd59-4def-83b0-c05beac3a607 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111405 Aug 30 17:58:11.944262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2718/5696] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:12.011092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:12.012415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:12.023070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:12.024469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:12.025107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:12.026010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:12.026646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:12.028352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:12.080367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:12.081863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:12.082556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:12.083191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lazy-loading 'fault' on Instance uuid 488e94eb-fcaf-499b-af30-f847eb11b95f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:58:12.138834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b272d5fecd4319a2f8aad6f98912be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3453f6c52492c8a2b01d2ad96e06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:12.147947 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1196a8d-23d9-4f82-b04a-06376081164c tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 200 len: 1331 microversion: 2.1 time: 0.141909 Aug 30 17:58:12.156585 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2979/5697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:12 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:13.171126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:13.172200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:13.182799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:13.183625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:13.184335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:13.185513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:13.186262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:13.187342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:13.208788 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f HTTP/1.1 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '488e94eb-fcaf-499b-af30-f847eb11b95f'} Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:13.212004 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:13.218396 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:13.222123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:13.223196 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9f77d00f-f921-4db0-b609-aa6ad39350f4 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 404 len: 111 microversion: 2.1 time: 0.057284 Aug 30 17:58:13.224499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2719/5698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:13 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:13.237281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-246102fc-45e7-4a75-a65a-5008db082bf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '.version_select at 0x7f2d9cca9160>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:13.275022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-246102fc-45e7-4a75-a65a-5008db082bf3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091812010" status: 202 len: 0 microversion: 2.1 time: 0.044005 Aug 30 17:58:13.276477 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2980/5699] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 17:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091812010 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:58:19.601078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:19.601720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:19.615720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:19.625307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:19.626366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:19.630534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:19.633606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:19.641668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:19.642348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:19.700314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f HTTP/1.1 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '488e94eb-fcaf-499b-af30-f847eb11b95f'} Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:19.708554 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.715677 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.724732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:19.726314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7478f31f-c139-4680-a6c8-ea07b4379a9b tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 404 len: 111 microversion: 2.1 time: 0.130414 Aug 30 17:58:19.727438 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2720/5700] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:19 2022] DELETE /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:58:19.736227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:19.737658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 488e94eb-fcaf-499b-af30-f847eb11b95f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:19.755246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:19.762019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:19.763737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:19.764552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:19.766154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:19.766852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:19.767555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:19.795822 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f HTTP/1.1 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '488e94eb-fcaf-499b-af30-f847eb11b95f'} Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:19.798555 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. Aug 30 17:58:19.804830 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:19.811238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 488e94eb-fcaf-499b-af30-f847eb11b95f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:19.812499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-307b77d9-1213-4d8f-8175-28f04d4f8975 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f" status: 404 len: 111 microversion: 2.1 time: 0.081218 Aug 30 17:58:19.818765 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2981/5701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:19 2022] GET /compute/v2.1/servers/488e94eb-fcaf-499b-af30-f847eb11b95f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:25.682053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:25.682630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:25.695002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.695556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.695968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.696697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.697141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.703189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.741910 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b HTTP/1.1 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '471adb65-8648-4c0d-bb3a-ad1454364f6b'} Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:25.744611 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.750520 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.754035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:25.756319 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a58f767e-4784-46fe-8684-c007b0be5ffe tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 404 len: 111 microversion: 2.1 time: 0.078671 Aug 30 17:58:25.758440 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2721/5702] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:25 2022] DELETE /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:25.772149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:25.773308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 471adb65-8648-4c0d-bb3a-ad1454364f6b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:25.788043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.792089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.792748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.793662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.794470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.795151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.832992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b HTTP/1.1 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '471adb65-8648-4c0d-bb3a-ad1454364f6b'} Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.834640 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 471adb65-8648-4c0d-bb3a-ad1454364f6b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:25.838884 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4235b920-0957-41a3-a45c-87622c4397bc tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b" status: 404 len: 111 microversion: 2.1 time: 0.073742 Aug 30 17:58:25.851463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:25.851998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:25.856927 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2982/5703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:25 2022] GET /compute/v2.1/servers/471adb65-8648-4c0d-bb3a-ad1454364f6b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:25.862989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.863511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.864030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.864713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.865185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.865619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.901580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 HTTP/1.1 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b3881c7d-66e5-4769-8564-c78b9b2a9dc7'} Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:25.904501 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:25.909804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f11a5666-4913-4432-8023-18644d010ec6 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 404 len: 111 microversion: 2.1 time: 0.067546 Aug 30 17:58:25.910875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2722/5704] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:25 2022] DELETE /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:25.917100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:25.917739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: b3881c7d-66e5-4769-8564-c78b9b2a9dc7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:25.926857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.927368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.927854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.936491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:25.937622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:25.938098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:25.969919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 HTTP/1.1 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b3881c7d-66e5-4769-8564-c78b9b2a9dc7'} Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:25.971539 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance b3881c7d-66e5-4769-8564-c78b9b2a9dc7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:25.978153 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3bb23dcc-3dc2-42d8-9836-31389fb1c4ec tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7" status: 404 len: 111 microversion: 2.1 time: 0.064152 Aug 30 17:58:25.979972 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2983/5705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:25 2022] GET /compute/v2.1/servers/b3881c7d-66e5-4769-8564-c78b9b2a9dc7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:31.734589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:31.735751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:31.745405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:31.745897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:31.746338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:31.747044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:31.747520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:31.747950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:31.790574 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 HTTP/1.1 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8a12f5d0-5ea8-40d4-b991-7bec7808af30'} Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:31.792217 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:31.797238 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff03c0f7-507b-409a-be70-5646fb0543e3 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 404 len: 111 microversion: 2.1 time: 0.064315 Aug 30 17:58:31.802545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:31.803174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] [instance: 8a12f5d0-5ea8-40d4-b991-7bec7808af30] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:31.817524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:31.818307 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2723/5706] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:31 2022] DELETE /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:31.818464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:31.819282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:31.820159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:31.820159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:31.820476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:31.830489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:31.856513 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] HTTP exception thrown: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Request method failure captured: Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 HTTP/1.1 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5UmcUK5Fv92kiIU4e5bH7U2xOR7jIaPTHj2XA4VMtrsIZl2M4dXWyQYlCBTnh-6NXMLZ_Y2EUY5xF1SxMa8mffrHaCkpCs9w7-qjQkW2GNcyNNd9k7u97YdRINGzJQ9ovvhikKV72RurFSWGV4RQhEVOdQ5skZLJE8kT8yjF173uY Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cf3453f6c52492c8a2b01d2ad96e06a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cf3453f6c52492c8a2b01d2ad96e06a"}]}] Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2cf3453f6c52492c8a2b01d2ad96e06a Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-924991078 Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: f5b272d5fecd4319a2f8aad6f98912be Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeNegativeTest-924991078-project Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '8a12f5d0-5ea8-40d4-b991-7bec7808af30'} Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:31.858121 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. Aug 30 17:58:31.864846 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:31.866330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] Returning 404 to user: Instance 8a12f5d0-5ea8-40d4-b991-7bec7808af30 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:31.866330 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-860b92a6-ecbc-48ee-96d1-e67307deae71 tempest-AttachVolumeNegativeTest-924991078 tempest-AttachVolumeNegativeTest-924991078-project] 10.222.0.50 "GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30" status: 404 len: 111 microversion: 2.1 time: 0.067342 Aug 30 17:58:31.866847 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2984/5707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:31 2022] GET /compute/v2.1/servers/8a12f5d0-5ea8-40d4-b991-7bec7808af30 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:58:38.476070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-377704871", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "660d6fcf-9d6a-4a81-b76f-2f5226dff89e"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:38.586443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] validate_networks() for [('660d6fcf-9d6a-4a81-b76f-2f5226dff89e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:58:39.404784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:58:39.405961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:58:39.406605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:58:39.407181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:58:39.407805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:58:39.425677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.426376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.426983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.428661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.429292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.429892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.447638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:39.460710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Getting quotas for project 90d6411bdda8435f90fdc829dc215f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:58:39.467511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Getting quotas for user 4ee51d0803dc4ea8a8a8e0dc207de12d and project 90d6411bdda8435f90fdc829dc215f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:58:39.487961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:39.490563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:39.500772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.501534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.502405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.503355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.504027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.504564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.519892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:58:39.523303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:58:39.567037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6748a44a-d7e1-4e47-a423-fbbf1626bf37 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082889 Aug 30 17:58:39.568624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2985/5708] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 17:58:39 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:39.601354 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d187847-1c6d-4aa3-9560-b777532e047c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130893 Aug 30 17:58:39.602968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2724/5709] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:58:39.616079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb076ed1-e953-42c8-a0df-cf79892dcf88 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:39.617382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb076ed1-e953-42c8-a0df-cf79892dcf88 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:39.695321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:39.697261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:39.709299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.710299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.711736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.714068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.714718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.716408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.750635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:58:39.825354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb076ed1-e953-42c8-a0df-cf79892dcf88 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:39.838557 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb076ed1-e953-42c8-a0df-cf79892dcf88 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1213 microversion: 2.1 time: 0.225688 Aug 30 17:58:39.839210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2986/5710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:39 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:39.904622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e25cf7f-dd54-4096-bd96-21cb485d0578 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 204 len: 0 microversion: 2.20 time: 0.212872 Aug 30 17:58:39.910365 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2725/5711] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:58:39 2022] DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:58:39.920646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:39.922599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:39.940853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.941355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.941797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:39.942514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:39.942970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:39.943398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:40.321423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:40.336548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:40.340511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:40.343877 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60f600e7-0405-47c8-acf9-63f15285ed20 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.428139 Aug 30 17:58:40.344688 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2987/5712] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:39 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:40.875036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:40.876504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:40.897048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:40.897876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:40.898495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:40.900866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:40.901549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:40.903105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:41.132816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:41.147957 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90ea31ac-b11e-4dfa-bf50-41f5687f141e tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1217 microversion: 2.1 time: 0.280050 Aug 30 17:58:41.148575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2726/5713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:40 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:58:41.370251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:41.370875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:41.394212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:41.394711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:41.395152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:41.399999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:41.400675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:41.401307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:42.175170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:42.175814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:42.187496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:42.210530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:42.211026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:42.211467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:42.212198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:42.212654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:42.213262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:42.216921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:42.220541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:42.226283 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58c35dcb-3088-401d-8e17-df8940bb3e00 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1724 microversion: 2.20 time: 0.859816 Aug 30 17:58:42.231655 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2988/5714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:41 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1724 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:42.413956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:42.431039 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-052e1d6f-ebc0-47ad-806a-550831c0d26b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1283 microversion: 2.1 time: 0.255096 Aug 30 17:58:42.443504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2727/5715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:42 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:58:43.256055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:43.256618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:43.287122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:43.287663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:43.288296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:43.289194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:43.289826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:43.290451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:43.428145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:43.441864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:43.443408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:43.444748 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e95fd762-a944-4d51-84c9-5aff2192a8eb tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1656 microversion: 2.20 time: 0.192783 Aug 30 17:58:43.452591 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2989/5716] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:43 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1656 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:43.464888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:43.467304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:43.476444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:43.477440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:43.478426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:43.479426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:43.480527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:43.481157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:43.674610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7cdbf875-4086-44be-b9c3-c49ebe91f1bb tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d937a0430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:43.739421 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7cdbf875-4086-44be-b9c3-c49ebe91f1bb tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7041cb92-a63c-42ad-960e-cff6a3d31479" status: 200 len: 351 microversion: 2.1 time: 0.074940 Aug 30 17:58:43.741266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2990/5717] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:58:43 2022] GET /compute/v2.1/os-volumes/7041cb92-a63c-42ad-960e-cff6a3d31479 => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:58:44.382143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:44.392904 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e337a87a-fac4-4767-9cab-bf66ae4a266d tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1271 microversion: 2.1 time: 0.935579 Aug 30 17:58:44.393638 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2728/5718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:43 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1271 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:44.475401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:44.476708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:44.510343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:44.514941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:44.515876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:44.523422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:44.524177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:44.525778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:44.620348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ecc66c-a659-433d-90f8-1916b50392e8", "name": "network-vif-deleted", "tag": "fef2573b-de84-4ade-9688-55d796f55ecb"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:44.653601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:44.654572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:44.656083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:44.676116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] Creating event network-vif-deleted:fef2573b-de84-4ade-9688-55d796f55ecb for instance 20ecc66c-a659-433d-90f8-1916b50392e8 on n-h1-852771-11 Aug 30 17:58:44.703214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e49ba0db-9e05-48fc-b2a9-daedf6b6c266 req-6b799aaa-fa90-4dac-a707-32dddf6704ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086673 Aug 30 17:58:44.720704 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2729/5719] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:58:44.799095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:44.808853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:44.810642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dff3e8a1712d4dc5a7b96ddf7bae30f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a368ff1b3394dc3934a4b13ae62fc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:44.816871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d53d66dc-9019-4ff3-8016-de3c3514d8d7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 200 len: 1656 microversion: 2.20 time: 0.347866 Aug 30 17:58:44.818768 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2991/5720] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:44 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 1656 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:58:45.415266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:45.416169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:45.431252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:45.436729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:45.439466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:45.442775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:45.443722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:45.446902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:45.840322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:45.841504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:45.861614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:45.862120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:45.862770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:45.863520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:45.864154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:45.864764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:45.907229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 HTTP/1.1 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '20ecc66c-a659-433d-90f8-1916b50392e8'} Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:45.909921 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:45.915237 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee64b527-fb5e-4b6a-80c9-0dc51123b70d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 404 len: 111 microversion: 2.20 time: 0.075237 Aug 30 17:58:45.916188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2992/5721] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:45 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:58:45.925864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a787a96-8c98-4156-9f4c-e7ef18388ce7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '.version_select at 0x7f2d937a0a60>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:45.973422 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a787a96-8c98-4156-9f4c-e7ef18388ce7 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014801184" status: 204 len: 0 microversion: 2.20 time: 0.056400 Aug 30 17:58:45.977983 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2993/5722] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 17:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014801184 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 17:58:46.042081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:46.065927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f86a751a-0e6e-46a8-b566-128b246846f8 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.655299 Aug 30 17:58:46.067417 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2730/5723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:45 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:46.469152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-717059b1-a42b-4b89-a176-f0cad6e48984 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d9398daf0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:46.552147 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-717059b1-a42b-4b89-a176-f0cad6e48984 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7a299eb4-793a-498e-87a8-f5f70ee919eb" status: 200 len: 351 microversion: 2.1 time: 0.086941 Aug 30 17:58:46.552873 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2994/5724] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:58:46 2022] GET /compute/v2.1/os-volumes/7a299eb4-793a-498e-87a8-f5f70ee919eb => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:47.098558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:47.100610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:47.113326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:47.115383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:47.116463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:47.119633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:47.121967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:47.122609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:47.987850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:47.997129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78c5ed91-62bc-4056-8e96-75a76f1960c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.910604 Aug 30 17:58:48.005210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2731/5725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:47 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:48.242309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123fe509-09d1-45b6-9400-d6dcd57c8ff8", "tag": "bce41bb9-d03b-4e5f-bc08-569a3eafde43"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:48.267936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:48.268638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:48.269249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:48.297212 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] Creating event network-changed:bce41bb9-d03b-4e5f-bc08-569a3eafde43 for instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 on n-h1-852771-11 Aug 30 17:58:48.315905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-14c7546d-2ad0-4a13-8b7c-73ff260039a3 req-a00fc58c-f4b1-47ab-8582-9aed1c60f30d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075520 Aug 30 17:58:48.316579 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2995/5726] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:58:49.037214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:49.040921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:49.063809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:49.064556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:49.065236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:49.066689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:49.067370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:49.068087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:49.312677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:49.326751 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8f3c6be-fc11-4d75-9e7a-c691a77fd49f tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.302535 Aug 30 17:58:49.327638 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2732/5727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:49 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:49.505496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b39e0fe6-8adb-4610-9c15-ded9dab8a148 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d98971b80>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:49.597491 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b39e0fe6-8adb-4610-9c15-ded9dab8a148 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/933e35da-9a37-4754-bffc-84ccb1d334f7" status: 200 len: 350 microversion: 2.1 time: 0.097597 Aug 30 17:58:49.598632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2996/5728] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 17:58:49 2022] GET /compute/v2.1/os-volumes/933e35da-9a37-4754-bffc-84ccb1d334f7 => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:49.615831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0687a3d-6d4f-43be-b846-632c707b5d8d tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d9381c940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:49.655296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:49.657069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:49.777658 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0687a3d-6d4f-43be-b846-632c707b5d8d tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.168871 Aug 30 17:58:49.784778 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2733/5729] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 17:58:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:49.801158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c480b78-9130-42dc-bd3c-61691f1820ac tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d93783430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:49.833582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:50.020980 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c480b78-9130-42dc-bd3c-61691f1820ac tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224406 Aug 30 17:58:50.022145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2997/5730] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 17:58:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:50.037202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9fb62f15-4f81-4f1a-a6b7-db7535e93069 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d939d8430>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:50.231662 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9fb62f15-4f81-4f1a-a6b7-db7535e93069 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200015 Aug 30 17:58:50.234106 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2734/5731] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:50.252932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b619a64-6b7e-41d3-b43a-346188763a07 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d9cda1dc0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:50.364153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:50.364800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:50.366761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:50.404763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:50.409594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:50.415354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:50.416595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:50.419078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:50.421779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:50.491188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b619a64-6b7e-41d3-b43a-346188763a07 tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248455 Aug 30 17:58:50.492252 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2998/5732] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:50.506514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1979103-755b-4234-98a7-d3d18c0e6ccf tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d934c3040>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:50.657713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1979103-755b-4234-98a7-d3d18c0e6ccf tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155053 Aug 30 17:58:50.658312 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 2999/5733] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:58:50.677330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec751ca5-510a-447a-91f1-c77d93f5809e tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d937a0f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:50.844126 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec751ca5-510a-447a-91f1-c77d93f5809e tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.174986 Aug 30 17:58:50.844863 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3000/5734] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:58:50.858908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-390fb53c-850f-44fa-89a1-13876a0ff8cb tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d9cda19d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:51.063389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:51.075750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98b1fa4a-fd1a-43c8-b879-19916616994b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.730421 Aug 30 17:58:51.079779 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2735/5735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:58:51.174409 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-390fb53c-850f-44fa-89a1-13876a0ff8cb tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.319449 Aug 30 17:58:51.175740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3001/5736] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 30 17:58:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:51.188920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d81f2215-16fd-4bec-bf09-00971a4d5c9c tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] Calling method '.version_select at 0x7f2d9cc14a60>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:51.412911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d81f2215-16fd-4bec-bf09-00971a4d5c9c tempest-VolumesTestJSON-1951242511 tempest-VolumesTestJSON-1951242511-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.228261 Aug 30 17:58:51.413496 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2736/5737] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 17:58:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:52.099979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:52.102272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:52.115111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:58:52.133318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:52.135594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:52.137005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:52.138815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:52.140684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:52.142786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:52.956640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:52.971791 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6dbd8e5f-6d59-4410-ae21-54e3e4ab2a15 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.875727 Aug 30 17:58:52.980137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3002/5738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:52 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:53.997071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:53.997678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:54.010241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.010748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.015117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.016557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.017050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.017493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.218630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:54.219761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:54.235060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.235585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.236027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.241491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.242232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.247164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.317805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 HTTP/1.1 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '20ecc66c-a659-433d-90f8-1916b50392e8'} Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:54.321132 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.326951 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.331969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:54.336761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a390b44-04ea-4c6b-a9fe-0f34bc1955f8 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 404 len: 111 microversion: 2.20 time: 0.122886 Aug 30 17:58:54.339387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3003/5739] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:58:54 2022] DELETE /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:58:54.350403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:54.351426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: 20ecc66c-a659-433d-90f8-1916b50392e8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:54.366852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.371355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.373819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.379866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:54.380816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:54.381446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:54.401132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:54.412485 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d48da675-161e-4c21-8d6a-faff5f1ebbd2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.421849 Aug 30 17:58:54.421075 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 HTTP/1.1 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '20ecc66c-a659-433d-90f8-1916b50392e8'} Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.424375 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. Aug 30 17:58:54.429643 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:58:54.432414 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2737/5740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:53 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:54.433900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance 20ecc66c-a659-433d-90f8-1916b50392e8 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:58:54.436815 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7aae588c-c009-4b98-9f31-b08ac26f186c tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8" status: 404 len: 111 microversion: 2.20 time: 0.092641 Aug 30 17:58:54.443252 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3004/5741] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:58:54 2022] GET /compute/v2.1/servers/20ecc66c-a659-433d-90f8-1916b50392e8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 17:58:55.452624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:55.453855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:55.469807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:55.470299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:55.477768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:55.481441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:55.483269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:55.486601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:55.914013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:55.939560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-281a337b-ff8d-4dff-9263-423860a6b4f6 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.502698 Aug 30 17:58:55.939962 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2738/5742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:55 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:56.366321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123fe509-09d1-45b6-9400-d6dcd57c8ff8", "name": "network-vif-plugged", "status": "completed", "tag": "bce41bb9-d03b-4e5f-bc08-569a3eafde43"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:58:56.399935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:56.400964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:56.404739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:56.438698 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] Creating event network-vif-plugged:bce41bb9-d03b-4e5f-bc08-569a3eafde43 for instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 on n-h1-852771-11 Aug 30 17:58:56.459653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b3958700-19d2-4f1a-b11b-f3af7e84aae3 req-65d09e30-b0f5-4615-8610-38c80160e85c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086180 Aug 30 17:58:56.461046 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3005/5743] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:58:56.962534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:56.963386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:56.973824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:56.976960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:56.977809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:56.978745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:56.979973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:56.980918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:57.214844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:57.227427 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d77c733-d33b-4a0c-9b13-16455ae7d633 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1313 microversion: 2.1 time: 0.268962 Aug 30 17:58:57.242238 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2739/5744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:56 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:58.249388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:58.250039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:58.264412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:58.264745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:58.276316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:58.277355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:58.284194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:58.284890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:58.903444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:58:58.915154 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1d50743e-ed9c-41c9-8049-ac629c2f9599 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1498 microversion: 2.1 time: 0.670335 Aug 30 17:58:58.916994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3006/5745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:58:58 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1498 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:58:59.719318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:58:59.719952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:58:59.729255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:59.730445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:59.730445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:59.732152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:58:59.732721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:58:59.733304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:58:59.849517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:59:00.022082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e82a8536-7dd6-4cb4-b47c-c206d2f38858 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "DELETE /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 204 len: 0 microversion: 2.1 time: 0.308138 Aug 30 17:59:00.026065 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2740/5746] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:58:59 2022] DELETE /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:59:00.032983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:00.033794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:00.051525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.053590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.056860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.058267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.059775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.062485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.277364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:00.278266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:00.293528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.294414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.295660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.296650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.297369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.298051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.323686 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 HTTP/1.1 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0'} Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:59:00.330750 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.336242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.337211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:59:00.338207 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb9df49e-ff29-4b1e-b8e6-22a2ea63591d tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 404 len: 111 microversion: 2.20 time: 0.065178 Aug 30 17:59:00.341153 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2741/5747] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 17:59:00 2022] DELETE /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:59:00.349197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:00.354542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] [instance: c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:00.365808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.367514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.367983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.368813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:00.369823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:00.370399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:00.371307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:00.383464 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34e29da7-d39a-40a9-824a-95e1f9fca507 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1504 microversion: 2.1 time: 0.355980 Aug 30 17:59:00.384452 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3007/5748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:00 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:00.414209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] HTTP exception thrown: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Request method failure captured: Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 HTTP/1.1 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk5erUg3SYUmbJx8Q69pxXpvgTwixXrsZmXOX_Sl-gkNRYo5rYdoXXya83iIwvfxVDTBCkeXG2FAHeoa6P26qC-ynhC5OYnCxTIP91xc9yWqfYwOvnhLli8fdOnFHzNINwpPbXTpGeUbNfzuaFwyypQAsvqVa_rcQ6JrvG7DOqP3m0s Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a368ff1b3394dc3934a4b13ae62fc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a368ff1b3394dc3934a4b13ae62fc66"}]}] Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2a368ff1b3394dc3934a4b13ae62fc66 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352751670 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: dff3e8a1712d4dc5a7b96ddf7bae30f5 Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352751670-project Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0'} Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.418911 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] Returning 404 to user: Instance c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:59:00.425261 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ecb4f97-71f0-472f-a553-aae3affb2b79 tempest-AttachVolumeShelveTestJSON-1352751670 tempest-AttachVolumeShelveTestJSON-1352751670-project] 10.222.0.50 "GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0" status: 404 len: 111 microversion: 2.20 time: 0.075708 Aug 30 17:59:00.436278 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2742/5749] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 17:59:00 2022] GET /compute/v2.1/servers/c44c9ca0-2d2e-4fcb-a210-1a5ba73e2ee0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:59:01.408962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:01.409530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:01.420784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:01.421285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:01.421721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:01.422445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:01.422891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:01.423315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:02.413450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:02.429254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60c34e00-5500-41e9-9aa5-bd7d8bdd3478 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1504 microversion: 2.1 time: 1.024342 Aug 30 17:59:02.444144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3008/5750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:01 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1504 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:02.793474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123fe509-09d1-45b6-9400-d6dcd57c8ff8", "name": "network-vif-deleted", "tag": "bce41bb9-d03b-4e5f-bc08-569a3eafde43"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:02.814665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:02.817528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:02.818880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:02.825164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:02.853537 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] Creating event network-vif-deleted:bce41bb9-d03b-4e5f-bc08-569a3eafde43 for instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 on n-h1-852771-11 Aug 30 17:59:02.870703 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-cd4223be-e7d8-4a8e-8103-1995a438edeb req-215bfdd0-1a7b-4d71-a744-b55107a3622d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081380 Aug 30 17:59:02.872103 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2743/5751] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:03.454174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:03.454801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:03.477615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:03.478370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:03.480574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:03.483655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:03.485978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:03.489412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:03.588592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:03.589722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:03.590665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:03.592305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lazy-loading 'fault' on Instance uuid 123fe509-09d1-45b6-9400-d6dcd57c8ff8 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 17:59:03.674296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:03.688410 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f4cd661-d340-42ac-97a3-97d44c35e383 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 200 len: 1303 microversion: 2.1 time: 0.239252 Aug 30 17:59:03.692723 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3009/5752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:03 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:04.715154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:04.715810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 123fe509-09d1-45b6-9400-d6dcd57c8ff8] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:04.726847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:04.727332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:04.727792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:04.738963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:04.739586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:04.740039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:04.784865 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] HTTP exception thrown: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Request method failure captured: Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 HTTP/1.1 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDk_LbLN_QlA6eO8O31Ppovj2Fx9nfmWnDFRlWScapzU0EYOb1l86ERG5Wx3NpF0iFm_SvIp9m-QAPeFPgGsS2h6n7hhOpdvvi8EwPkhynzk-nJ_XHlqtJx_L86RF8hougLne6_KBedFHV_7E__wNXVs_rYnREdGrXENEwg7aWdDwXvs Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 90d6411bdda8435f90fdc829dc215f7b Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-VolumesActionsTest-318869521 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90d6411bdda8435f90fdc829dc215f7b"}]}] Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-VolumesActionsTest-318869521 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 90d6411bdda8435f90fdc829dc215f7b Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-VolumesActionsTest-318869521 Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-VolumesActionsTest-318869521-project Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4ee51d0803dc4ea8a8a8e0dc207de12d Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-VolumesActionsTest-318869521-project Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '123fe509-09d1-45b6-9400-d6dcd57c8ff8'} Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:04.786569 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Returning 404 to user: Instance 123fe509-09d1-45b6-9400-d6dcd57c8ff8 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02506322-8a72-459b-b1b1-ef459c828ed2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8" status: 404 len: 111 microversion: 2.1 time: 0.081602 Aug 30 17:59:04.791894 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2744/5753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:04 2022] GET /compute/v2.1/servers/123fe509-09d1-45b6-9400-d6dcd57c8ff8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:59:05.021234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-502665831", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "660d6fcf-9d6a-4a81-b76f-2f5226dff89e"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:05.143436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] validate_networks() for [('660d6fcf-9d6a-4a81-b76f-2f5226dff89e', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 17:59:06.733941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:59:06.735842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:59:06.735842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:59:06.735842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:59:06.736573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:59:06.754127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:06.757090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:06.759295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:06.761248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:06.761829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:06.762274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:06.828648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Getting quotas for project 90d6411bdda8435f90fdc829dc215f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:59:06.848860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Getting quotas for user 4ee51d0803dc4ea8a8a8e0dc207de12d and project 90d6411bdda8435f90fdc829dc215f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:59:06.893823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:59:06.900381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:59:07.015274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d148ba29-7255-47bc-b5a2-37867c1c0d49 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999513 Aug 30 17:59:07.022144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3010/5754] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 17:59:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:59:07.034241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b86a97e8-b066-48e7-be8d-159ddd7b39c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:07.034892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b86a97e8-b066-48e7-be8d-159ddd7b39c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:07.180039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b86a97e8-b066-48e7-be8d-159ddd7b39c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:07.200407 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b86a97e8-b066-48e7-be8d-159ddd7b39c1 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1213 microversion: 2.1 time: 0.167060 Aug 30 17:59:07.202237 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2745/5755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:07 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:08.227161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:08.235115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:08.262547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:08.264101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:08.264911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:08.265897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:08.266690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:08.269280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:08.404225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:08.417297 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06b0a122-f592-426a-9f0a-04c03eb08966 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1265 microversion: 2.1 time: 0.197762 Aug 30 17:59:08.418307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3011/5756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:08 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:09.441341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:09.442150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:09.460075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:09.461228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:09.461951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:09.463067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:09.463858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:09.465024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:09.619615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:09.637563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-918cb3b3-c68b-4247-bdd0-b853b019e948 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1271 microversion: 2.1 time: 0.201571 Aug 30 17:59:09.643821 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2746/5757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:09 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:10.665963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:10.666607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:10.691582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:10.695116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:10.695755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:10.700124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:10.702044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:10.703002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:10.711196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=82 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:11.043769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:11.058838 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b240e6dc-a5db-4d0d-b41b-b7db1ec60c86 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.400568 Aug 30 17:59:11.060943 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3012/5758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:10 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:12.084053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:12.084508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:12.092090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:12.092949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:12.093395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:12.094095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:12.094712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:12.095333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:12.251096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d29037-53c3-4d22-8483-14b159c995dc", "tag": "f8d869d9-5d44-4093-b7ef-be3e4f3daac5"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:12.268287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:12.268763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:12.269384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:12.290041 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] Creating event network-changed:f8d869d9-5d44-4093-b7ef-be3e4f3daac5 for instance 23d29037-53c3-4d22-8483-14b159c995dc on n-h1-852771-11 Aug 30 17:59:12.295564 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7e073cae-3b2e-4c11-ba2b-e0af03c43295 req-8f2ceb7c-b47e-4033-a8a0-92eae1a75627 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048329 Aug 30 17:59:12.296663 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3013/5759] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:59:12.508742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:12.521160 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-def35d3b-f329-4d15-aa5d-4f2d313c88a2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.441824 Aug 30 17:59:12.522367 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2747/5760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:12 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:13.549984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:13.550762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:13.565038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:13.565538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:13.566447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:13.567456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:13.568561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:13.569164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:14.114150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:14.124430 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88bac8f3-8f46-46d5-81d2-644279c3b5cb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.580850 Aug 30 17:59:14.138821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3014/5761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:13 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:15.150049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:15.150783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:15.169573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:15.171178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:15.172427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:15.176447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:15.177110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:15.177746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:15.605724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:15.614338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ebba1223-8592-4709-8863-bc5045b64e3b tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.470848 Aug 30 17:59:15.629907 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2748/5762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:15 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:16.640371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:16.641865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:16.664329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:16.665034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:16.666841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:16.668558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:16.670471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:16.671106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:16.793049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:16.870700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:16.996444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:17.005714 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e1fa7abc-828f-46c0-b7e1-1f09bdb56cc2 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.373946 Aug 30 17:59:17.006315 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3015/5763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:16 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:17.446699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d29037-53c3-4d22-8483-14b159c995dc", "name": "network-vif-plugged", "status": "completed", "tag": "f8d869d9-5d44-4093-b7ef-be3e4f3daac5"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:17.464367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:17.478985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:17.479597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:17.482084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:17.512248 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] Creating event network-vif-plugged:f8d869d9-5d44-4093-b7ef-be3e4f3daac5 for instance 23d29037-53c3-4d22-8483-14b159c995dc on n-h1-852771-11 Aug 30 17:59:17.524062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-dbdcf764-c425-47f5-9018-f393ad535e2b req-aab8e131-dbd9-439c-b498-d470a6fb5878 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081098 Aug 30 17:59:17.524907 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2749/5764] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:18.029902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:18.030583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:18.049505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:18.050212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:18.052601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:18.055393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:18.056033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:18.058467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:18.286711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:18.297999 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-635a18a0-3094-40d9-8446-cd1e89dd8d33 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1313 microversion: 2.1 time: 0.273516 Aug 30 17:59:18.299068 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3016/5765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:18 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:19.324700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:19.326303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:19.341251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:19.343299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:19.343876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:19.346399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:19.347168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:19.348435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:19.587540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:19.597828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2f50866-aa78-42c5-8c48-2b4b4a9a97ba tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1497 microversion: 2.1 time: 0.279214 Aug 30 17:59:19.598424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2750/5766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:19 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:20.193359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:20.193858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:20.204188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:20.206400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:20.206817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:20.207800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:20.211736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:20.212634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:20.246393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:59:20.383190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b75a507-577d-41fb-abff-25f993c2f7cf tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "DELETE /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 204 len: 0 microversion: 2.1 time: 0.193977 Aug 30 17:59:20.384113 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3017/5767] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 17:59:20 2022] DELETE /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:59:20.396876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:20.397673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:20.406583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:20.407078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:20.408357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:20.409637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:20.410112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:20.411118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:20.574473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:20.583986 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a75fab17-0425-4ebd-ae7c-66e192080e1c tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1503 microversion: 2.1 time: 0.192016 Aug 30 17:59:20.585138 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2751/5768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:20 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:21.609063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:21.610627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:21.617795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:21.618306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:21.618954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:21.619910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:21.620365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:21.620791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:21.771247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee51d0803dc4ea8a8a8e0dc207de12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6411bdda8435f90fdc829dc215f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:59:21.786572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ca79e29-8360-424a-a872-b07a2c587782 tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 200 len: 1503 microversion: 2.1 time: 0.184051 Aug 30 17:59:21.787431 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3018/5769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:21 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:22.255228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d29037-53c3-4d22-8483-14b159c995dc", "name": "network-vif-deleted", "tag": "f8d869d9-5d44-4093-b7ef-be3e4f3daac5"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:22.283163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:22.285212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:22.286227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:22.286978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:22.303644 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] Creating event network-vif-deleted:f8d869d9-5d44-4093-b7ef-be3e4f3daac5 for instance 23d29037-53c3-4d22-8483-14b159c995dc on n-h1-852771-11 Aug 30 17:59:22.314368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a90dbdb6-0230-4dc7-bbe4-3d75397989a3 req-a0b61923-ded6-477a-a4a3-a072ca68a9de service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062683 Aug 30 17:59:22.315603 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2752/5770] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 17:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:22.810014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:22.820209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] [instance: 23d29037-53c3-4d22-8483-14b159c995dc] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:59:22.823353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:22.831517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:22.832079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:22.832458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:22.837431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:59:22.837912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:59:22.838414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:59:22.859506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] HTTP exception thrown: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Request method failure captured: Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc HTTP/1.1 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDk_LbLN_QlA6eO8O31Ppovj2Fx9nfmWnDFRlWScapzU0EYOb1l86ERG5Wx3NpF0iFm_SvIp9m-QAPeFPgGsS2h6n7hhOpdvvi8EwPkhynzk-nJ_XHlqtJx_L86RF8hougLne6_KBedFHV_7E__wNXVs_rYnREdGrXENEwg7aWdDwXvs Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 90d6411bdda8435f90fdc829dc215f7b Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesActionsTest-318869521 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90d6411bdda8435f90fdc829dc215f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90d6411bdda8435f90fdc829dc215f7b"}]}] Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesActionsTest-318869521 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 90d6411bdda8435f90fdc829dc215f7b Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesActionsTest-318869521 Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesActionsTest-318869521-project Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4ee51d0803dc4ea8a8a8e0dc207de12d Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesActionsTest-318869521-project Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '23d29037-53c3-4d22-8483-14b159c995dc'} Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:59:22.861541 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] Returning 404 to user: Instance 23d29037-53c3-4d22-8483-14b159c995dc could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3b0b77f-f521-4aa1-b154-ce4f05cd8edb tempest-VolumesActionsTest-318869521 tempest-VolumesActionsTest-318869521-project] 10.222.0.50 "GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc" status: 404 len: 111 microversion: 2.1 time: 0.057605 Aug 30 17:59:22.866405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3019/5771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 17:59:22 2022] GET /compute/v2.1/servers/23d29037-53c3-4d22-8483-14b159c995dc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:00:17.568018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=37 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:17.972147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Action: 'create', calling method: .version_select at 0x7f2d939b4820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1027184064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/AZ534+yZWGVSdmydfOzlKDd4x4vDi6gj+tu4ct1+6GaTr2VtM/W8r1pAS8j/oNguPxnWqo6uW+fIUUyEhNqaZPitqEGQCi9+O0gQhwaQFjKyeaZMIt7jgN9Px7GYBYA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:17.990955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for project ddb785e83ad64b6994df481c4f1137ba. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:00:17.998133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for user ce23db53e16b41c9b2b5d162e342a4c2 and project ddb785e83ad64b6994df481c4f1137ba. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:00:18.016513 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:00:19.023738 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47800. Aug 30 18:00:19.048162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3f5d87f9-b287-48db-89da-95a24555dc55 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.481680 Aug 30 18:00:19.050389 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2753/5772] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:00:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:32.791759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1964230723-access_point-1394488737", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "ea0362ea-97f3-4b80-9ec8-3fc4caaab334"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1027184064", "security_groups": [{"name": "tempest-secgroup_access--1826969091"}, {"name": "tempest-secgroup_general--735010146"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:32.816293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:32.817823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:33.028529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] validate_networks() for [('ea0362ea-97f3-4b80-9ec8-3fc4caaab334', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:00:34.119139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:00:34.121602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:00:34.122127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:00:34.122554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:00:34.122978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:00:34.145583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:34.146547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:34.147341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:34.148212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:34.153342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:34.154646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:34.204722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for project ddb785e83ad64b6994df481c4f1137ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:00:34.221295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for user ce23db53e16b41c9b2b5d162e342a4c2 and project ddb785e83ad64b6994df481c4f1137ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:00:34.259216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:00:34.262234 n-d-852771-11 devstack@n-api.service[122124]: WARNING nova.utils [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1964230723-access_point-1394488737 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1964230723-ac Aug 30 18:00:34.267905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:00:34.361404 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-788ad43e-802a-4f5a-8c81-074f4a46bf4d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.574405 Aug 30 18:00:34.362475 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3020/5773] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:00:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:00:34.371597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:34.373330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:34.377990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5720ec8-698c-4a81-a0ce-96a80aa3737d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:34.378729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5720ec8-698c-4a81-a0ce-96a80aa3737d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:34.502655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5720ec8-698c-4a81-a0ce-96a80aa3737d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:34.511009 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5720ec8-698c-4a81-a0ce-96a80aa3737d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1295 microversion: 2.1 time: 0.141214 Aug 30 18:00:34.516281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2754/5774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:34 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:35.536521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:35.537164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:35.546229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:35.547026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:35.547707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:35.548640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:35.549298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:35.549928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:35.700982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:35.718730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc49fcdb-8d0b-407f-b6b4-6972b0792e59 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1299 microversion: 2.1 time: 0.185447 Aug 30 18:00:35.723249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3021/5775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:35 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:36.746723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:36.747364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:36.772755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:36.773515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:36.774693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:36.775707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:36.776326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:36.776926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:36.935110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:36.962767 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2042f489-2086-40e7-bf3e-169d33478ae6 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1353 microversion: 2.1 time: 0.223815 Aug 30 18:00:36.964740 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2755/5776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:36 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:37.987102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:37.988488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:38.003632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:38.004450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:38.005066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:38.005976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:38.006607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:38.007209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:38.098120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:38.109682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4972498-c128-4583-bfbc-cd120b423f93 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1353 microversion: 2.1 time: 0.127332 Aug 30 18:00:38.110806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3022/5777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:37 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:39.132631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:39.133990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:39.146876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:39.148578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:39.150951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:39.152075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:39.152682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:39.161807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:40.027094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:40.044636 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06f300d7-a090-4619-b223-bcc2208d84c5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.914234 Aug 30 18:00:40.046171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2756/5778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:39 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:41.071173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:41.072458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:41.087748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:41.088734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:41.089181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:41.091241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:41.094677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:41.095636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:41.172983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f63-9d06-4d48-8c08-252ef5f7ee25", "tag": "e4ccf6da-a47a-4607-b540-30e9fbc25471"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:41.199421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:41.199973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:41.200412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:41.253321 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] Creating event network-changed:e4ccf6da-a47a-4607-b540-30e9fbc25471 for instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 on n-h2-852771-11 Aug 30 18:00:41.283360 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ab1897d9-d73c-40aa-a8b6-c3fc79694a70 req-81d3e855-8260-4f2e-9247-d65a703f49a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114156 Aug 30 18:00:41.284313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2757/5779] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:41.489918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:41.500175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c042d91-51a9-470a-8548-c3407665fc81 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.435715 Aug 30 18:00:41.501313 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3023/5780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:41 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:42.526948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:42.528458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:42.539830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:42.540993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:42.541793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:42.543407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:42.544201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:42.545064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:42.965035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:42.976052 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1b4cca11-1658-490f-92ee-b67cd51a235b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.456350 Aug 30 18:00:42.981203 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2758/5781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:42 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:44.057247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:44.061343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:44.081982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:44.083779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:44.084462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:44.086741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:44.087946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:44.088599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:44.174486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:44.239758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:44.445309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:44.458756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee602612-6044-4f5b-8983-263af7c71399 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.445537 Aug 30 18:00:44.461251 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3024/5782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:44 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:45.482115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:45.482732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:45.491751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:45.510844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:45.512479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:45.514437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:45.516350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:45.519931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:45.520689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:46.156611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:46.166032 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-986d167a-df55-4849-b027-6e5e0043d144 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.687775 Aug 30 18:00:46.170619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2759/5783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:45 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:00:46.797159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab0f63-9d06-4d48-8c08-252ef5f7ee25", "name": "network-vif-plugged", "status": "completed", "tag": "e4ccf6da-a47a-4607-b540-30e9fbc25471"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:46.818196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:46.818951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:46.819826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:46.834993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] Creating event network-vif-plugged:e4ccf6da-a47a-4607-b540-30e9fbc25471 for instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 on n-h2-852771-11 Aug 30 18:00:46.874577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e111ba60-e2b8-4939-a779-e76cd8edc11d req-5078a1ff-c701-40f5-b736-ea0b90a174cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062526 Aug 30 18:00:46.876017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3025/5784] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:47.190837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:47.192260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:47.207979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:47.208741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:47.209400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:47.212372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:47.223219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:47.224157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:47.472897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:47.482842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a6b2ed0-5df4-467d-8ee4-5761b681a4b5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1472 microversion: 2.1 time: 0.295413 Aug 30 18:00:47.484150 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2760/5785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:47 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:48.511619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:48.518449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:48.527769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:48.528808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:48.529505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:48.530476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:48.531211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:48.531915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:48.932953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:48.942538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d37645d5-09b8-444d-a6af-9d89cf387ea8 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1644 microversion: 2.1 time: 0.441833 Aug 30 18:00:48.956159 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3026/5786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:48 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1644 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:48.968978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:48.970283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:48.979736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:48.981428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:48.982627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:48.983542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:48.984008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:48.984445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:49.300028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:00:49.312660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57007ef1-aa93-4fe6-b6ef-8d2e4a2b55ce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1644 microversion: 2.1 time: 0.349358 Aug 30 18:00:49.313371 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2761/5787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:48 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1644 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:49.332779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:49.333437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:00:49.340565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:49.341171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:49.341473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:49.342839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:49.344214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:49.344822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:49.864241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c4ad5e7e-6e97-438c-95d9-3a323037ec96 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1797 microversion: 2.1 time: 0.533905 Aug 30 18:00:49.883660 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3027/5788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:00:49 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1797 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:53.761913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f63-9d06-4d48-8c08-252ef5f7ee25", "tag": "e4ccf6da-a47a-4607-b540-30e9fbc25471"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:53.789217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:00:53.789629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:00:53.793667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:00:53.827963 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] Creating event network-changed:e4ccf6da-a47a-4607-b540-30e9fbc25471 for instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 on n-h2-852771-11 Aug 30 18:00:53.843827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-aab76c13-a2c6-40c3-98e4-7cbf61ef54fd req-4c19285c-4b66-418f-a182-b111a811b674 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085293 Aug 30 18:00:53.850924 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2762/5789] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:01.962715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:01.963933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=40 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:01.968576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1405993215", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:02.229000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:01:02.637565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:01:02.638169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:01:02.639216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:01:02.639818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:01:02.640238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:01:02.657079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:02.657586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:02.658063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:02.658846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:02.659308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:02.659992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:02.681492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Getting quotas for project 6aad81367c3e4354bd1e83d30118ba63. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:01:02.687364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Getting quotas for user 7c1dad274a93492482506126509c5da1 and project 6aad81367c3e4354bd1e83d30118ba63. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:01:02.702679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:01:02.705255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:01:02.756249 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9ae20e23-e0b2-4e8a-95f1-da85040f0a3d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796184 Aug 30 18:01:02.758073 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3028/5790] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:01:02.770652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d535cc3-614c-45d2-bad4-da82f689deef tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:02.772048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d535cc3-614c-45d2-bad4-da82f689deef tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:02.852637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d535cc3-614c-45d2-bad4-da82f689deef tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:02.860172 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d535cc3-614c-45d2-bad4-da82f689deef tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1214 microversion: 2.1 time: 0.094730 Aug 30 18:01:02.861010 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2763/5791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:02 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:01:03.884585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:03.885364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:03.892838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:03.893347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:03.893780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:03.894673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:03.895249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:03.895714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:04.155461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:04.166828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee28cfb8-cc65-4ce5-b137-ee5189ceb7be tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1274 microversion: 2.1 time: 0.288384 Aug 30 18:01:04.168464 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3029/5792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:03 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:05.192444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:05.193756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:05.199514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=40 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:05.201328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=25 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:05.209509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:05.210866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:05.211513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:05.213143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:05.213761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:05.214545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:05.868544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:05.876531 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e02cec6e-be8b-4313-a5b8-f0e7a806d68a tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.688300 Aug 30 18:01:05.877994 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2764/5793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:05 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:06.798852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b946bbc-d861-465c-918d-c9694147109f", "tag": "a1a67a5b-1676-47a9-a801-e94a1527550d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:06.812216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:06.812698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:06.813128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:06.837175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] Creating event network-changed:a1a67a5b-1676-47a9-a801-e94a1527550d for instance 0b946bbc-d861-465c-918d-c9694147109f on n-h1-852771-11 Aug 30 18:01:06.842929 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b2451253-1667-40ec-8e61-d98ea67ce73b req-1fb827e9-46c2-4db2-ae89-560f7f9d149b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047707 Aug 30 18:01:06.844071 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3030/5794] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:01:06.900252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:06.900973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:06.914537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:06.915316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:06.916338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:06.917331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:06.917875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:06.918504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:07.171943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:07.180914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-659d46bf-9cf0-4822-8707-f8be92c24e1e tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.286150 Aug 30 18:01:07.195315 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2765/5795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:06 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:08.204973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:08.206367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:08.217965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:08.218491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:08.218930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:08.219685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:08.220291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:08.220981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:08.380819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:08.389949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-adbdd7d4-2c1b-4a02-9aaa-88dbfb9da804 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.191786 Aug 30 18:01:08.403342 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3031/5796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:08 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:09.412577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:09.414291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:09.422640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:09.423349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:09.424102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:09.425336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:09.426002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:09.426587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:09.653602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:09.670295 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91c6602e-8360-43dd-bf2f-dd6fed1ecbff tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.259796 Aug 30 18:01:09.671616 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2766/5797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:09 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:10.694724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:10.695988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:10.704564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:10.705295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:10.705739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:10.706466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:10.707016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:10.707732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:10.939415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:10.954335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-940522c6-05a2-4f5e-afec-be6a59a081e0 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.263947 Aug 30 18:01:10.955180 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3032/5798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:10 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:11.858359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b946bbc-d861-465c-918d-c9694147109f", "name": "network-vif-plugged", "status": "completed", "tag": "a1a67a5b-1676-47a9-a801-e94a1527550d"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:11.879927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:11.881552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:11.882223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:11.906795 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] Creating event network-vif-plugged:a1a67a5b-1676-47a9-a801-e94a1527550d for instance 0b946bbc-d861-465c-918d-c9694147109f on n-h1-852771-11 Aug 30 18:01:11.918126 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3f3015b0-f11f-41e1-811a-3ac7845f2d02 req-00b5a1df-e791-4502-a13f-fe63f7d18200 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065114 Aug 30 18:01:11.919826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2767/5799] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:11.976293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:11.977134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:11.984175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:11.984939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:11.985457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:11.986250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:11.986792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:11.987299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:12.254905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:12.263948 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a3350b7b-27f4-4ea6-911c-3d45b91cf3b6 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1314 microversion: 2.1 time: 0.292402 Aug 30 18:01:12.267352 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3033/5800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:11 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:13.289506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:13.300789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:13.304163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:13.314046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:13.314558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:13.314978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:13.315723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:13.316345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:13.316952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:13.628319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:13.637408 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d805a17-259a-401a-a275-62447e5a1285 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1464 microversion: 2.1 time: 0.350229 Aug 30 18:01:13.638009 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2768/5801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:13 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:13.666139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8b2e47d-126e-446a-80a5-9ae51c40081e", "device": "/dev/sdb"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:13.669414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:13.671505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:13.672517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:13.680872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:13.681288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:13.681734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:13.682453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:13.683082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:13.683534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:13.969446 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4cee9060-76cb-4949-820f-2265f20d7064 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "POST /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309438 Aug 30 18:01:13.970279 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3034/5802] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:01:13 2022] POST /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:33.320957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-220144241", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "e981781e-b4da-4787-bc51-f602100075ab"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1027184064", "security_groups": []}, "os:scheduler_hints": {"different_host": ["10ab0f63-9d06-4d48-8c08-252ef5f7ee25"]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:33.334870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:33.336311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=26 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:33.400133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] validate_networks() for [('e981781e-b4da-4787-bc51-f602100075ab', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:01:34.436602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:01:34.437739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:01:34.438378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:01:34.439225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:01:34.439822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:01:34.456134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:34.456815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:34.457510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:34.458998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:34.459916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:34.460858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:34.491293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for project ddb785e83ad64b6994df481c4f1137ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:01:34.498041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Getting quotas for user ce23db53e16b41c9b2b5d162e342a4c2 and project ddb785e83ad64b6994df481c4f1137ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:01:34.513727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:01:34.516386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:01:34.601019 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [f9df973d-861f-4e29-940c-012f33e6b0e4] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:01:35.611724 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [f9df973d-861f-4e29-940c-012f33e6b0e4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49432. Aug 30 18:01:35.617005 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e35848f-9b2a-4854-8f7c-15e8da66fb2a tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.301309 Aug 30 18:01:35.631082 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2769/5803] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:01:33 2022] POST /compute/v2.1/servers => generated 361 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:01:35.635643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:35.637720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:35.648861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e88bc39-7534-42a3-b91d-1c757c07e2f2 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:35.662332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e88bc39-7534-42a3-b91d-1c757c07e2f2 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:35.862732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0e88bc39-7534-42a3-b91d-1c757c07e2f2 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:35.878331 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e88bc39-7534-42a3-b91d-1c757c07e2f2 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1241 microversion: 2.1 time: 0.245573 Aug 30 18:01:35.891867 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3035/5804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:35 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1241 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:36.909806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:36.910458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:36.929135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:36.929855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:36.930460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:36.931178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:36.931797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:36.932354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:37.171283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:37.183916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bdaf3b5f-9865-4c71-a287-e7046ee49cce tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1237 microversion: 2.1 time: 0.276351 Aug 30 18:01:37.185414 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2770/5805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:36 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1237 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:38.207786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:38.209595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:38.218646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:38.219442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:38.227767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:38.229041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:38.229489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:38.229925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:38.391389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:38.406545 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f4e48f05-8f77-4925-a0c5-a8b4e88c5089 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.202601 Aug 30 18:01:38.407667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3036/5806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:38 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:39.428696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.430027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:39.437386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:39.438131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:39.438788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:39.439788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:39.440453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:39.441101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:39.570935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:39.583840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5b85c14-306e-4320-a4b8-b0c2eb9f59f5 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.158325 Aug 30 18:01:39.588062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2771/5807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:39 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:39.892416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8688a13-549d-4374-a3b5-57e05ba40f98", "tag": "513f56ad-979a-4a76-92db-c17a97b5f201"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:39.904019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:39.904502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:39.904937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:39.964989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] Creating event network-changed:513f56ad-979a-4a76-92db-c17a97b5f201 for instance b8688a13-549d-4374-a3b5-57e05ba40f98 on n-h1-852771-11 Aug 30 18:01:39.978762 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8778d689-2bec-4cff-a747-aaf18221f618 req-b23bc9e8-1259-4e65-81da-012eaa1b0bfb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088966 Aug 30 18:01:39.980266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3037/5808] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:40.606974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:40.608318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:40.616922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:40.617574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:40.618101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:40.618909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:40.619463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:40.620083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:40.757881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:40.772714 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf972c24-d0f2-4145-b3e9-8184ea4e3562 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.169628 Aug 30 18:01:40.775281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2772/5809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:40 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:41.800088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:41.801365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:41.811398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:41.812266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:41.812855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:41.814284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:41.814973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:41.815568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:41.963815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:41.967395 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d045b2e-862b-4566-b19a-0951c736d910 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.172252 Aug 30 18:01:41.976208 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3038/5810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:41 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:42.997520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:42.999457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:43.014975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:43.015807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:43.016425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:43.017286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:43.017794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:43.018225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:43.118994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:43.127970 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7346e9e6-3ced-4c89-9612-f3d7b555e064 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.134382 Aug 30 18:01:43.128804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2773/5811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:42 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:44.151012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:44.152424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:44.174009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:44.175042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:44.178115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:44.190085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:44.195331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:44.196085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:44.386507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:44.395019 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43765167-f01a-4010-9aef-5793e981ff4c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.249831 Aug 30 18:01:44.397413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3039/5812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:44 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:45.422539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:45.423726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:45.431734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:45.433123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:45.435031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:45.435567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:45.436214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:45.437096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:45.437933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:45.438799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:45.670189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:45.684213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bab70311-15d8-4093-a667-a767fd2a3b34 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.269103 Aug 30 18:01:45.690633 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2774/5813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:45 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:46.048460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8688a13-549d-4374-a3b5-57e05ba40f98", "name": "network-vif-plugged", "status": "completed", "tag": "513f56ad-979a-4a76-92db-c17a97b5f201"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:46.064199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:46.066812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:46.068096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:46.068944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:46.100362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] Creating event network-vif-plugged:513f56ad-979a-4a76-92db-c17a97b5f201 for instance b8688a13-549d-4374-a3b5-57e05ba40f98 on n-h1-852771-11 Aug 30 18:01:46.107688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5bfcdbfa-d69a-4c1e-97e6-6f5846534bd3 req-875069f2-7dda-44d5-b2b8-d16445934d31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063363 Aug 30 18:01:46.111075 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3040/5814] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:46.716664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:46.717282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:46.725158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:46.725943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:46.726533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:46.727387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:46.728285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:46.728947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:46.901321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:46.921268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a1f71c2-993a-4f7f-9d62-c882e56f4ab4 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1299 microversion: 2.1 time: 0.210180 Aug 30 18:01:46.921875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2775/5815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:46 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1299 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:47.947804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:47.948535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:47.965517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:47.966980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:47.967668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:47.968629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:47.969741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:47.971383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.105032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:48.114340 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d54084c7-d726-4991-9720-29df6e100ecb tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1472 microversion: 2.1 time: 0.175636 Aug 30 18:01:48.115530 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3041/5816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:47 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:48.134884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:48.136315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:48.143901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.144664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.145937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.146872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.147555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.148208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.345352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:48.357179 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37ef4a24-bf35-416d-a1c1-ffcdf7e37fad tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1472 microversion: 2.1 time: 0.225885 Aug 30 18:01:48.357595 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2776/5817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:48 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:48.378670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:48.380027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:48.387210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.387734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.388179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.388895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.389354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.389782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.502715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06862ada-5960-427f-9992-3bde3dad6679 tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1625 microversion: 2.1 time: 0.127823 Aug 30 18:01:48.503659 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3042/5818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:48 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1625 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:48.524267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:48.525190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:48.531749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.532496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.532935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.533857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:48.534321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:48.534750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:48.980641 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d91c68f-c4df-4732-b44c-a0d9409b9c1d tempest-TestSecurityGroupsBasicOps-1206433424 tempest-TestSecurityGroupsBasicOps-1206433424-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1915 microversion: 2.1 time: 0.460080 Aug 30 18:01:48.981419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2777/5819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:48 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1915 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:49.066437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:49.067007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:49.086310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:49.086810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:49.087258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:49.088016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:49.088478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:49.088915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:49.129876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:01:49.244688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-472ec87b-8706-4dc1-a8c4-def4b8bec784 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 204 len: 0 microversion: 2.1 time: 0.181454 Aug 30 18:01:49.251339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3043/5820] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:01:49 2022] DELETE /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:01:49.255599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:49.256230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:49.267295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:49.267652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:49.271636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:49.272572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:49.274459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:49.275085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:49.479713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:49.487729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b2f92fc-87f4-4829-a8d7-06acdd12b688 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1478 microversion: 2.1 time: 0.237213 Aug 30 18:01:49.488969 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2778/5821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:49 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1478 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:50.512742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:50.513536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:50.527339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:50.528026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:50.529295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:50.530318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:50.531403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:50.532040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:50.680235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:50.690752 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-801173ab-cc4e-4207-b8cc-cd99a79e316f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1478 microversion: 2.1 time: 0.184901 Aug 30 18:01:50.692505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3044/5822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:50 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1478 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:51.713676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:51.715044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:51.724951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:51.725778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:51.727156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:51.728247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:51.728897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:51.730506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:51.877569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:51.888513 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-853a1e3d-4f4d-4390-bd64-3dd70f6fa24c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 200 len: 1478 microversion: 2.1 time: 0.179299 Aug 30 18:01:51.894448 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2779/5823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:51 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:52.158935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8688a13-549d-4374-a3b5-57e05ba40f98", "name": "network-vif-deleted", "tag": "513f56ad-979a-4a76-92db-c17a97b5f201"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:52.181922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:52.184160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:52.184617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:52.204483 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] Creating event network-vif-deleted:513f56ad-979a-4a76-92db-c17a97b5f201 for instance b8688a13-549d-4374-a3b5-57e05ba40f98 on n-h1-852771-11 Aug 30 18:01:52.210121 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-381ccc2e-b709-4535-b70e-66186fb3c0b2 req-02edfd1c-0cdb-449c-a93f-3cf695be96c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285189 Aug 30 18:01:52.210902 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3045/5824] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:52.914793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:52.915321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: b8688a13-549d-4374-a3b5-57e05ba40f98] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:52.922438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:52.923338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:52.923807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:52.925550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:52.925550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:52.925838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:52.941946 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] HTTP exception thrown: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Request method failure captured: Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 HTTP/1.1 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlAu8hMadh6-NNbMirVPTW0s_oRgJ6wJE3KdeqzhfM6YgL7FNNyZB7zeFZfkHE3mJ8Wb91BEFH5WhopPumvxiWXesWd75AUg_k9bu5yUfmKpDeV5pXA09yPfkRyqxt1KFvy-gilJl4FZAZu9pUInF0jHjXZkFP01PgUrVr-NX2UE_wE Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ddb785e83ad64b6994df481c4f1137ba Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddb785e83ad64b6994df481c4f1137ba"}]}] Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ddb785e83ad64b6994df481c4f1137ba Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestSecurityGroupsBasicOps-1964230723-project Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ce23db53e16b41c9b2b5d162e342a4c2 Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1964230723-project Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b8688a13-549d-4374-a3b5-57e05ba40f98'} Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:01:52.944415 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Returning 404 to user: Instance b8688a13-549d-4374-a3b5-57e05ba40f98 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:01:52.947817 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48102afc-9ac4-48f8-a3fa-f95d5593504c tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98" status: 404 len: 111 microversion: 2.1 time: 0.036709 Aug 30 18:01:52.951433 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2780/5825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:52 2022] GET /compute/v2.1/servers/b8688a13-549d-4374-a3b5-57e05ba40f98 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:01:58.650958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:58.651499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f63-9d06-4d48-8c08-252ef5f7ee25", "tag": "e4ccf6da-a47a-4607-b540-30e9fbc25471"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:01:58.651876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:58.662252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:58.663647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:58.663895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:58.664150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:58.664592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:58.664766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:58.665314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:58.665773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:58.666208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:58.676895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] Creating event network-changed:e4ccf6da-a47a-4607-b540-30e9fbc25471 for instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 on n-h2-852771-11 Aug 30 18:01:58.682171 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9607bac8-0c60-4489-ab9c-14f4bfac76aa req-a699c0df-2691-44de-ac27-d4d7e23f3496 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034958 Aug 30 18:01:58.683137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2781/5826] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:58.756663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:01:59.005582 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8fafdeb0-c26a-4c1d-93cd-4e0e2a07cd5f tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "DELETE /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 204 len: 0 microversion: 2.1 time: 0.361368 Aug 30 18:01:59.008312 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3046/5827] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:01:58 2022] DELETE /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:01:59.020146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:59.021563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:01:59.032084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:59.032880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:59.033472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:59.034346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:01:59.035019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:01:59.036235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:01:59.290934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:01:59.301150 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96a32b9a-e448-46e4-b489-96f0d04718bf tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1768 microversion: 2.1 time: 0.287341 Aug 30 18:01:59.302133 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2782/5828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:01:59 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1768 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:00.323576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:00.325006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:00.340199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:00.344588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:00.345551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:00.347198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:00.349634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:00.351064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:00.890158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:00.900274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfdfc4f6-32c8-4eb6-a25c-92f0002a1639 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1768 microversion: 2.1 time: 0.581098 Aug 30 18:02:00.901449 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3047/5829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:00 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1768 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:01.611142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab0f63-9d06-4d48-8c08-252ef5f7ee25", "name": "network-vif-deleted", "tag": "e4ccf6da-a47a-4607-b540-30e9fbc25471"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:01.690942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:01.695550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:01.698821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:01.736210 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] Creating event network-vif-deleted:e4ccf6da-a47a-4607-b540-30e9fbc25471 for instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 on n-h2-852771-11 Aug 30 18:02:01.743318 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-155f7a9f-2f4f-4adb-9c40-b5705aac1590 req-6656b799-6756-498e-a77d-c27d4b7d0fd4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375310 Aug 30 18:02:01.744217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2783/5830] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:02:01.923325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:01.923982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:01.937252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:01.938057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:01.938509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:01.961418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:01.962092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:01.962751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:02.037584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:02.038870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:02.039584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:02.040199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lazy-loading 'fault' on Instance uuid 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:02:02.100555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce23db53e16b41c9b2b5d162e342a4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb785e83ad64b6994df481c4f1137ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:02.111019 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f005e51-344f-4973-84b9-1869bb70baa7 tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 200 len: 1385 microversion: 2.1 time: 0.191777 Aug 30 18:02:02.111946 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3048/5831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:01 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 1385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:03.138381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:03.139094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [instance: 10ab0f63-9d06-4d48-8c08-252ef5f7ee25] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:03.156033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:03.157941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:03.159682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:03.161328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:03.165351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:03.166013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:03.197272 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] HTTP exception thrown: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Request method failure captured: Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 HTTP/1.1 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlAu8hMadh6-NNbMirVPTW0s_oRgJ6wJE3KdeqzhfM6YgL7FNNyZB7zeFZfkHE3mJ8Wb91BEFH5WhopPumvxiWXesWd75AUg_k9bu5yUfmKpDeV5pXA09yPfkRyqxt1KFvy-gilJl4FZAZu9pUInF0jHjXZkFP01PgUrVr-NX2UE_wE Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ddb785e83ad64b6994df481c4f1137ba Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddb785e83ad64b6994df481c4f1137ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddb785e83ad64b6994df481c4f1137ba"}]}] Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ddb785e83ad64b6994df481c4f1137ba Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1964230723 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestSecurityGroupsBasicOps-1964230723-project Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: ce23db53e16b41c9b2b5d162e342a4c2 Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1964230723-project Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '10ab0f63-9d06-4d48-8c08-252ef5f7ee25'} Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:02:03.199242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. Aug 30 18:02:03.203013 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:02:03.204480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Returning 404 to user: Instance 10ab0f63-9d06-4d48-8c08-252ef5f7ee25 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:02:03.209173 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0ca4a1e-cc55-4920-9307-d142def5e82d tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25" status: 404 len: 111 microversion: 2.1 time: 0.077801 Aug 30 18:02:03.210277 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2784/5832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:03 2022] GET /compute/v2.1/servers/10ab0f63-9d06-4d48-8c08-252ef5f7ee25 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:02:11.202018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7d6e957-0618-4cfd-af92-cc6f13ba3d2b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] Calling method '.version_select at 0x7f2d9cca9430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:11.212812 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7d6e957-0618-4cfd-af92-cc6f13ba3d2b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:02:12.028719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:12.105289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:12.222945 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7d6e957-0618-4cfd-af92-cc6f13ba3d2b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50160. Aug 30 18:02:12.256835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7d6e957-0618-4cfd-af92-cc6f13ba3d2b tempest-TestSecurityGroupsBasicOps-1964230723 tempest-TestSecurityGroupsBasicOps-1964230723-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1027184064" status: 202 len: 0 microversion: 2.1 time: 1.059608 Aug 30 18:02:12.257437 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3049/5833] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 18:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1027184064 => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:02:39.874383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:39.874967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:39.887778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:39.893923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=76 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:39.903293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:39.909479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:39.912606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:39.916455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:39.917962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:39.919168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:40.128622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lazy-loading 'services' on Instance uuid 0b946bbc-d861-465c-918d-c9694147109f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:02:40.312289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44c8873a-7f7a-4161-9b7d-9ddea68bd37d tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f/os-volume_attachments/f8b2e47d-126e-446a-80a5-9ae51c40081e" status: 202 len: 0 microversion: 2.1 time: 0.441197 Aug 30 18:02:40.334358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2785/5834] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:02:39 2022] DELETE /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f/os-volume_attachments/f8b2e47d-126e-446a-80a5-9ae51c40081e => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:02:42.198713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:42.418302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a9ef21ad-c7bc-4a0d-b73e-6cebbe942038 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Action: 'create', calling method: .version_select at 0x7f2d991118b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-899439531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAlP2NjC/joSUbmyJjQNYzAefVKIVgXx7JFe77kn6oAq0oqSsbDnC4sdkwNOGG15Igu9AAy+cKBFvKoGLQGr+lBOG5FczGjHirzV3olAD2HAWuocV/u/OQJpGnjB8kR2A=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:42.436413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a9ef21ad-c7bc-4a0d-b73e-6cebbe942038 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:02:42.448733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a9ef21ad-c7bc-4a0d-b73e-6cebbe942038 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for user 0f37709d07724a61be26465cb6e19273 and project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:02:42.484362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a9ef21ad-c7bc-4a0d-b73e-6cebbe942038 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.287460 Aug 30 18:02:42.486332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3050/5835] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:02:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:02:45.021427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1242186945", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-899439531", "security_groups": [{"name": "tempest-secgroup-smoke-1095427257"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "fe092f14-1320-4069-9f21-87b46529d742"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:45.201544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] validate_networks() for [('fe092f14-1320-4069-9f21-87b46529d742', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:02:46.099325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:02:46.107062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for user 0f37709d07724a61be26465cb6e19273 and project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: dict_keys(['metadata_items']) {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:02:46.123808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:02:46.124479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:02:46.125174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:02:46.126094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:02:46.127677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:02:46.137735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:46.138519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:46.139156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:46.142295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:46.143201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:46.143887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:46.166972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:02:46.173877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Getting quotas for user 0f37709d07724a61be26465cb6e19273 and project 2be2a5f5f514474b95d1cfebe2d02d98. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:02:46.206113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:02:46.208925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:02:46.300950 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0ebc2206-cb7b-46aa-84d5-39d6bb9c9a2b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.285823 Aug 30 18:02:46.303604 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2786/5836] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:02:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:02:46.315261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a3460dd-608b-4d8c-8e9e-a07a0089a605 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:46.317097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a3460dd-608b-4d8c-8e9e-a07a0089a605 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:46.438501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a3460dd-608b-4d8c-8e9e-a07a0089a605 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:46.453499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a3460dd-608b-4d8c-8e9e-a07a0089a605 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1302 microversion: 2.1 time: 0.144633 Aug 30 18:02:46.454307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3051/5837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:46 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1302 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:47.185627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:47.187056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:47.198661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:47.199693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:47.200537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:47.201613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:47.220781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:47.226099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:47.294722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:02:47.476176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4cb0cbc-bb4a-479c-90c9-7b402fdc7142 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:47.476973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4cb0cbc-bb4a-479c-90c9-7b402fdc7142 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:47.524767 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3d43db0-fb41-4eb0-b0db-69abeb0d6c26 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 204 len: 0 microversion: 2.1 time: 0.344299 Aug 30 18:02:47.526521 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2787/5838] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:02:47 2022] DELETE /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:02:47.542015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:47.550666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:47.561878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:47.562608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:47.563287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:47.564318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:47.564999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:47.565658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:47.621759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4cb0cbc-bb4a-479c-90c9-7b402fdc7142 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:47.632156 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4cb0cbc-bb4a-479c-90c9-7b402fdc7142 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1302 microversion: 2.1 time: 0.160507 Aug 30 18:02:47.633363 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3052/5839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:47 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:48.654791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:48.656172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:48.678200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:48.678699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:48.679144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:48.679898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:48.692348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:48.692911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:48.818598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:48.828625 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9889b8ea-0c14-4baf-8659-2cad178db9d3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1470 microversion: 2.1 time: 1.297548 Aug 30 18:02:48.841003 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2788/5840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:47 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1470 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:02:48.936530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:48.953138 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fbe394f7-c058-4a3c-8745-69973e7b0e0e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1362 microversion: 2.1 time: 0.302217 Aug 30 18:02:48.954223 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3053/5841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:48 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:02:49.868223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:49.869027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:49.883161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:49.883931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:49.884588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:49.885513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:49.889538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:49.891398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:49.981017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:49.982223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:49.994775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:49.997908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:49.998564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:49.999579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:50.000366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:50.001896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:50.293469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:50.302571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a69871f-0d89-4cd0-b36f-61b777df7806 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.326282 Aug 30 18:02:50.303280 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3054/5842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:49 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:02:50.364034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1dad274a93492482506126509c5da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad81367c3e4354bd1e83d30118ba63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:50.371912 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8fd0b075-3f3c-4486-8e5e-bb38af0a9ec3 tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 200 len: 1428 microversion: 2.1 time: 0.508476 Aug 30 18:02:50.378135 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2789/5843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:49 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 1428 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:50.630400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b946bbc-d861-465c-918d-c9694147109f", "name": "network-vif-deleted", "tag": "a1a67a5b-1676-47a9-a801-e94a1527550d"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:50.647981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:50.654309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:50.655283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:50.677170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] Creating event network-vif-deleted:a1a67a5b-1676-47a9-a801-e94a1527550d for instance 0b946bbc-d861-465c-918d-c9694147109f on n-h1-852771-11 Aug 30 18:02:50.695030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-17b76fbf-2988-41e7-bc5d-bfe85299be29 req-44453493-275a-4a86-adf8-d1208be4c9f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068225 Aug 30 18:02:50.696072 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3055/5844] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:02:51.325077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:51.325701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:51.347957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:51.348476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:51.348933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:51.355064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:51.355731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:51.364469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:51.398256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:51.399296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] [instance: 0b946bbc-d861-465c-918d-c9694147109f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:51.418360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:51.424972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:51.425383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:51.427632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:51.429193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:51.429651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:51.481417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] HTTP exception thrown: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Request method failure captured: Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f HTTP/1.1 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlBc5HGecp0Mu3AX-7hCe3N6aiKCchrs_IBYTrralAnuhyVI9N-sd5c_O0eP1nFaEkPbEW2RlQ8d85QsNP-UrA9jjOUjKThCtVDJnVBLsgzcQMx6BIeE9ISdcVM5RiUvhEGAcCSUk7Uz8SEAuF9E-gJqv_TkpncuPY8DkMWoeKg5qbI Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 6aad81367c3e4354bd1e83d30118ba63 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesBackupsTest-1276313816 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6aad81367c3e4354bd1e83d30118ba63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6aad81367c3e4354bd1e83d30118ba63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6aad81367c3e4354bd1e83d30118ba63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6aad81367c3e4354bd1e83d30118ba63"}]}] Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesBackupsTest-1276313816 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 6aad81367c3e4354bd1e83d30118ba63 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesBackupsTest-1276313816 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesBackupsTest-1276313816-project Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 7c1dad274a93492482506126509c5da1 Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesBackupsTest-1276313816-project Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '0b946bbc-d861-465c-918d-c9694147109f'} Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:02:51.490370 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] Returning 404 to user: Instance 0b946bbc-d861-465c-918d-c9694147109f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9bb39c5f-22c7-4ee8-8940-f979d63d34dc tempest-VolumesBackupsTest-1276313816 tempest-VolumesBackupsTest-1276313816-project] 10.222.0.50 "GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f" status: 404 len: 111 microversion: 2.1 time: 0.102014 Aug 30 18:02:51.494044 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3056/5845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:51 2022] GET /compute/v2.1/servers/0b946bbc-d861-465c-918d-c9694147109f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:02:51.784664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:51.793036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc1b98aa-6111-4413-98ae-e01dff5fc620 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.472155 Aug 30 18:02:51.809417 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2790/5846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:51 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:51.838812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e990fec8-a2a2-4346-a939-1d05349be6a6", "tag": "44c09e5a-5ebf-46a8-8774-429d5e61e17c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:51.864653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:51.865420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:51.868481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:51.895193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] Creating event network-changed:44c09e5a-5ebf-46a8-8774-429d5e61e17c for instance e990fec8-a2a2-4346-a939-1d05349be6a6 on n-h2-852771-11 Aug 30 18:02:51.915188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f83f6a4f-56cf-415d-8aca-3cedc1f3ea12 req-5dfc89b4-16e5-4784-8310-b52b432ba95e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078751 Aug 30 18:02:51.917720 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3057/5847] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:02:52.822694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:52.823378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:52.841737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:52.842237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:52.848182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:52.849001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:52.849474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:52.862599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:53.675177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:53.690279 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f9de022-9672-4dd0-8769-b86376a60b5e tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.871618 Aug 30 18:02:53.691512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2791/5848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:52 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:54.712300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:54.713538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:54.728516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:54.730033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:54.734881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:54.736873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:54.737501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:54.738129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:54.991778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:55.007931 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef50f273-365b-4afc-98ab-a688e23b20f3 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.299822 Aug 30 18:02:55.028402 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3058/5849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:54 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:56.036182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:56.037476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:56.053181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:56.055157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:56.055943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:56.056822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:56.057431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:56.058139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:56.156352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:56.185179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:56.476715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:56.486909 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7f7b57ee-5d19-47e4-b9aa-d251ae3dd629 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.455431 Aug 30 18:02:56.493857 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2792/5850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:56 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:57.416242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e990fec8-a2a2-4346-a939-1d05349be6a6", "name": "network-vif-plugged", "status": "completed", "tag": "44c09e5a-5ebf-46a8-8774-429d5e61e17c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:02:57.433362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:57.433847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:57.434456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:57.453407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] Creating event network-vif-plugged:44c09e5a-5ebf-46a8-8774-429d5e61e17c for instance e990fec8-a2a2-4346-a939-1d05349be6a6 on n-h2-852771-11 Aug 30 18:02:57.463243 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f8f4b78d-18dd-4393-ae92-ab4d2808089a req-708143cd-749c-4642-bd2c-555a80eeacc5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198438 Aug 30 18:02:57.464116 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3059/5851] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:02:57.512044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:57.513409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:57.533506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:57.538331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:57.539983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:57.540799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:57.541331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:57.541771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:57.768188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:57.779129 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-726a0cb1-3335-4664-9d47-e21067fb0f81 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.272490 Aug 30 18:02:57.783615 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2793/5852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:57 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:02:58.808107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:02:58.809831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:02:58.815581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:02:58.829550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:58.832588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:58.837885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:58.838995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:02:58.839735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:02:58.840376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:02:59.121605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:02:59.142631 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bcf0cd1-de08-413e-865a-93128974a27f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1428 microversion: 2.1 time: 0.340657 Aug 30 18:02:59.147851 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3060/5853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:02:58 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1428 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:03:00.169658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:03:00.170545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:03:00.197704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:00.199332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:00.200071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:00.209967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:00.210563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:00.211068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:00.878876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:03:00.887926 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4cd28f6-8c3e-4d08-924f-febf9d56ab8f tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1609 microversion: 2.1 time: 0.722200 Aug 30 18:03:00.889137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2794/5854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:03:00 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1609 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:03:00.913091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:03:00.913826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:03:00.922981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:00.923652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:00.924371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:00.925268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:00.925794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:00.926564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:01.236361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:03:01.247357 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-17cc6ddd-df37-4086-bf94-a46fbc061778 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1609 microversion: 2.1 time: 0.339100 Aug 30 18:03:01.248951 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3061/5855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:03:00 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1609 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:03:01.269671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:03:01.272489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:03:01.286495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:01.287093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:01.287627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:01.288400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:01.288917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:01.289407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:01.444917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:03:01.455856 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3bab5311-2069-425a-a578-8be3d6db6eba tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1609 microversion: 2.1 time: 0.187861 Aug 30 18:03:01.457485 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2795/5856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:03:01 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1609 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:03:05.966839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e990fec8-a2a2-4346-a939-1d05349be6a6", "tag": "44c09e5a-5ebf-46a8-8774-429d5e61e17c"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:03:05.988519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:05.989261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:05.989943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:06.015731 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] Creating event network-changed:44c09e5a-5ebf-46a8-8774-429d5e61e17c for instance e990fec8-a2a2-4346-a939-1d05349be6a6 on n-h2-852771-11 Aug 30 18:03:06.026229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9643d6fb-beaa-4846-8f11-a26a15d6188c req-988565c4-a0fb-4213-83b3-1c8090c26801 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063453 Aug 30 18:03:06.042736 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3062/5857] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:03:36.077570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:03:36.078143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:03:36.081991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:03:36.082680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:03:36.083898 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:03:36.084136 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6/os-server-password (ip 10.222.0.50) !!! Aug 30 18:03:36.089706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:36.090362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:36.090730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:36.091606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:03:36.092038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:03:36.092731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:03:36.134504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df644d7f-a64d-4de3-be95-7f171cee1729 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.061457 Aug 30 18:03:36.137968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2796/5858] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 30 18:03:36 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6/os-server-password => generated 116 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:05:56.368049 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:05:56.368946 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:05:56.370249 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:05:56.370399 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.50) !!! Aug 30 18:05:56.371955 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:05:56.372088 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.50) !!! Aug 30 18:05:56.373436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:05:56.374189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=40 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:05:56.375202 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:05:56.375426 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.50) !!! Aug 30 18:05:56.577775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d35e168f-2c7b-41ea-83e7-00fa102dc769 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: .version_select at 0x7f2d98dccb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1127656685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmPmKetksGUORfqVBnjQsmPDCzgrmLku9zwq4kJ2zpvZ5rE2QCd2GjHmQJdi+x27hmZuMy56c8VAIZkUvJOVyOelUaFKfzR9PC07JOzFf+IvlHy5tX4BECwXk9UgqOL8g=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:05:56.594886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d35e168f-2c7b-41ea-83e7-00fa102dc769 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:05:56.600188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-d35e168f-2c7b-41ea-83e7-00fa102dc769 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:05:56.628849 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d35e168f-2c7b-41ea-83e7-00fa102dc769 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.263274 Aug 30 18:05:56.629395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3063/5859] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:05:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:06:02.820349 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:06:02.821816 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:06:02.825865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1543451436", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "bb2cb294-1dec-448f-9f6f-6fe581f73732"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1127656685", "security_groups": [{"name": "tempest-secgroup-smoke-522102154"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:02.845209 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:06:02.845441 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Aug 30 18:06:02.847821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:02.848661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:03.120571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] validate_networks() for [('bb2cb294-1dec-448f-9f6f-6fe581f73732', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:06:03.833724 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56206. Aug 30 18:06:03.845978 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56204. Aug 30 18:06:03.960776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:06:03.961411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:06:03.962074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:06:03.962490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:06:03.962915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:06:03.972752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:03.973240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:03.973683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:03.974420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:03.975698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:03.976215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:03.995113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:06:04.000783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:06:04.014394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:06:04.016807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:06:04.066035 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [f9df973d-861f-4e29-940c-012f33e6b0e4] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:06:05.073909 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [f9df973d-861f-4e29-940c-012f33e6b0e4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56210. Aug 30 18:06:05.079025 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9e17a72-b585-4977-8e5e-a6220dd2c754 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.260803 Aug 30 18:06:05.079773 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2797/5860] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:06:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:06:05.093492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-badd9736-f566-4a5e-afe1-c71c587c8f9a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:05.094985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-badd9736-f566-4a5e-afe1-c71c587c8f9a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:05.137576 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56214. Aug 30 18:06:05.138345 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56216. Aug 30 18:06:05.273758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-badd9736-f566-4a5e-afe1-c71c587c8f9a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:05.292011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-badd9736-f566-4a5e-afe1-c71c587c8f9a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1267 microversion: 2.1 time: 0.204040 Aug 30 18:06:05.292649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3064/5861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:05 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:06.316161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:06.318958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:06.326725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:06.327217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:06.327688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:06.329230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:06.329699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:06.330135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:06.463821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:06.478309 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-34ae00dc-dfa6-4285-9094-198dc7c0ad28 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1319 microversion: 2.1 time: 0.168522 Aug 30 18:06:06.493821 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2798/5862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:06 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:07.513256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:07.514460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:07.535216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:07.544153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:07.549116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:07.549892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:07.552042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:07.552677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:07.878626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:07.889568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ea37f6cc-601f-46a3-982a-9488e92bc2ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.378667 Aug 30 18:06:07.890650 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3065/5863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:07 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:08.033713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:08.047140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:08.048049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:08.048548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:08.060680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] Creating event network-changed:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h1-852771-11 Aug 30 18:06:08.066675 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6d0d4380-1c89-442a-88d1-e7f5ba79e242 req-489b6f26-a900-4839-b036-cb368ff5ef9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036670 Aug 30 18:06:08.067433 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2799/5864] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:06:08.910295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:08.910947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:08.918356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:08.918849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:08.919319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:08.920089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:08.920549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:08.920980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:09.068217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:09.076523 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-628a1b4b-a1e7-460e-a901-9e74ae7aac47 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.170171 Aug 30 18:06:09.077110 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3066/5865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:08 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:06:10.102068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:10.102773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:10.117500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:10.117986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:10.118635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:10.119554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:10.120061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:10.120449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:10.347249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:10.356399 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97a4ba66-5a59-4c85-b630-7a1053ea6624 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.261955 Aug 30 18:06:10.357024 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2800/5866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:10 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:11.377375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:11.378585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:11.386503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:11.387276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:11.387957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:11.388856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:11.389476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:11.390086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:11.539503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:11.547778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0bdb61a-e75a-49af-8815-1bb83224c3de tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.174220 Aug 30 18:06:11.548376 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3067/5867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:11 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:06:12.570411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:12.571029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:12.578312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:12.578792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:12.579234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:12.579951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:12.580408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:12.580845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:12.716914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:12.725285 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b69edfaf-53ff-41ce-a084-ae5c5e7a6da2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.158815 Aug 30 18:06:12.725859 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2801/5868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:12 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:13.007217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "name": "network-vif-plugged", "status": "completed", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:13.019053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:13.019799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:13.020233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:13.033401 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] Creating event network-vif-plugged:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h1-852771-11 Aug 30 18:06:13.042972 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a0a8e317-0230-411f-b8f0-56d6e105d5f2 req-6d317b35-3b94-46dd-b623-5b18fa9f06d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040182 Aug 30 18:06:13.043920 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3068/5869] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:06:13.746211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:13.747030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:13.754119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:13.754610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:13.755054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:13.756413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:13.756875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:13.757331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:13.890989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:13.899532 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e79dc0a7-22e8-47cc-85eb-3919b06a3e5e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1392 microversion: 2.1 time: 0.157131 Aug 30 18:06:13.900138 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2802/5870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:13 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:14.924421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:14.925133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:14.933445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:14.934344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:14.934801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:14.936190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:14.937025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:14.937467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:15.089806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:15.097952 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cca9f352-dfb3-4a5d-ac82-b0a64eda0ffd tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1563 microversion: 2.1 time: 0.178720 Aug 30 18:06:15.098539 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3069/5871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:14 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:15.118663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:15.119304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:15.121296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:15.121961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:15.129092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:15.129570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:15.130003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:15.130687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:15.131134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:15.131676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:15.523963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:15.531776 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-56dd135d-2ae3-4605-abf4-8ca9ed8a7377 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1563 microversion: 2.1 time: 0.416915 Aug 30 18:06:15.532281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2803/5872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:15 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1563 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:17.249500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:17.250937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:17.251659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:17.260220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:17.260698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:17.261126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:17.272710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:17.274826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] Creating event network-changed:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h1-852771-11 Aug 30 18:06:17.283935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:17.284125 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e056c40e-446d-4e57-adb2-7262f602b0f6 req-474e94aa-bce0-4c15-b1ba-58e13b6f8329 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037545 Aug 30 18:06:17.284912 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2804/5873] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:06:17.285172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:17.285827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:17.287504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:17.289017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:17.289979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:17.499615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:17.509613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-279408ae-f1a1-42fe-a3a2-efa7b03fdb01 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1563 microversion: 2.1 time: 0.270127 Aug 30 18:06:17.510829 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3070/5874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:17 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1563 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:06:38.920249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:38.922439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:38.924606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:38.925277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:38.933226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:38.933707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:38.934147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:38.934863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:38.935317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:38.935797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:38.994722 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ac2fc713-6c70-4ada-b23a-5e8bea0f566d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action" status: 200 len: 24563 microversion: 2.1 time: 0.079013 Aug 30 18:06:38.995349 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2805/5875] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:06:38 2022] POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action => generated 24563 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:06:49.989757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:49.990466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:49.992595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:49.993347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:49.999663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.000154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.000597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.001299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.001759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.002188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.243129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94bbf743-a0c8-4faa-9246-9e7817391d48 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1834 microversion: 2.1 time: 0.257748 Aug 30 18:06:50.243848 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3071/5876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:49 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1834 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:50.265033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:50.265728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:50.268610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:50.269267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:06:50.274892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.275380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.275843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.276540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.277162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.277585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.421776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:50.430440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6982cd7-d458-41af-ab1b-171c745862f1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1681 microversion: 2.1 time: 0.169538 Aug 30 18:06:50.431086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2806/5877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:50 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:50.525106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:50.527396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:50.533683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.534243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.534783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.535608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.536726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.537438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.592622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d898f8b-aedd-4e67-b757-e69929c61fd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action" status: 200 len: 32633 microversion: 2.1 time: 0.071885 Aug 30 18:06:50.593485 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3072/5878] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:06:50 2022] POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action => generated 32633 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:06:50.752822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:06:50.760523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:50.801583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.803006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.803459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.813095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:50.819853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:50.820536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:50.872650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1f99fffff2984814852c4f53db440e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c96e441f4284efd92c52d92eccc7ba3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:50.873260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] flavor_id is None. Assuming migration. {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:06:50.873737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:06:51.118564 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e73f8c24-206c-4d46-874d-1cfbe2b3f02b tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action" status: 202 len: 0 microversion: 2.1 time: 0.369485 Aug 30 18:06:51.119086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2807/5879] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:06:50 2022] POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:06:51.127935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:51.128639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:51.136029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:51.136513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:51.136946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:51.137640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:51.138089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:51.138512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:51.289387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:51.297497 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1fab8e6-ec77-4894-9351-02304be08d0a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1690 microversion: 2.1 time: 0.173888 Aug 30 18:06:51.298082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3073/5880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:51 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:52.319267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:52.319856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:52.325913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:52.326391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:52.326822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:52.327523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:52.328153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:52.328565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:52.467395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:52.476743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98274cce-72ca-4027-b85f-028f918ec0f8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1690 microversion: 2.1 time: 0.162282 Aug 30 18:06:52.477367 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2808/5881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:52 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:53.499681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:53.500317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:53.507309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:53.507823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:53.508262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:53.508978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:53.509415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:53.509836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:53.652004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:53.662465 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-771fa248-7b5b-4e73-8bd3-ff6e48662fa5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.166700 Aug 30 18:06:53.663264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3074/5882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:53 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:54.685012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:54.685629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:54.693203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:54.693760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:54.694273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:54.694962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:54.695414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:54.696150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:54.835085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:54.843289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f1cfc1e-0a3e-4415-bcae-7868bee50c40 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.162380 Aug 30 18:06:54.855870 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2809/5883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:54 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:55.866714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:55.867351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:55.875821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:55.876701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:55.877768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:55.879346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:55.880456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:55.881194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:56.031464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:56.040575 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7a17f5d-fa5d-42ca-95bc-0add38ddb514 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.178815 Aug 30 18:06:56.041317 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3075/5884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:55 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:57.063045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:57.063808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:57.071795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:57.072425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:57.073123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:57.074022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:57.074675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:57.075114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:57.219198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:57.228857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9651ab67-494d-43ff-9258-8801b65b40a7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.169942 Aug 30 18:06:57.242767 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2810/5885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:57 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:58.250852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:58.252300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:58.260644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:58.261535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:58.262103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:58.262834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:58.263288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:58.263770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:58.407442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:58.416494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-739e97ff-c5e1-4dd2-b127-bcf8499f10cb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.170100 Aug 30 18:06:58.417240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3076/5886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:58 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:06:59.438298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:06:59.438912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:06:59.446606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:59.447096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:59.447559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:59.448256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:06:59.448707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:06:59.449130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:06:59.592130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:06:59.601388 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78a17a99-c97d-45f7-8e46-a3eb46f838dc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.166972 Aug 30 18:06:59.601985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2811/5887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:06:59 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:07:00.623186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:00.623754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:00.631347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:00.631859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:00.632308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:00.633012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:00.633474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:00.633912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:00.773402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:00.781281 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fbaf8c99-8d6e-4d83-bcde-98c7cfa484b9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.162200 Aug 30 18:07:00.781871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3077/5888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:00 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:01.802368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:01.803095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:01.810326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:01.810814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:01.811259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:01.812021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:01.812487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:01.812914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:01.959638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:01.967813 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86f606d7-1db9-42c5-b1a7-025ad50fb677 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.169450 Aug 30 18:07:01.968421 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2812/5889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:01 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:02.990448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:02.991002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:02.998119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:02.998609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:02.999050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:02.999870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:03.000329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:03.000758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:03.142711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:03.151105 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8479997c-0be2-45e2-a7f9-fb2adea8082a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.165692 Aug 30 18:07:03.151722 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3078/5890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:02 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:04.171917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:04.172563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:04.180508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:04.180998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:04.181446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:04.182139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:04.182595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:04.183022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:04.323526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:04.331266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-feaf1517-0f37-4ee8-af74-bb67e3ada88f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.163159 Aug 30 18:07:04.331868 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2813/5891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:04 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:05.353887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:05.354510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:05.361264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:05.361761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:05.362201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:05.362903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:05.363422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:05.363941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:05.505304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:05.513193 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d924fc2e-ad28-4094-92f6-ada6051cc0fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.163374 Aug 30 18:07:05.513851 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3079/5892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:05 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:06.534232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:06.534851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:06.542197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:06.542677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:06.543113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:06.543831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:06.544283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:06.544708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:06.683823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:06.692333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d522bc6e-2aab-44be-83e6-90cdb7b5c465 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.161370 Aug 30 18:07:06.692951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2814/5893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:06 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:07.714429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:07.715272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:07.724695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:07.724799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:07.725222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:07.725921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:07.726373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:07.726802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:07.910104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:07.918518 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-180d1e63-270b-40d0-abfe-db316a26af33 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.208382 Aug 30 18:07:07.919465 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3080/5894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:07 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:08.940503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:08.941128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:08.948137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:08.948620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:08.949055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:08.949748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:08.950198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:08.950621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:09.386646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:09.395586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b971cf83-aa03-4790-bf19-3a478d01c47a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1695 microversion: 2.1 time: 0.458305 Aug 30 18:07:09.396196 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2815/5895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:08 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1695 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:10.417491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:10.418113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:10.425118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:10.425647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:10.426613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:10.427340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:10.427840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:10.428280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:10.662472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:10.672335 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c0919a0-d84c-4150-9242-28579effe510 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1694 microversion: 2.1 time: 0.258727 Aug 30 18:07:10.673147 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3081/5896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:10 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:11.092704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "name": "network-vif-unplugged", "status": "completed", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:11.104223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:11.105124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:11.105760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:11.120493 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Creating event network-vif-unplugged:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h2-852771-11 Aug 30 18:07:11.126279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:07:11.137631 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-78fb9c8b-9ca0-4ef7-a9c1-1e71927065f7 req-40bd778f-4e07-4b7b-a833-ddb92ca92318 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141349 Aug 30 18:07:11.138336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2816/5897] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:11.694919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:11.696214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:11.703411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:11.703951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:11.704410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:11.705109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:11.705570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:11.706002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:11.926700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:11.946219 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7edb9ac-915e-4158-8100-2b2da8ec2450 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1694 microversion: 2.1 time: 0.255870 Aug 30 18:07:11.946819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3082/5898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:11 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:12.970006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:12.970625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:12.977289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:12.977773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:12.978210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:12.978937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:12.979391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:12.979843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:13.125800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:13.134110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7354e39-3611-4936-a6d4-6555c964346d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1692 microversion: 2.1 time: 0.169357 Aug 30 18:07:13.134934 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2817/5899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:12 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:13.153110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:13.164641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:13.165120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:13.165556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:13.182137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Creating event network-changed:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h2-852771-11 Aug 30 18:07:13.187901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:07:13.198911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9e5e52e3-a7a9-4c95-a001-4602c46abc03 req-ea260bc9-a86a-4aef-a781-273b2f7f9e13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049542 Aug 30 18:07:13.199834 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3083/5900] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:14.156233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:14.156832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:14.164190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.164731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.165255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.166015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.166533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.167024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.327029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:14.335334 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db6f14a6-bbea-47f3-a472-afb2b4a22013 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1689 microversion: 2.1 time: 0.182976 Aug 30 18:07:14.335949 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2818/5901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:14 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:14.357410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:14.357947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:14.364835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.365322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.365763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.366458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.366914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.367342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.437433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6e490073-654f-40d9-9426-989d5d9feb41 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action" status: 204 len: 0 microversion: 2.1 time: 0.084905 Aug 30 18:07:14.438087 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3084/5902] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:07:14 2022] POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:07:14.452724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:14.457945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:14.474093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.474586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.475202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.476094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:14.476704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:14.477380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:14.776972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:14.786395 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6734861-77b6-4a5c-9531-4085f1ae8053 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1689 microversion: 2.1 time: 0.342886 Aug 30 18:07:14.787255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2819/5903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:14 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1689 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:15.809391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:15.810088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:15.817176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:15.817664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:15.818107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:15.818800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:15.819251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:15.819702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:15.974909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:15.984510 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f7f5763a-afba-47cd-aa76-0cc7902e2090 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1681 microversion: 2.1 time: 0.180451 Aug 30 18:07:15.985334 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3085/5904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:15 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:16.198303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "name": "network-vif-plugged", "status": "completed", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:16.211559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:16.212314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:16.214323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:16.231270 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] Creating event network-vif-plugged:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h2-852771-11 Aug 30 18:07:16.236820 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8f6a7894-c2aa-43bd-a904-e4ffa25c6fa4 req-3c15439a-b881-4ebd-aa47-e2061483c9b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043870 Aug 30 18:07:16.237561 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2820/5905] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:38.200743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:38.203662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:38.206101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=30 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:38.206883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:38.213185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:38.213768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:38.214278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:38.215064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:38.215618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:38.216120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:38.273554 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-02f47d40-a052-460d-ac25-4f2611751848 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action" status: 200 len: 24574 microversion: 2.1 time: 0.076763 Aug 30 18:07:38.280880 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3086/5906] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:07:38 2022] POST /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931/action => generated 24574 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:07:39.608697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=32 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:39.610112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:39.615448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:39.616129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:39.625251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:39.626018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:39.626500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:39.628043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:39.628797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:39.628916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:39.664013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:07:39.763936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c5283ce-67e6-4c4e-8a41-621b96786172 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 204 len: 0 microversion: 2.1 time: 0.151487 Aug 30 18:07:39.764610 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2821/5907] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:07:39 2022] DELETE /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:07:39.773776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:39.775154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:39.783901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:39.784603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:39.785037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:39.785735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:39.786185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:39.786606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:39.936450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:39.958254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a5a20ead-976b-47d9-871c-5fa8b3410a8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1734 microversion: 2.1 time: 0.188701 Aug 30 18:07:39.964528 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3087/5908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:39 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:40.988300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:40.989157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:40.996862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:40.997353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:40.997790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:40.998486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:40.998947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:40.999353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:41.155737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:41.163936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d6e2d29d-56ae-4a2c-9bac-93e20037263b tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1734 microversion: 2.1 time: 0.180062 Aug 30 18:07:41.164535 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2822/5909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:40 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:41.453213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106043846", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "d66fd8f8-2720-47df-8150-af794f52c404"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:41.516216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] validate_networks() for [('d66fd8f8-2720-47df-8150-af794f52c404', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:07:42.185940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:42.186633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:42.194929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:42.195683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:42.196125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:42.196828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:42.197286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:42.197714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:42.266546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f37709d07724a61be26465cb6e19273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be2a5f5f514474b95d1cfebe2d02d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:42.275666 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8219bc40-3e5b-450f-bb3c-60b2cd13d077 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 200 len: 1666 microversion: 2.1 time: 0.093183 Aug 30 18:07:42.280705 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2823/5910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:42 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 1666 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:07:42.522445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:07:42.522919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:07:42.523512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:07:42.524538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:07:42.524965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:07:42.537163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:42.537762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:42.538330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:42.539438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:42.540040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:42.540724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:42.566128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Getting quotas for project 4fcc879e0cb54aab84942cc66bb1127e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:07:42.572634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Getting quotas for user 38ce25b5fd304974aca47b5551bf5beb and project 4fcc879e0cb54aab84942cc66bb1127e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:07:42.588264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:07:42.591266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:07:42.597233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e990fec8-a2a2-4346-a939-1d05349be6a6", "name": "network-vif-deleted", "tag": "44c09e5a-5ebf-46a8-8774-429d5e61e17c"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:42.614271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:42.614745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:42.615360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:42.634541 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] Creating event network-vif-deleted:44c09e5a-5ebf-46a8-8774-429d5e61e17c for instance e990fec8-a2a2-4346-a939-1d05349be6a6 on n-h2-852771-11 Aug 30 18:07:42.640033 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-029da34e-e47f-4c2c-a0d9-78e4a1d1a42e req-6b513ae1-d0f5-497d-a00a-1733a6dd23f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047234 Aug 30 18:07:42.641174 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2824/5911] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:42.653863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e05c5206-cee0-4b59-9a97-2c6265529bfd tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204414 Aug 30 18:07:42.655704 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3088/5912] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:07:42.669098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-23977364-ae92-4599-b8f5-8ed329bc7eda tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:42.669608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-23977364-ae92-4599-b8f5-8ed329bc7eda tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:42.744391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23977364-ae92-4599-b8f5-8ed329bc7eda tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:42.752342 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-23977364-ae92-4599-b8f5-8ed329bc7eda tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1219 microversion: 2.1 time: 0.089335 Aug 30 18:07:42.753551 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2825/5913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:42 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:43.435134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:43.435782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:43.443257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:43.443767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:43.445104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:43.445798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:43.446254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:43.446680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:43.464189 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] HTTP exception thrown: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Request method failure captured: Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 HTTP/1.1 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlC0w9o6EkTJYagSIYROrBQw7NycdJfoU-SIYXc_mxmDdjcQgM5FCXJqYVV21IWz53RiiePAuYV5TM_TnIDrfJKFfH-BpnsA006kqtyI7b_VZmR_wzDWuHzggnPxefn6rr23iHft4pGWuF8xLLtTMT9WlwV96xeHUJdvXeNZhHrPQag Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2be2a5f5f514474b95d1cfebe2d02d98"}]}] Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestServerBasicOps-828347078 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0f37709d07724a61be26465cb6e19273 Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e990fec8-a2a2-4346-a939-1d05349be6a6'} Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:43.466081 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Returning 404 to user: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82729794-5f3e-49bd-b3b8-9c51f07a4d8a tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 404 len: 111 microversion: 2.1 time: 0.174860 Aug 30 18:07:43.470499 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3089/5914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:43 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:07:43.776736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:43.777467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:43.786507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:43.787138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:43.787851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:43.788839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:43.789423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:43.790083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:43.862316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:43.871315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9d4bf4f-9b48-4959-a3a2-0167fcde2a90 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1279 microversion: 2.1 time: 0.101346 Aug 30 18:07:43.885250 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2826/5915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:43 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:44.032813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:44.033498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:44.040241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.040720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.041157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.041848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.042305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.042729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.059394 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] HTTP exception thrown: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Request method failure captured: Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 HTTP/1.1 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlC0w9o6EkTJYagSIYROrBQw7NycdJfoU-SIYXc_mxmDdjcQgM5FCXJqYVV21IWz53RiiePAuYV5TM_TnIDrfJKFfH-BpnsA006kqtyI7b_VZmR_wzDWuHzggnPxefn6rr23iHft4pGWuF8xLLtTMT9WlwV96xeHUJdvXeNZhHrPQag Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2be2a5f5f514474b95d1cfebe2d02d98"}]}] Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 0f37709d07724a61be26465cb6e19273 Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'e990fec8-a2a2-4346-a939-1d05349be6a6'} Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:07:44.061026 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Returning 404 to user: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4dd04b2b-87f9-444a-8445-cb10d26cd7f4 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 404 len: 111 microversion: 2.1 time: 0.033596 Aug 30 18:07:44.065771 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3090/5916] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:07:44 2022] DELETE /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:07:44.072647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:44.073267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] [instance: e990fec8-a2a2-4346-a939-1d05349be6a6] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:44.079473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.080085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.082214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.083551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.084018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.084449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.098939 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] HTTP exception thrown: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Request method failure captured: Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 HTTP/1.1 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlC0w9o6EkTJYagSIYROrBQw7NycdJfoU-SIYXc_mxmDdjcQgM5FCXJqYVV21IWz53RiiePAuYV5TM_TnIDrfJKFfH-BpnsA006kqtyI7b_VZmR_wzDWuHzggnPxefn6rr23iHft4pGWuF8xLLtTMT9WlwV96xeHUJdvXeNZhHrPQag Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2be2a5f5f514474b95d1cfebe2d02d98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2be2a5f5f514474b95d1cfebe2d02d98"}]}] Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2be2a5f5f514474b95d1cfebe2d02d98 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestServerBasicOps-828347078 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 0f37709d07724a61be26465cb6e19273 Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestServerBasicOps-828347078-project Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'e990fec8-a2a2-4346-a939-1d05349be6a6'} Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:44.100696 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Returning 404 to user: Instance e990fec8-a2a2-4346-a939-1d05349be6a6 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:07:44.105721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d3f0574-0e3f-47ce-bcf7-0b78529e30b8 tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6" status: 404 len: 111 microversion: 2.1 time: 0.033432 Aug 30 18:07:44.106445 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2827/5917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:44 2022] GET /compute/v2.1/servers/e990fec8-a2a2-4346-a939-1d05349be6a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:07:44.298068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca734084-573e-42c8-b61d-45673c592b9d tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] Calling method '.version_select at 0x7f2d9921f3a0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:44.322767 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca734084-573e-42c8-b61d-45673c592b9d tempest-TestServerBasicOps-828347078 tempest-TestServerBasicOps-828347078-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-899439531" status: 202 len: 0 microversion: 2.1 time: 0.028457 Aug 30 18:07:44.326916 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3091/5918] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 18:07:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-899439531 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:07:44.659142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:44.659780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:44.666031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.666511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.666944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.667671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.668122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.668585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.808436 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0170fed0-8a66-4f78-9b00-69742d02f820 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1834 microversion: 2.1 time: 0.153601 Aug 30 18:07:44.809743 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2828/5919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:44 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1834 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:44.894638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:44.895311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:44.902830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.903575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.904221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:44.905091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:44.905725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:44.906152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:45.272648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:45.289583 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50c0238c-1ed9-46d9-ae8e-c27d39d9c417 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.400479 Aug 30 18:07:45.294394 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3092/5920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:44 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:45.732695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:45.733759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:45.741443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:45.742653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:45.743354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:45.752869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:45.754871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:45.755431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:45.796182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:07:45.820525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:45.837943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:45.838712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:45.839651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:45.861934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] Creating event network-changed:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h2-852771-11 Aug 30 18:07:45.869255 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-baae0fb9-cac3-4769-b152-1223e88f3dc7 req-5709337b-b5ec-4963-bef0-99ccdbf78385 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130195 Aug 30 18:07:45.871784 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3093/5921] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:07:45.915595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-daa4816f-6347-45f5-ad42-f21f9a5f03a4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 204 len: 0 microversion: 2.1 time: 0.187407 Aug 30 18:07:45.917147 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2829/5922] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:07:45 2022] DELETE /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:07:45.929542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:45.930773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:45.938935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:45.940377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:45.942408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:45.944115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:45.944782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:45.945626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:46.256822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:46.257637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd26f099-6cc2-4042-95f4-517179a48471", "tag": "18bc9599-cedc-4fe6-952e-be074e215e27"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:46.273620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:46.275540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:46.276238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:46.285501 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-364093fa-7288-4901-8fe6-5df626e865d8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1687 microversion: 2.1 time: 0.363497 Aug 30 18:07:46.289130 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3094/5923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:45 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1687 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:46.296980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] Creating event network-changed:18bc9599-cedc-4fe6-952e-be074e215e27 for instance fd26f099-6cc2-4042-95f4-517179a48471 on n-h2-852771-11 Aug 30 18:07:46.305575 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-30e8ac6f-5461-49fa-b88a-aa35ed8382d8 req-c29e79e6-d8ea-40fa-88a7-a37e6f3a803c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058903 Aug 30 18:07:46.306676 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2830/5924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:07:46.323314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:46.324194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:46.332152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:46.332832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:46.333583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:46.334513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:46.335125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:46.336125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:46.910430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:46.918229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5aa52720-0f7c-4a04-862c-fbcf3649809f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.604335 Aug 30 18:07:46.918912 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3095/5925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:46 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:47.316611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:47.318111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:47.324618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:47.325311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:47.325791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:47.326521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:47.326968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:47.327401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:47.701159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:47.741369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d83b1b94-6fe4-4aa0-be07-28a89a373a51 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1687 microversion: 2.1 time: 0.430768 Aug 30 18:07:47.755569 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2831/5926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:47 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:47.942678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:47.944929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:47.956940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:47.957716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:47.958701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:47.960091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:47.962165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:47.963066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:48.205641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b9cfdf-141b-46b0-89c8-8d0696dd3931", "name": "network-vif-deleted", "tag": "a79878bb-9fc3-41a9-bda9-57ce2401f15e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:48.219520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:48.220389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:48.221060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:48.233822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:48.237126 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] Creating event network-vif-deleted:a79878bb-9fc3-41a9-bda9-57ce2401f15e for instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 on n-h2-852771-11 Aug 30 18:07:48.242772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1e57423f-a333-4152-a436-ed24900156f6 req-e8375a3e-22e3-478b-bb7e-1fbcff63b0d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041929 Aug 30 18:07:48.243628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2832/5927] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:07:48.246319 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-71200b1a-ba37-4500-a9d2-0a5f5d3abe54 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.310232 Aug 30 18:07:48.264107 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3096/5928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:47 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:48.767455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:48.769146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:48.776046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:48.776538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:48.777087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:48.777797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:48.778420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:48.778853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:48.816327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:48.816835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:48.817244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:48.817696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lazy-loading 'fault' on Instance uuid 91b9cfdf-141b-46b0-89c8-8d0696dd3931 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:07:49.032048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:49.040532 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a28e9e17-39c2-409c-85c2-4badadaa81bb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 200 len: 1357 microversion: 2.1 time: 0.278429 Aug 30 18:07:49.041119 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2833/5929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:48 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:49.267027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:49.267813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:49.274775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:49.275272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:49.278415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:49.278415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:49.278415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:49.278415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:49.482632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:49.495256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-18584755-c8be-4434-a4c3-2cacc199a76d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.232274 Aug 30 18:07:49.500165 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3097/5930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:49 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:50.062386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:50.062910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 91b9cfdf-141b-46b0-89c8-8d0696dd3931] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:50.070455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:50.070935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:50.071384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:50.072090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:50.072538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:50.072962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:50.087197 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] HTTP exception thrown: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Request method failure captured: Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 HTTP/1.1 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlGDwXmImJOpEs8dvPBn9r-uyIf9kUDlojS3mwmrJzSPSAps_CJQoqoDeiezhgu1NqiXGGSafMF1julVC5XM_xI8eLxFOKCaS_1lZb2uBaeSqlmNEC-USSPCXaAOwFbgYHiBAkWOHakWOSe2AimNS0Neqtzlrk4SLwJI2KrFpj_INKs Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c4a340bef6214caf85d78be544a88327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c4a340bef6214caf85d78be544a88327"}]}] Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b45d9856716b4bbabc9eacbed7b8fa2d Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '91b9cfdf-141b-46b0-89c8-8d0696dd3931'} Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:50.089174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Returning 404 to user: Instance 91b9cfdf-141b-46b0-89c8-8d0696dd3931 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e443cb7-6a27-479c-b9aa-cac74ed5c896 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931" status: 404 len: 111 microversion: 2.1 time: 0.032234 Aug 30 18:07:50.093081 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2834/5931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:50 2022] GET /compute/v2.1/servers/91b9cfdf-141b-46b0-89c8-8d0696dd3931 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:07:50.521310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:50.522054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:50.529126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:50.530334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:50.530915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:50.532153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:50.533616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:50.534162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:50.737398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:50.746199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da934b25-6abd-4edd-8be9-8d6c60473923 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.229338 Aug 30 18:07:50.760072 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3098/5932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:50 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:07:51.773160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:51.778013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:51.801748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:51.802485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:51.803113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:51.804032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:51.804641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:51.805223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:52.104683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:52.145474 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8dd95ff6-3a6f-486b-9aab-d92af3e74a7c tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.375499 Aug 30 18:07:52.149196 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2835/5933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:51 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:52.650735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd26f099-6cc2-4042-95f4-517179a48471", "name": "network-vif-plugged", "status": "completed", "tag": "18bc9599-cedc-4fe6-952e-be074e215e27"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:52.658423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:52.665412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:52.684969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:52.687514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:52.688267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:52.718274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] Creating event network-vif-plugged:18bc9599-cedc-4fe6-952e-be074e215e27 for instance fd26f099-6cc2-4042-95f4-517179a48471 on n-h2-852771-11 Aug 30 18:07:52.725550 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7d1dd1bb-5313-4f7a-9717-bab75a678d2c req-f703c8d7-f2ec-4f8e-9682-90e935ac4c54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079216 Aug 30 18:07:52.726840 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3099/5934] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:53.169822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:53.170517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:53.172500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:53.189692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:53.190592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:53.191416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:53.192852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:53.197121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:53.197638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:53.876313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:53.893132 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73e4cbc7-8164-4681-b271-6c3793783fd3 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1319 microversion: 2.1 time: 0.727401 Aug 30 18:07:53.915545 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2836/5935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:53 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1319 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:07:54.515140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d69895cc-4aa4-4429-b878-072fba21a26c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '.version_select at 0x7f2d937f60d0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:54.542447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d69895cc-4aa4-4429-b878-072fba21a26c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1127656685" status: 202 len: 0 microversion: 2.1 time: 0.032375 Aug 30 18:07:54.543642 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3100/5936] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:07:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1127656685 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:07:54.577709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: .version_select at 0x7f2d9379d940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1764394479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn0Uw6ESy4GGeTjvwV4j0rIGaLakqX5MgyIm0c8Y3E2MFtlCSVaPhDl/8izoDWv5Y7bQPzGIAwhMXbkpuVFoQKg9e27S/nljGdCbtQzGy2261DlRZUCs34stFZLZcCqVg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:07:54.594913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:07:54.601534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:07:54.616500 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:07:54.921365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:54.922301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:07:54.929528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:54.930005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:54.930433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:54.931127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:54.931594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:54.932144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:55.069846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:07:55.077662 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fba7cfd5-b0fb-4b73-9091-94ad1f2c43b8 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1508 microversion: 2.1 time: 0.160559 Aug 30 18:07:55.078240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3101/5937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:07:54 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:07:55.623395 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58406. Aug 30 18:07:55.639997 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-066ac637-eedb-4c05-936f-5ba5d65f3fa0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.065974 Aug 30 18:07:55.640676 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2837/5938] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:07:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:05.120956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1957219490", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "1f391910-2ced-4d06-988f-c2ce365e6661"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1764394479", "security_groups": [{"name": "tempest-secgroup-smoke-620668430"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:05.133391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:05.134380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=62 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:05.302707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] validate_networks() for [('1f391910-2ced-4d06-988f-c2ce365e6661', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:08:06.158597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:08:06.159298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:08:06.159606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:08:06.160640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:08:06.161243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:08:06.181356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:06.184601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:06.185992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:06.192371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:06.196477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:06.197129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:06.233756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:08:06.241230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:08:06.267796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:08:06.272493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:08:06.387103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-60038015-4fa2-4aac-8923-73ff123c8dee tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.271981 Aug 30 18:08:06.397964 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3102/5939] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:08:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:08:06.401302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-955d2b21-06e7-42a1-a1a6-b02273a3002c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:06.401927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-955d2b21-06e7-42a1-a1a6-b02273a3002c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:06.405311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:06.408502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:06.410925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:06.513193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-955d2b21-06e7-42a1-a1a6-b02273a3002c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:06.523989 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-955d2b21-06e7-42a1-a1a6-b02273a3002c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1267 microversion: 2.1 time: 0.126116 Aug 30 18:08:06.526944 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2838/5940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:06 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:07.552429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:07.553432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:07.568439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:07.568931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:07.569378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:07.570170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:07.572595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:07.573048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:07.898124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:07.919247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73d5f395-d24c-45c3-bcb3-7ecf46329fe0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1271 microversion: 2.1 time: 0.373778 Aug 30 18:08:07.920147 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3103/5941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:07 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:08.943424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:08.946724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:08.980471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:08.981363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:08.982647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:08.985337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:08.987374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:08.992873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:09.366428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:09.398612 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5512e19d-a61d-4e6d-a601-8093704abacc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1325 microversion: 2.1 time: 0.460855 Aug 30 18:08:09.402032 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2839/5942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:08 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:10.431030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:10.432338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:10.451820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:10.452587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:10.453452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:10.455076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:10.457611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:10.458905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:10.844931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:10.862973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94655625-69d3-4ec0-b2b9-7e1d68a021e2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.441442 Aug 30 18:08:10.877042 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3104/5943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:10 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:11.355110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:11.356841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:11.357505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:11.358113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:11.359073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:11.360085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:11.360817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:11.403113 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d4e1aa2a-75e7-4333-b2f2-5db14697e23f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.252000 Aug 30 18:08:11.409485 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2840/5944] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 30 18:08:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:11.550345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1891616888", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "availability_zone": "nova:n-h2-852771-11", "networks": [{"uuid": "e40be65c-f8cb-494a-a7f5-0589248c2ea7"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:11.638484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] validate_networks() for [('e40be65c-f8cb-494a-a7f5-0589248c2ea7', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:08:11.686021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:11.705159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:11.705735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:11.706243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:11.727747 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] Creating event network-changed:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:08:11.747363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7130d659-d7bb-4ac1-b188-e85eac37dae9 req-07d61236-e0d7-43ab-bcc4-f0ad1672fdb8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064862 Aug 30 18:08:11.748649 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2841/5945] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:11.887313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:11.888347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:11.896260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:11.897111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:11.897938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:11.898889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:11.899592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:11.900377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.504701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:08:12.505134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:08:12.505616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:08:12.506032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:08:12.506555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:08:12.523665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.524173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.524622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.525384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.525845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.526283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.576315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Getting quotas for project 8cfec4b2534249689fccfa858026879d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:08:12.585099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Getting quotas for user 9a527190f6594e0585abacd6fee6d800 and project 8cfec4b2534249689fccfa858026879d. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:08:12.606911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:08:12.609252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:08:12.679268 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-da4c636c-b57b-4cdb-b9e1-c4254bc64e8c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131136 Aug 30 18:08:12.681533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3105/5946] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:08:12.692441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bee2ecb3-b024-483c-acd0-b3e131ee93a5 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:12.701690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bee2ecb3-b024-483c-acd0-b3e131ee93a5 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:12.864980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:12.880625 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86b800f2-8cb4-4acf-acb7-77ce43b68bb2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.997650 Aug 30 18:08:12.881615 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2842/5947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:11 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:12.919753 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bee2ecb3-b024-483c-acd0-b3e131ee93a5 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1329 microversion: 2.1 time: 0.230934 Aug 30 18:08:12.920385 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3106/5948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:12 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1329 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:13.903929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:13.904742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:13.912399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:13.912880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:13.913314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:13.914005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:13.914454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:13.914930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:13.958335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:13.958952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:13.966400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:13.966880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:13.967313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:13.968039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:13.968490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:13.968914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:14.046351 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fe97fb17-aa09-4a3b-81aa-90d4fad92311 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1418 microversion: 2.1 time: 0.091865 Aug 30 18:08:14.048219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3107/5949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:13 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1418 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:14.163364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:14.176182 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90e5cdc7-5fc5-48d3-a8ad-c89d600994fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.276426 Aug 30 18:08:14.183594 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2843/5950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:13 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:15.067858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:15.070303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:15.079978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:15.080867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:15.081829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:15.082995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:15.083823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:15.084438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:15.211357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:15.217176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:15.228892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:15.231554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:15.232005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:15.232736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:15.233183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:15.233821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:15.378715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e68b148b-685e-4a5c-8fda-cf93bec99467 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.314434 Aug 30 18:08:15.379745 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3108/5951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:15 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:15.598851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:15.613152 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4728557c-ef84-42d8-b90b-34362d281add tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.411293 Aug 30 18:08:15.614987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2844/5952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:15 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:16.220448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c45f3f-9506-46a2-8b0f-7e2db369fcc9", "tag": "504dd865-856f-4c1d-a511-e9406e302101"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:16.251279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:16.252295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:16.252736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:16.284567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] Creating event network-changed:504dd865-856f-4c1d-a511-e9406e302101 for instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 on n-h2-852771-11 Aug 30 18:08:16.291305 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cb39c6fe-380a-4b83-9594-fec5f75d2461 req-e69be06a-0b52-438c-bc02-d5cb0e1f810f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075965 Aug 30 18:08:16.293770 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3109/5953] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:16.401222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:16.404778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:16.429163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:16.429672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:16.430112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:16.431827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:16.431827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:16.431827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:16.523953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:16.637944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:16.638929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:16.646138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:16.646869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:16.647715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:16.648728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:16.649510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:16.651177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:16.695559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-201d70d1-d38c-4080-a218-3c2ecae024d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.291930 Aug 30 18:08:16.697246 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2845/5954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:16 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:16.868952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:16.877939 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e62d66a6-6cab-4349-a4f7-c6315c43aada tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.244664 Aug 30 18:08:16.878564 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3110/5955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:16 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:17.605638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "name": "network-vif-plugged", "status": "completed", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:17.616454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:17.616940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:17.617688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:17.630506 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] Creating event network-vif-plugged:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:08:17.636569 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2701574c-0cc2-4383-9867-774272df794e req-9a28f4f1-7ae8-485e-b1c1-6b168dd05243 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153309 Aug 30 18:08:17.637903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2846/5956] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:17.717968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:17.719250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:17.726557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:17.727296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:17.727959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:17.729224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:17.732282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:17.732948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:17.900964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:17.901681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:17.912910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:17.913408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:17.913849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:17.914561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:17.916600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b683333f-93ad-40f3-9bd2-aa6becbcf9f1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.201664 Aug 30 18:08:17.917920 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3111/5957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:17 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:17.920250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:17.921102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:18.195269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:18.208746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b3d4870-0f12-4bbb-91a3-d6b509a00498 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1392 microversion: 2.1 time: 0.313036 Aug 30 18:08:18.224389 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2847/5958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:17 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:18.945016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:18.945908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:18.953436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:18.954159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:18.954274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:18.955207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:18.955894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:18.956331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.112538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b8fb599-c201-416c-83dc-e755d84b52b6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.171378 Aug 30 18:08:19.113408 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3112/5959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:18 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:19.232078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:19.232898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:19.240721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.241327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.241773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.242507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.243020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.243445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.399699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:19.408572 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-560d4d8f-9ea6-49e3-a5c4-f2abd9fad3fe tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1564 microversion: 2.1 time: 0.180346 Aug 30 18:08:19.409171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2848/5960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:19 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:19.430022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:19.430641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:19.438274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.439124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.439840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.440805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.441272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.441706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.593508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:19.604843 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-daa9ec2f-f648-4f6e-9a59-98d3b1618f5d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1564 microversion: 2.1 time: 0.178659 Aug 30 18:08:19.605454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3113/5961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:19 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:19.804443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4711af72-67d5-46a1-b534-1f2209a79df5", "device": "/dev/sdb"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:19.806928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:19.813417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.813894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.814378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:19.815247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:19.815724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:19.816148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:20.079655 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-68200aad-de8f-467e-ae76-58c92ab6cfbb tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "POST /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278770 Aug 30 18:08:20.080292 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2849/5962] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:08:19 2022] POST /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:20.135018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:20.136480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:20.146852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:20.147610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:20.148264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:20.150102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:20.150739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:20.151336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:20.366111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a2ccce7-195e-46c1-9587-e3afac62c2f0 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.235084 Aug 30 18:08:20.380670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3114/5963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:20 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:21.386768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:21.387656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:21.390844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:21.397758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:21.398397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:21.398935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:21.399768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:21.400323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:21.400866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:21.644502 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-37a7855c-5b70-4a6c-877b-591478619cee tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.261764 Aug 30 18:08:21.645123 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2850/5964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:21 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:21.855859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:21.858266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:21.858894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:21.872085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:21.872589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:21.873029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:21.879193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:21.880475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:21.880921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:21.881355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:21.887259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:21.887259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:21.905215 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] Creating event network-changed:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:08:21.919228 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4ce01c60-affd-4b26-a31d-3d4f265e060e req-51d00e24-c866-45b9-914c-f8cc07961ebb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068183 Aug 30 18:08:21.920601 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2851/5965] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:22.081625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:22.092618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-781569bc-9e9f-4b45-b2a6-a8af0d2e351e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1564 microversion: 2.1 time: 0.248928 Aug 30 18:08:22.108065 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3115/5966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:21 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:22.668081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:22.668845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:22.676007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:22.676490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:22.677976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:22.677976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:22.678427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:22.679021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:22.828206 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d408b1a-52d8-40ee-ad86-6233fb186e26 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.165367 Aug 30 18:08:22.832027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2852/5967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:22 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:22.840629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c45f3f-9506-46a2-8b0f-7e2db369fcc9", "name": "network-vif-plugged", "status": "completed", "tag": "504dd865-856f-4c1d-a511-e9406e302101"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:22.847431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:22.856068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:22.856739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:22.857326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:22.870137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] Creating event network-vif-plugged:504dd865-856f-4c1d-a511-e9406e302101 for instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 on n-h2-852771-11 Aug 30 18:08:22.875797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6f1d4a3c-37f1-4599-bbd3-7986b941df08 req-7050c94e-0aaa-4806-9d27-237ee2bdd509 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040790 Aug 30 18:08:22.876400 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3116/5968] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:08:23.849307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:23.849817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:23.856755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:23.857226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:23.857655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:23.858337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:23.858777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:23.859200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:23.987416 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36c692b4-c529-49cb-a441-99ba4d1c455c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1466 microversion: 2.1 time: 0.141932 Aug 30 18:08:23.988036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2853/5969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:23 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:25.005125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:25.013087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:25.014330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:25.023677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.024177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.024626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.025343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.025807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.026247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.162959 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9227764f-c721-4bc8-8399-4872b8d96f95 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1651 microversion: 2.1 time: 0.158726 Aug 30 18:08:25.163578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3117/5970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:25 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1651 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:25.183936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:25.184551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:25.191917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.192419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.192831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.193519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.193966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.194383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.331662 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f336561a-33d6-4f1a-a542-5cf275b0a474 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1651 microversion: 2.1 time: 0.151503 Aug 30 18:08:25.332242 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2854/5971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:25 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:25.351591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:25.352206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:25.358234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.358712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.359145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.359859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.360340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.360759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.489866 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1217cb6-a8a7-452c-b881-8f92d3af4e06 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1651 microversion: 2.1 time: 0.142186 Aug 30 18:08:25.490456 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3118/5972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:25 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1651 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:25.549384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1452698915", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "availability_zone": "nova:n-h1-852771-11", "networks": [{"uuid": "e40be65c-f8cb-494a-a7f5-0589248c2ea7"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:25.610015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] validate_networks() for [('e40be65c-f8cb-494a-a7f5-0589248c2ea7', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:08:25.982055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:08:25.982476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:08:25.982980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:08:25.983387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:08:25.983832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:08:25.993388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.993859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.994316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:25.995039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:25.995498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:25.995935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:26.013825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Getting quotas for project 8cfec4b2534249689fccfa858026879d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:08:26.019700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Getting quotas for user 9a527190f6594e0585abacd6fee6d800 and project 8cfec4b2534249689fccfa858026879d. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:08:26.032234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:08:26.034527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:08:26.082398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-97862728-dc52-4934-950d-653b7874283a tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536883 Aug 30 18:08:26.083029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2855/5973] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:08:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:08:26.093798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-baf7ebe4-8a3f-4660-90c1-44761b3157d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:26.094738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-baf7ebe4-8a3f-4660-90c1-44761b3157d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:26.156297 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-baf7ebe4-8a3f-4660-90c1-44761b3157d8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1329 microversion: 2.1 time: 0.065987 Aug 30 18:08:26.156857 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3119/5974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:26 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:27.177115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:27.177717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:27.186527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:27.187788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:27.188247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:27.189625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:27.189625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:27.190176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:27.295854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ace7a6f-973f-4f27-a359-3c82f1f1a6eb tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1424 microversion: 2.1 time: 0.122196 Aug 30 18:08:27.296667 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2856/5975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:27 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:28.260101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec30755-b31e-40ed-a528-1911760cfd08", "tag": "fb271d26-e7d8-45b0-b7b5-40baac64b1a4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:28.273400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:28.273877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:28.274335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:28.287746 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] Creating event network-changed:fb271d26-e7d8-45b0-b7b5-40baac64b1a4 for instance aec30755-b31e-40ed-a528-1911760cfd08 on n-h1-852771-11 Aug 30 18:08:28.293870 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-3a161894-f44e-46f8-a214-737a895e3c79 req-556cfe18-a93f-4178-ba97-b09fb9bb3451 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037240 Aug 30 18:08:28.294975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3120/5976] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:28.317249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:28.318007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:28.327746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:28.328323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:28.328836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:28.329808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:28.330480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:28.330994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:28.357992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:28.561090 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64ed5d46-24fb-4148-86d2-fb22c52b9c8f tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.248250 Aug 30 18:08:28.561713 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2857/5977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:28 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:29.584294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:29.584906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:29.591495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:29.592053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:29.592486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:29.593206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:29.593742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:29.594155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:29.723406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a8c954a3-ff81-431c-89ce-c3d02e0429c1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.144092 Aug 30 18:08:29.724494 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3121/5978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:29 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:30.745425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:30.746064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:30.753836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:30.754327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:30.754770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:30.755472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:30.755950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:30.756381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:30.893145 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6617f6d8-5b9d-4753-bb88-36dd82d460bd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.151895 Aug 30 18:08:30.893747 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2858/5979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:30 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:31.913668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:31.914296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:31.922093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:31.922707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:31.923149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:31.923879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:31.924339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:31.924776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:32.055677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd458033-8e48-4de8-a4fe-800f1c40300b tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.145787 Aug 30 18:08:32.067862 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3122/5980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:31 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:33.077299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:33.078174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:33.085412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:33.085903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:33.086597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:33.087544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:33.088012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:33.088440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:33.225835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-239bdeb0-d527-4956-904d-4f1ccbbab6c4 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.152249 Aug 30 18:08:33.226463 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2859/5981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:33 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:33.550348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec30755-b31e-40ed-a528-1911760cfd08", "name": "network-vif-plugged", "status": "completed", "tag": "fb271d26-e7d8-45b0-b7b5-40baac64b1a4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:33.561839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:33.562559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:33.563168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:33.574449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] Creating event network-vif-plugged:fb271d26-e7d8-45b0-b7b5-40baac64b1a4 for instance aec30755-b31e-40ed-a528-1911760cfd08 on n-h1-852771-11 Aug 30 18:08:33.580192 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e1739224-163f-45dd-afeb-0e53d1f90538 req-3c7cb768-cc1e-48a4-af81-ff1498b9e236 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036039 Aug 30 18:08:33.581014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3123/5982] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:34.248908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:34.250241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:34.256806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:34.257290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:34.258466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:34.259167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:34.259696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:34.260061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:34.400035 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbd6b9d6-bfd3-45e6-820e-f1d48a5c6b93 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1466 microversion: 2.1 time: 0.155087 Aug 30 18:08:34.400624 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2860/5983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:34 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:35.423138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:35.423948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:35.426149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:35.432811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.433435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.434013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.434765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.435238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.435674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.438962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:35.586942 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13bb621a-af56-4bd4-9bea-4d6adcaae2f9 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1650 microversion: 2.1 time: 0.168903 Aug 30 18:08:35.587535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3124/5984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:35 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:35.607728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:35.608409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:35.615409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.615941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.616383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.617077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.617531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.617957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.751021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d805db68-bdb4-47fd-bc55-eded93729ae1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1650 microversion: 2.1 time: 0.147187 Aug 30 18:08:35.751625 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2861/5985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:35 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:35.770969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:35.771536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:35.777561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.778042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.778477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.779170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.779652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.780081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.907313 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f596627-99d2-4f84-9716-b4b58158f8fd tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1650 microversion: 2.1 time: 0.140068 Aug 30 18:08:35.907928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3125/5986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:35 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1650 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:35.927490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:35.928066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:35.934027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.934501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.934933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.935645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:35.936098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:35.936563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:35.962703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:08:36.003072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:36.028133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:36.047989 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d5d4d8e-fe09-4a19-9d4c-dccd33c787b3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 204 len: 0 microversion: 2.1 time: 0.123903 Aug 30 18:08:36.048587 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2862/5987] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:08:35 2022] DELETE /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:08:36.057382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:36.058032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:36.064144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:36.064626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:36.065057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:36.065741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:36.066191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:36.066613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:36.153605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:36.200466 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-76b7bd51-cde0-4664-8ef1-8a09b5005ca1 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1656 microversion: 2.1 time: 0.146699 Aug 30 18:08:36.201049 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3126/5988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:36 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:37.223491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:37.224214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:37.227251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:37.232656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:37.233138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:37.234398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:37.235128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:37.235610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:37.236045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:37.365426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-adf5a91c-cba9-48e5-8a82-402211722459 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1656 microversion: 2.1 time: 0.146513 Aug 30 18:08:37.366005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2863/5989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:37 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:37.833256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec30755-b31e-40ed-a528-1911760cfd08", "name": "network-vif-deleted", "tag": "fb271d26-e7d8-45b0-b7b5-40baac64b1a4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:37.868477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:37.869423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:37.870218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:37.884470 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] Creating event network-vif-deleted:fb271d26-e7d8-45b0-b7b5-40baac64b1a4 for instance aec30755-b31e-40ed-a528-1911760cfd08 on n-h1-852771-11 Aug 30 18:08:37.891844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1b71820b-3e4f-49d6-85ea-7ce0b1acc03f req-2fe4eb35-f0ae-4b94-a052-aec2b3439a94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062906 Aug 30 18:08:37.893145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3127/5990] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:38.386679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:38.387393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:38.400805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:38.401397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:38.401908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:38.402755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:38.403434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:38.404062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:38.440233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:38.440740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:38.441899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:38.442364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lazy-loading 'fault' on Instance uuid aec30755-b31e-40ed-a528-1911760cfd08 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:08:38.510000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d55d1830-2702-42bb-9b65-66b8c549e8f8 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 200 len: 1456 microversion: 2.1 time: 0.127446 Aug 30 18:08:38.510806 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2864/5991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:38 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 1456 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:39.534004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:39.534714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: aec30755-b31e-40ed-a528-1911760cfd08] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:39.540972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.541460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.541902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.542598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.543058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.543504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.557538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] HTTP exception thrown: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Request method failure captured: Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 HTTP/1.1 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlILY-XbZw1Q9bB3fPqsTO4QQZXTYB0G9Q2Bqh0DpUhX4-_-1TleFQFMSqSzKxtyka4lbq_FNl1_HPqYXBPCIXs6Lyi5s_5OWWNELDRmBWJoKRr4fnOrpyG7Lap4jKjNPwc-FwRHReYUEGT3n0oye7huTckt8_hHtzq7xVFtTvQyP1k Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 8cfec4b2534249689fccfa858026879d Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestServerMultinode-1419943070 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8cfec4b2534249689fccfa858026879d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8cfec4b2534249689fccfa858026879d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8cfec4b2534249689fccfa858026879d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8cfec4b2534249689fccfa858026879d"}]}] Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestServerMultinode-1419943070 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 8cfec4b2534249689fccfa858026879d Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestServerMultinode-1419943070 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestServerMultinode-1419943070-project-admin Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 9a527190f6594e0585abacd6fee6d800 Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestServerMultinode-1419943070-project-admin Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'aec30755-b31e-40ed-a528-1911760cfd08'} Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:39.559143 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Returning 404 to user: Instance aec30755-b31e-40ed-a528-1911760cfd08 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e08deb14-a4e7-43a9-aed7-a0c0ba4b773c tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08" status: 404 len: 111 microversion: 2.1 time: 0.032444 Aug 30 18:08:39.564579 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3128/5992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:39 2022] GET /compute/v2.1/servers/aec30755-b31e-40ed-a528-1911760cfd08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:08:39.569263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:39.569763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:39.576591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.577667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.578116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.578811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.579265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.579721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.606251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:08:39.687268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f1ee0644-6390-4f5d-a78a-a9cb7eaa8ba3 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 204 len: 0 microversion: 2.1 time: 0.121438 Aug 30 18:08:39.687902 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2865/5993] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:08:39 2022] DELETE /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:08:39.696071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:39.696790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:39.703882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.704559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.705122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.705911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:39.706429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:39.706921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:39.851469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a61ac3b-5878-42df-b099-30e83da39a0d tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1657 microversion: 2.1 time: 0.159096 Aug 30 18:08:39.852187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3129/5994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:39 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:40.873430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:40.875056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:40.882984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:40.883563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:40.884215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:40.885143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:40.885662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:40.886159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:41.128662 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1b74956c-9602-45a3-8471-a4daba925126 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 200 len: 1657 microversion: 2.1 time: 0.259264 Aug 30 18:08:41.129435 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2866/5995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:40 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 1657 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:41.482037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c45f3f-9506-46a2-8b0f-7e2db369fcc9", "name": "network-vif-deleted", "tag": "504dd865-856f-4c1d-a511-e9406e302101"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:41.494266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:41.494753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:41.495193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:41.507354 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] Creating event network-vif-deleted:504dd865-856f-4c1d-a511-e9406e302101 for instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 on n-h2-852771-11 Aug 30 18:08:41.512321 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a58aa968-e9be-4afd-84b6-e747e5463481 req-e6137e76-f945-41a9-a68d-76bd641171bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034042 Aug 30 18:08:41.513464 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3130/5996] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:42.149405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:42.150128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] [instance: d7c45f3f-9506-46a2-8b0f-7e2db369fcc9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:42.158141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:42.158734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:42.159175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:42.159965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:42.160398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:42.160826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:42.175037 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] HTTP exception thrown: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Request method failure captured: Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 HTTP/1.1 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlILY-XbZw1Q9bB3fPqsTO4QQZXTYB0G9Q2Bqh0DpUhX4-_-1TleFQFMSqSzKxtyka4lbq_FNl1_HPqYXBPCIXs6Lyi5s_5OWWNELDRmBWJoKRr4fnOrpyG7Lap4jKjNPwc-FwRHReYUEGT3n0oye7huTckt8_hHtzq7xVFtTvQyP1k Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 8cfec4b2534249689fccfa858026879d Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestServerMultinode-1419943070 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8cfec4b2534249689fccfa858026879d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8cfec4b2534249689fccfa858026879d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8cfec4b2534249689fccfa858026879d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8cfec4b2534249689fccfa858026879d"}]}] Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestServerMultinode-1419943070 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 8cfec4b2534249689fccfa858026879d Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestServerMultinode-1419943070 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestServerMultinode-1419943070-project-admin Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 9a527190f6594e0585abacd6fee6d800 Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestServerMultinode-1419943070-project-admin Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'd7c45f3f-9506-46a2-8b0f-7e2db369fcc9'} Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:42.176725 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] Returning 404 to user: Instance d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07d79fda-7829-430f-b6ff-f05a8e7047a6 tempest-TestServerMultinode-1419943070 tempest-TestServerMultinode-1419943070-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9" status: 404 len: 111 microversion: 2.1 time: 0.032514 Aug 30 18:08:42.181114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2867/5997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:42 2022] GET /compute/v2.1/servers/d7c45f3f-9506-46a2-8b0f-7e2db369fcc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:08:44.054180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:44.055397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:44.063021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:44.063552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:44.063997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:44.064706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:44.065158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:44.065581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:44.159449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lazy-loading 'services' on Instance uuid fd26f099-6cc2-4042-95f4-517179a48471 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:08:44.251117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-929f62a9-aa98-44f3-a7ad-82bc9abe1855 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471/os-volume_attachments/4711af72-67d5-46a1-b534-1f2209a79df5" status: 202 len: 0 microversion: 2.1 time: 0.202374 Aug 30 18:08:44.255050 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3131/5998] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:08:44 2022] DELETE /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471/os-volume_attachments/4711af72-67d5-46a1-b534-1f2209a79df5 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:08:44.439954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:44.444242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:44.458095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:44.458967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:44.459421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:44.460480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:44.461098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:44.461959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:44.520032 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-77d22525-8ddd-46f1-ae56-633c278c30f4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action" status: 200 len: 24566 microversion: 2.1 time: 0.085437 Aug 30 18:08:44.521008 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2868/5999] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:08:44 2022] POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action => generated 24566 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:08:49.687769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:49.688365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:49.694722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:49.695206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:49.695670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:49.696372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:49.696827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:49.697906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:49.726134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:08:49.815918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc7be932-5102-4331-9e84-7cdb4aeddda0 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 204 len: 0 microversion: 2.1 time: 0.133084 Aug 30 18:08:49.819872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3132/6000] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:08:49 2022] DELETE /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:08:49.825910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:49.826625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:49.835318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:49.836087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:49.836531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:49.837494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:49.838118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:49.838921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:49.989553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:49.997786 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-79b39d97-2337-4181-b171-1c4e62edad4a tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1514 microversion: 2.1 time: 0.176207 Aug 30 18:08:49.998360 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2869/6001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:49 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:51.019931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:51.020642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:51.027528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:51.028021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:51.028734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:51.029429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:51.029925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:51.030353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:51.168100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:51.176066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-af3f7979-6d70-40b1-9c3c-d3a44976e0f4 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 200 len: 1514 microversion: 2.1 time: 0.161628 Aug 30 18:08:51.176649 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3133/6002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:51 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:51.676946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd26f099-6cc2-4042-95f4-517179a48471", "name": "network-vif-deleted", "tag": "18bc9599-cedc-4fe6-952e-be074e215e27"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:51.687931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:51.688404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:51.688831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:51.700147 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] Creating event network-vif-deleted:18bc9599-cedc-4fe6-952e-be074e215e27 for instance fd26f099-6cc2-4042-95f4-517179a48471 on n-h2-852771-11 Aug 30 18:08:51.705345 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-09fd52c7-eaab-45ab-9425-d4e7dda57863 req-6077c776-c24c-4db3-9cfd-a3190a5c8b27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Aug 30 18:08:51.705944 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2870/6003] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:08:52.196965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:52.197586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: fd26f099-6cc2-4042-95f4-517179a48471] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:52.204750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:52.205230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:52.205660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:52.206349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:52.206797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:52.207215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:52.222135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] HTTP exception thrown: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Request method failure captured: Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 HTTP/1.1 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlG3szRb-vuyhuSKrw2993LM2W6EK2IWNi1noCcNbcQLStkweu1-K0PzWQHupo4f679Fn_Uo0vl__RFn27ZJaUd6b25bowB2FSG1_XKwD9YBwCszgbRxae8zwklVSLK5uIYsYpJhnGKSGf2JJzNIdCi89v2AWAZy1ehm6FEk0VBRuvQ Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4fcc879e0cb54aab84942cc66bb1127e Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4fcc879e0cb54aab84942cc66bb1127e"}]}] Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4fcc879e0cb54aab84942cc66bb1127e Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesSnapshotTestJSON-830172410-project Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 38ce25b5fd304974aca47b5551bf5beb Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesSnapshotTestJSON-830172410-project Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'fd26f099-6cc2-4042-95f4-517179a48471'} Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:08:52.223818 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Returning 404 to user: Instance fd26f099-6cc2-4042-95f4-517179a48471 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:08:52.229094 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0456830-b1cc-473a-81a3-44a660f300a6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471" status: 404 len: 111 microversion: 2.1 time: 0.032345 Aug 30 18:08:52.231116 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3134/6004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:52 2022] GET /compute/v2.1/servers/fd26f099-6cc2-4042-95f4-517179a48471 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:08:55.453797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:55.454525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:55.460903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.461447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.461884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.462837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.463286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.463740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.596870 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32f22577-62e8-41ef-bfb6-636ee42dcb50 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1835 microversion: 2.1 time: 0.148016 Aug 30 18:08:55.597479 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2871/6005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:55 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1835 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:55.618421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:55.619040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:55.626981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.627465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.627926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.628623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.629076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.629504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.768674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:55.778598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1c32ce9-3744-48d7-ab64-8244d36f5ec0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1682 microversion: 2.1 time: 0.164183 Aug 30 18:08:55.779290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3135/6006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:55 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:55.890617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:55.893041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:55.903818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.904566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.905011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.905750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:55.906839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:55.907514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:55.911977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:08:55.960633 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-499ff9ff-17d8-4cd8-a362-5ed454878b65 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action" status: 200 len: 32638 microversion: 2.1 time: 0.073944 Aug 30 18:08:55.961295 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2872/6007] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:08:55 2022] POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:08:56.121216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:56.121794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:56.127980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:56.128464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:56.128897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:56.129586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:56.130038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:56.130463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:56.174616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1f99fffff2984814852c4f53db440e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c96e441f4284efd92c52d92eccc7ba3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:56.175266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] flavor_id is None. Assuming migration. {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:08:56.175751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:08:56.467469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3adf6cbe-6b41-42e3-80d3-12ba55d6254e tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action" status: 202 len: 0 microversion: 2.1 time: 0.350102 Aug 30 18:08:56.468122 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3136/6008] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:08:56 2022] POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:08:56.477738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:56.478447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:56.486179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:56.486747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:56.487196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:56.487938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:56.488393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:56.488829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:56.626294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:56.634148 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ca8bf2e5-95ef-4ff4-a2fe-3ac307a12f62 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1691 microversion: 2.1 time: 0.160797 Aug 30 18:08:56.634730 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2873/6009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:56 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:08:57.657942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:57.658478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:57.664749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:57.665238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:57.665688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:57.666393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:57.666887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:57.667323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:57.804393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:57.812479 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48807eca-93c2-4925-85d5-988ad6addac6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1691 microversion: 2.1 time: 0.160099 Aug 30 18:08:57.813185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3137/6010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:57 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:58.833959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:58.834590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:58.842444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:58.842923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:58.843356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:58.844582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:58.845029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:58.845453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:58.982129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:58.990923 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-635e1292-561d-4d92-a3b0-d0da964bf655 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.160876 Aug 30 18:08:58.991526 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2874/6011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:58 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:08:59.065397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-97051006", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "d66fd8f8-2720-47df-8150-af794f52c404"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:08:59.119135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] validate_networks() for [('d66fd8f8-2720-47df-8150-af794f52c404', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:08:59.470033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:08:59.470465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:08:59.470954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:08:59.471370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:08:59.471838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:08:59.480916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:59.481404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:59.481855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:59.482593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:59.483056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:59.483547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:59.502166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Getting quotas for project 4fcc879e0cb54aab84942cc66bb1127e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:08:59.507552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Getting quotas for user 38ce25b5fd304974aca47b5551bf5beb and project 4fcc879e0cb54aab84942cc66bb1127e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:08:59.520806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:08:59.523102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:08:59.569664 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c3a50d4-1cd7-490d-b529-7b7fdb75a9e6 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508751 Aug 30 18:08:59.570325 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3138/6012] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:08:59.581327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff30637e-f797-4bcc-91b5-0f20a0d3ae33 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:08:59.581948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff30637e-f797-4bcc-91b5-0f20a0d3ae33 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:08:59.637736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff30637e-f797-4bcc-91b5-0f20a0d3ae33 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:08:59.645230 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff30637e-f797-4bcc-91b5-0f20a0d3ae33 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1217 microversion: 2.1 time: 0.067875 Aug 30 18:08:59.645822 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2875/6013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:08:59 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:00.012662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:00.013288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:00.020675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:00.021214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:00.021664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:00.022369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:00.022832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:00.023267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:00.164932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:00.173228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-459b6407-e45b-462e-b331-b02a17e20a22 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.164562 Aug 30 18:09:00.173821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3139/6014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:00 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:00.666911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:00.667571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:00.677972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:00.678518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:00.678966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:00.679743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:00.680277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:00.680748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:00.755696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:00.763952 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcfea55f-2d38-404a-b0e2-c4e05bbe3dfe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1275 microversion: 2.1 time: 0.101616 Aug 30 18:09:00.764554 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2876/6015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:00 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:01.194491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:01.195027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:01.202069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:01.202557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:01.202994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:01.203726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:01.204181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:01.204612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:01.210052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:01.341980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:01.350317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-234c7d9e-50d3-478f-bf27-143885398ee0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.159970 Aug 30 18:09:01.350908 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3140/6016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:01 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:01.785272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:01.785919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:01.793239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:01.793880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:01.794443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:01.795376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:01.795873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:01.796297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:01.816989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef74ae4b-1be4-4d54-96d4-91469138fa18", "tag": "e21ef898-f3d3-449f-a72e-66ce1fa788d3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:01.831342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:01.832390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:01.832958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:01.846617 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] Creating event network-changed:e21ef898-f3d3-449f-a72e-66ce1fa788d3 for instance ef74ae4b-1be4-4d54-96d4-91469138fa18 on n-h2-852771-11 Aug 30 18:09:01.851773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-980d0d3f-f434-494d-8343-6449fb60dff0 req-9ac3249a-619c-4d12-8eac-b77e4c9d309a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040381 Aug 30 18:09:01.852481 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3141/6017] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:02.054529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:02.063393 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49a9e125-fa28-486c-9378-4ac0b55fb93f tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.282232 Aug 30 18:09:02.064027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2877/6018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:01 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:02.373583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:02.374209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:02.381469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:02.381953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:02.382393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:02.383082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:02.383583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:02.384013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:02.519266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:02.527113 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfc6be1a-ad79-4bdc-a68c-b07d82acb22b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.158810 Aug 30 18:09:02.527725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3142/6019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:02 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:03.084558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:03.085409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:03.092692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.093176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.093610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.095129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.095609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.096038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.324790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:03.333824 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96067f87-8464-460d-bee1-a0091f2e395d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.253120 Aug 30 18:09:03.334421 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2878/6020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:03 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:03.548615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:03.549383 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:03.556327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.556810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.557251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.557938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.558484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.558912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.695222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:03.703141 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8a6a8d9-fea1-4fce-873a-3ea32077a102 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.158513 Aug 30 18:09:03.704133 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3143/6021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:03 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:04.354919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.355548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:04.362368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.362843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.363271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.363986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.364433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.364852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.499455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:04.507941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e67c5ab-20e4-43fa-adef-9cb6eb010bd5 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.157145 Aug 30 18:09:04.508523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2879/6022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:04.724602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.725158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:04.731968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.732446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.732879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.733565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.734016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.734440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.876056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:04.883746 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d527cef-1c4b-4734-8918-5355722c0e27 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.163169 Aug 30 18:09:04.884324 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3144/6023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:05.528604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.529159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:05.536656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.537129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.537560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.538244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.538691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.539111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.668158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.675901 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63840d92-6380-47e4-9a95-91bf77921168 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.151326 Aug 30 18:09:05.676475 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2880/6024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:05.905271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.905809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:05.908051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:05.913416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.913908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.914348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.915049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.915522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.915955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:06.048218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:06.055924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1170bc67-b9d1-4ff0-a87c-9ae2233842b7 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.154804 Aug 30 18:09:06.056503 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3145/6025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:06.696997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.697616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:06.705005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:06.705482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:06.705912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:06.706595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:06.707044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:06.707467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:06.839650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:06.848091 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7052ee96-559c-46a6-b711-5516d93e57c2 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.154993 Aug 30 18:09:06.848678 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2881/6026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:06 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.077552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.078237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:07.085979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.086459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.086892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:07.087604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.088060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.088737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:07.228016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:07.236057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-25673c60-e798-4952-9111-10bd5bc2c57d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.162402 Aug 30 18:09:07.236644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3146/6027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.868292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.868902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:07.871690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:07.877074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.877552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.877985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:07.878670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.879114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.879555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:08.015835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:08.023663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e626796-b008-4867-b08d-3e58af197383 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.159129 Aug 30 18:09:08.024237 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2882/6028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:08.257608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:08.258229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:08.265550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:08.266038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:08.266564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:08.267273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:08.267758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:08.268193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:08.399424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:08.407538 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82ae7bf3-06ff-4672-abae-b8c3f9727906 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.153633 Aug 30 18:09:08.408131 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3147/6029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:08 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:08.586371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef74ae4b-1be4-4d54-96d4-91469138fa18", "name": "network-vif-plugged", "status": "completed", "tag": "e21ef898-f3d3-449f-a72e-66ce1fa788d3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:08.597004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:08.597486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:08.597911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:08.610692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] Creating event network-vif-plugged:e21ef898-f3d3-449f-a72e-66ce1fa788d3 for instance ef74ae4b-1be4-4d54-96d4-91469138fa18 on n-h2-852771-11 Aug 30 18:09:08.615930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9a561369-42c9-4e8e-8767-0c9cca4c721a req-92482e8f-b42c-40c8-a3a9-5dedec3ee0ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Aug 30 18:09:08.616529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2883/6030] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:09.044837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.045371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:09.052086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.052723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.053412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.054109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.054564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.055136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.183115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:09.190878 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a92f3bd9-ccda-4eb9-aa78-2197e56d0d5d tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1317 microversion: 2.1 time: 0.149996 Aug 30 18:09:09.191451 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3148/6031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:09.431392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.432050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:09.438804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.439458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.439928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.440628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.441081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.441511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.573708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:09.582120 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6490d48b-e071-4d71-9f28-99fab516bde1 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.157023 Aug 30 18:09:09.582731 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2884/6032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:10.211881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:10.212439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:10.215410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:10.216102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:10.222564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.223055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.223502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.224223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.224679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.225103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.365677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:10.373619 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3656a3f-abe0-4128-834f-dad8b0b61cbc tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1506 microversion: 2.1 time: 0.165810 Aug 30 18:09:10.374204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3149/6033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:10 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:10.394979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c93cfb7d-71f6-4e55-80c1-b0445a664308", "device": "/dev/sdb"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:10.397435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:10.399449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:10.404890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.405381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.405824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.406526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.407182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.407832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.604161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:10.604782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:10.611354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.612081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.612719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.613605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:10.614066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:10.614504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:10.669024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c64b6361-eb4a-4fa2-b419-80b4d857edd9 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "POST /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278674 Aug 30 18:09:10.675276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2885/6034] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:09:10 2022] POST /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:10.760615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:10.768767 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc4a50f7-78ad-4661-8e98-e08a71988479 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.168556 Aug 30 18:09:10.769350 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3150/6035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:10 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:11.802698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:11.945389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:11.953387 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5737a7bb-0d04-4cbc-9832-d1c7d4c04e64 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.166780 Aug 30 18:09:11.954176 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2886/6036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:11 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:12.976889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:12.977646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:12.985758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:12.986408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:12.986858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:12.987604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:12.988126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:12.988550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:13.134928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:13.143984 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-217419c6-b836-4bc9-be5f-1c9042c99ad3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.171070 Aug 30 18:09:13.144583 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3151/6037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:12 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:14.166297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:14.166890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:14.174832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:14.175322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:14.175794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:14.176502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:14.176957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:14.177386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:14.316258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:14.324245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3bb96f41-461f-4e10-84a8-d61c692c655f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.162027 Aug 30 18:09:14.324831 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2887/6038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:14 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:15.348127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:15.348730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:15.356873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:15.357370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:15.357806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:15.358514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:15.358972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:15.359432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:15.516676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:15.526086 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6238b17-5ea1-497c-b111-8860babbc09a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1696 microversion: 2.1 time: 0.183716 Aug 30 18:09:15.526732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3152/6039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:15 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:15.951909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "name": "network-vif-unplugged", "status": "completed", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:15.963511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:15.964251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:15.964792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:15.977632 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Creating event network-vif-unplugged:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h2-852771-11 Aug 30 18:09:15.983347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:09:15.995347 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-58049613-ebd7-4040-a766-b538b7f57f62 req-f0b3a044-3297-4cef-a021-6515df62d4d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047072 Aug 30 18:09:15.996187 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2888/6040] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:16.548953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:16.549573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:16.556475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:16.556961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:16.557396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:16.558089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:16.558546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:16.558970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:16.694975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:16.702907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4990929-0078-4417-96c8-e3e63bb22349 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1695 microversion: 2.1 time: 0.158492 Aug 30 18:09:16.703531 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3153/6041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:16 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:17.726241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:17.726933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:17.733457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:17.733921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:17.734351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:17.735035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:17.735539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:17.735963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:17.880323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:17.883978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:17.888949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-09a0b224-bea5-467f-98b1-e41bbfef7e6c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1693 microversion: 2.1 time: 0.167911 Aug 30 18:09:17.889539 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2889/6042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:17 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:18.032067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:18.042318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:18.042800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:18.043214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:18.055044 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Creating event network-changed:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h2-852771-11 Aug 30 18:09:18.060315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:09:18.071715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-be8e7874-68d3-460e-8ec3-25b5513bbdf8 req-a436967a-0b9f-4bfb-b9dd-5cdf29c91f21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043280 Aug 30 18:09:18.072355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3154/6043] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:18.911103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:18.911749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:18.919903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:18.920325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:18.920766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:18.921522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:18.921977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:18.922409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:19.068752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:19.076945 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1c6a32cd-183f-4be6-b441-5403eb206b4a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1690 microversion: 2.1 time: 0.170607 Aug 30 18:09:19.077523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2890/6044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:18 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:19.100111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:19.100737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:19.106987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:19.107468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:19.107932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:19.108628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:19.109093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:19.109523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:19.203264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:19.226487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a34d169-f267-4fb0-91bb-556c348bdcae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action" status: 202 len: 0 microversion: 2.1 time: 0.131558 Aug 30 18:09:19.227100 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3155/6045] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:09:19 2022] POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:19.235431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:19.236284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:19.242294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:19.243011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:19.243527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:19.244387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:19.244965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:19.245516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:19.444942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:19.452851 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-326ab86b-dded-48dd-8de8-1f3f4fece03c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.221328 Aug 30 18:09:19.453439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2891/6046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:19 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:20.477036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:20.477741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:20.485004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.486211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.486651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:20.487346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.487832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.488258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:20.862107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:20.870805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d6047d1-dfbb-43c7-b3ec-ddc389bbef75 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.399271 Aug 30 18:09:20.871405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3156/6047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:20 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:21.894414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:21.895033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:21.902009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.902489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.902931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.903663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.904118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.904546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:22.039986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:22.047840 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9eb2da5-b45d-46e0-b7b2-02c1e094a448 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.158681 Aug 30 18:09:22.048422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2892/6048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:21 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:23.070043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:23.071322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:23.080315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:23.080802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:23.081235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:23.081967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:23.082416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:23.082837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:23.232939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:23.242149 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b74460d-293d-48a0-9f70-e6416b2ae916 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.176726 Aug 30 18:09:23.243157 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3157/6049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:23 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:24.064097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:24.084216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.084955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.092154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.109977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Creating event network-changed:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:09:24.119023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:09:24.130710 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-5bcbe925-eeb8-4290-bc91-c57480d01958 req-7783008c-e685-4881-b3e0-c049eceae897 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071535 Aug 30 18:09:24.132466 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2893/6050] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:24.267767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.268518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:24.276098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.276597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.277042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.277754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.278214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.278645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.419713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:24.429911 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-013beee8-364f-41dd-af42-1ccf22b67903 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.168654 Aug 30 18:09:24.430849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3158/6051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:25.453420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.454464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:25.461187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.461670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.462103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.462800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.463246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.463704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.600886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:25.608782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c9ee3445-41ac-4fc7-9181-decad616f6b2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1689 microversion: 2.1 time: 0.160972 Aug 30 18:09:25.609428 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2894/6052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:26.630642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.631305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:26.638068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.638789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.639878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.640589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.641048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.641500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.777207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:26.785513 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d56c0d1-1bec-4f78-a332-e8a7363a27fb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1682 microversion: 2.1 time: 0.159069 Aug 30 18:09:26.786086 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3159/6053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:31.758292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "name": "network-vif-plugged", "status": "completed", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:31.773629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:31.775579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:31.775579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:31.787606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] Creating event network-vif-plugged:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:09:31.793329 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9b70a552-c3de-4e70-8cff-9a12e6bdd1bc req-c48e97eb-7c47-4455-8650-5a9501d3d50f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038769 Aug 30 18:09:31.794128 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2895/6054] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:33.307677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:33.308282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:33.316675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:33.317156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:33.317586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:33.318291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:33.318742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:33.319164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:33.398951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lazy-loading 'services' on Instance uuid ef74ae4b-1be4-4d54-96d4-91469138fa18 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:09:33.468850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d632a3a7-620e-4d84-ad9c-24d0538b5281 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18/os-volume_attachments/c93cfb7d-71f6-4e55-80c1-b0445a664308" status: 202 len: 0 microversion: 2.1 time: 0.165295 Aug 30 18:09:33.469578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3160/6055] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:09:33 2022] DELETE /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18/os-volume_attachments/c93cfb7d-71f6-4e55-80c1-b0445a664308 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:38.821335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.821926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:38.824690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=28 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:38.830660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.831137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.831596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.832288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.832733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.833152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.858613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:09:38.936320 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7e0a81a9-6ec6-4681-8076-eabf1f856b91 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 204 len: 0 microversion: 2.1 time: 0.118996 Aug 30 18:09:38.936967 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2896/6056] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:38 2022] DELETE /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:09:38.946257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.947014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:38.949338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=36 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:38.955729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.956210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.956646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.957346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.957799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.958224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:39.088306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.096919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65050e12-3b3c-42e4-b302-1104395f43fe tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1512 microversion: 2.1 time: 0.154978 Aug 30 18:09:39.097495 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3161/6057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:38 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:40.119051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:40.119732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:40.126581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.127079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.127539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.128245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.128699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.129127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.268589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:40.277416 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0e50a59-0599-40ea-8379-83c6a48a1884 tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1512 microversion: 2.1 time: 0.162748 Aug 30 18:09:40.278149 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2897/6058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:40 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:40.933444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef74ae4b-1be4-4d54-96d4-91469138fa18", "name": "network-vif-deleted", "tag": "e21ef898-f3d3-449f-a72e-66ce1fa788d3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:40.944635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.945124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.945558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.960615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] Creating event network-vif-deleted:e21ef898-f3d3-449f-a72e-66ce1fa788d3 for instance ef74ae4b-1be4-4d54-96d4-91469138fa18 on n-h2-852771-11 Aug 30 18:09:40.965536 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5b5c4baa-80ac-4a28-92b5-b01bb02796d8 req-c82ea5c6-2d9f-4035-bd44-5ac3e8536484 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041127 Aug 30 18:09:40.966766 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3162/6059] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:41.299228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:41.300057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:41.308219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.308705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.309136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.309829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.310421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.310874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.345869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.346280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.346710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.347152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lazy-loading 'fault' on Instance uuid ef74ae4b-1be4-4d54-96d4-91469138fa18 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:09:41.393240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ce25b5fd304974aca47b5551bf5beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcc879e0cb54aab84942cc66bb1127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:41.401491 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73b2c7af-e3fc-4fe0-9b52-c07e9c3b1a6e tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 200 len: 1307 microversion: 2.1 time: 0.107180 Aug 30 18:09:41.402073 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2898/6060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:41 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:42.424529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:42.425236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] [instance: ef74ae4b-1be4-4d54-96d4-91469138fa18] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:42.431438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:42.431950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:42.432385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:42.433073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:42.433526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:42.433952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:42.447222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] HTTP exception thrown: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Request method failure captured: Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 HTTP/1.1 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlG3szRb-vuyhuSKrw2993LM2W6EK2IWNi1noCcNbcQLStkweu1-K0PzWQHupo4f679Fn_Uo0vl__RFn27ZJaUd6b25bowB2FSG1_XKwD9YBwCszgbRxae8zwklVSLK5uIYsYpJhnGKSGf2JJzNIdCi89v2AWAZy1ehm6FEk0VBRuvQ Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4fcc879e0cb54aab84942cc66bb1127e Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4fcc879e0cb54aab84942cc66bb1127e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4fcc879e0cb54aab84942cc66bb1127e"}]}] Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4fcc879e0cb54aab84942cc66bb1127e Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830172410 Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-VolumesSnapshotTestJSON-830172410-project Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 38ce25b5fd304974aca47b5551bf5beb Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-VolumesSnapshotTestJSON-830172410-project Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'ef74ae4b-1be4-4d54-96d4-91469138fa18'} Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:42.448809 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] Returning 404 to user: Instance ef74ae4b-1be4-4d54-96d4-91469138fa18 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58cd2ea3-414b-462f-b353-1a45e5590bfa tempest-VolumesSnapshotTestJSON-830172410 tempest-VolumesSnapshotTestJSON-830172410-project] 10.222.0.50 "GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18" status: 404 len: 111 microversion: 2.1 time: 0.031740 Aug 30 18:09:42.453439 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3163/6061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:42 2022] GET /compute/v2.1/servers/ef74ae4b-1be4-4d54-96d4-91469138fa18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:51.012642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:51.014943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:51.022152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.022638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.023085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.023786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.024422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.024852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.027495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:51.089733 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-104072f2-1a44-44c2-a61d-1e40a7dee99c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action" status: 200 len: 63166 microversion: 2.1 time: 0.079813 Aug 30 18:09:51.089733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2899/6062] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:09:51 2022] POST /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063/action => generated 63166 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:57.452395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.453060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:57.456380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:57.457853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:57.464123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.464624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.465066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.465773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.466230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.466661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.604572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-55e7c788-756d-447b-bf1d-595a75095d1f tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1835 microversion: 2.1 time: 0.155959 Aug 30 18:09:57.605162 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3164/6063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:57 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1835 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:58.504730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:58.505449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:58.510469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.513289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.513779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.514282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.515107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.515750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.516188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.526210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.527407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.528041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.545151 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] Creating event network-changed:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:09:58.547530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:09:58.554713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a3f4738b-bc50-4bb3-8f86-4ea38649a7db req-8a19da89-9485-4d56-8aed-05bddc130d2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047639 Aug 30 18:09:58.558930 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3165/6064] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:58.681034 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0d6cb446-28d5-44b1-991a-8c9537a065f2 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 204 len: 0 microversion: 2.1 time: 0.180206 Aug 30 18:09:58.687972 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2900/6065] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:58 2022] DELETE /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:09:58.698068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:58.699047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:58.721663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.724652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.725709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.729019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.729840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.730294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.904755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:58.914194 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c19f7357-990d-44d7-9ff9-c4c3552d64db tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1688 microversion: 2.1 time: 0.220580 Aug 30 18:09:58.914794 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3166/6066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:58 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:59.937170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:59.937949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:59.947394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.948049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.948581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:59.949362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.949941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.950423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:00.272263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.288514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2364cd14-6354-434c-b4f4-30cbfee06052 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 200 len: 1688 microversion: 2.1 time: 0.355891 Aug 30 18:10:00.290057 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2901/6067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:59 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 1688 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:00.727533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2e0d-ea4a-42a6-8898-8269a438b063", "name": "network-vif-deleted", "tag": "2f926008-12d8-4e36-b2a9-5c7def12dd56"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:00.738960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:00.739666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:00.740195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:00.752508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] Creating event network-vif-deleted:2f926008-12d8-4e36-b2a9-5c7def12dd56 for instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 on n-h1-852771-11 Aug 30 18:10:00.758073 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-61b2d10d-47be-4745-8673-dc3bd981dd57 req-1207356f-beaf-4c15-9ced-21ad09f5a92b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034139 Aug 30 18:10:00.758793 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3167/6068] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:01.310704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:01.311577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: 95cd2e0d-ea4a-42a6-8898-8269a438b063] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:01.319577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:01.320262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:01.320701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:01.321432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:01.321884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:01.322309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:01.336615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] HTTP exception thrown: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Request method failure captured: Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 HTTP/1.1 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlGDwXmImJOpEs8dvPBn9r-uyIf9kUDlojS3mwmrJzSPSAps_CJQoqoDeiezhgu1NqiXGGSafMF1julVC5XM_xI8eLxFOKCaS_1lZb2uBaeSqlmNEC-USSPCXaAOwFbgYHiBAkWOHakWOSe2AimNS0Neqtzlrk4SLwJI2KrFpj_INKs Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c4a340bef6214caf85d78be544a88327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c4a340bef6214caf85d78be544a88327"}]}] Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b45d9856716b4bbabc9eacbed7b8fa2d Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '95cd2e0d-ea4a-42a6-8898-8269a438b063'} Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.338302 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Returning 404 to user: Instance 95cd2e0d-ea4a-42a6-8898-8269a438b063 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7b6bb1c-359f-49ee-ae3f-b8bddf1ef7f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063" status: 404 len: 111 microversion: 2.1 time: 0.032944 Aug 30 18:10:01.343252 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2902/6069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:01 2022] GET /compute/v2.1/servers/95cd2e0d-ea4a-42a6-8898-8269a438b063 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:04.714543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b304e16-f795-47e8-8d11-d9202e9ad0ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '.version_select at 0x7f2d98813f70>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:04.720389 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b304e16-f795-47e8-8d11-d9202e9ad0ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:10:05.729689 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b304e16-f795-47e8-8d11-d9202e9ad0ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59320. Aug 30 18:10:05.753580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b304e16-f795-47e8-8d11-d9202e9ad0ae tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1764394479" status: 202 len: 0 microversion: 2.1 time: 1.043031 Aug 30 18:10:05.755824 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3168/6070] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1764394479 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:05.790818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-105a5947-e2d5-4aa3-b231-d2feb057b309 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: .version_select at 0x7f2d98578d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-690890916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImu2wD2LGmwGOVvWpApXKoVu4RUkh7cVOt3GGODZ+PPCIuL1WNB1n+zJCHwBVuQsy8yX4aJwuOaPKDgygaz+uhqesAEPlrrI1+Z+LZI0wvenlgLC84yJW0+lkySXXm/4w=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:05.809512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-105a5947-e2d5-4aa3-b231-d2feb057b309 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:10:05.819752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-105a5947-e2d5-4aa3-b231-d2feb057b309 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:10:05.847336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-105a5947-e2d5-4aa3-b231-d2feb057b309 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060402 Aug 30 18:10:05.848454 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2903/6071] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:10:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:12.680005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1866241306", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "a8af153d-1fdd-48a1-a888-f833e41f47a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-690890916", "security_groups": [{"name": "tempest-secgroup-smoke-1254905777"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:12.693523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:12.831223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] validate_networks() for [('a8af153d-1fdd-48a1-a888-f833e41f47a4', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:10:13.412802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:10:13.413222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:10:13.413691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:10:13.414099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:10:13.414662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:10:13.429240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.429978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.431367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.432339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.432957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.433553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.459397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:10:13.464793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:10:13.477945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:10:13.480400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:10:13.535263 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9250f007-4135-4658-86e9-74fb0499336b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861229 Aug 30 18:10:13.536651 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3169/6072] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:10:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:10:13.545162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:13.552242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f628052-7448-4ecd-a060-3d694169d354 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.553442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f628052-7448-4ecd-a060-3d694169d354 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:13.555585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:13.633057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6f628052-7448-4ecd-a060-3d694169d354 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:13.640758 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f628052-7448-4ecd-a060-3d694169d354 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1266 microversion: 2.1 time: 0.097346 Aug 30 18:10:13.642989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2904/6073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:14.663097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:14.665138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:14.671603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.672324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.673004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.673884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.674509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.675102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.747954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:14.756342 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97aed9d1-224f-42ae-a914-c8c42cf16db0 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1318 microversion: 2.1 time: 0.098337 Aug 30 18:10:14.756933 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3170/6074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:14 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:15.781122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.781733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:15.790452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.790938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.791370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.792092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.798367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.798820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.037461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:16.054828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f81523f-adc3-49b2-8254-66e6bcaba51e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.277579 Aug 30 18:10:16.056518 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2905/6075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:15 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:16.850517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:16.866966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.867626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.868925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.885706 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] Creating event network-changed:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h1-852771-11 Aug 30 18:10:16.892307 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1b923806-edef-4dc0-b66c-c954acd95a77 req-cfc42779-8c27-4f7e-a55a-1e34b8b58d83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047449 Aug 30 18:10:16.893661 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3171/6076] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:17.077358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:17.077986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:17.085714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:17.087121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:17.087609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:17.088326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:17.088782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:17.089212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:17.317044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:17.326318 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1e5638dc-fec8-409f-a684-ad22c31e8f89 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.252751 Aug 30 18:10:17.327040 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2906/6077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:17 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:18.349880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:18.350995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:18.359516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.360076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.361063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.361975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.362935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.363620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.514220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:18.522665 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f09de8d3-b003-437a-ba71-e4ce1cae446c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.178213 Aug 30 18:10:18.539870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3172/6078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:18 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:19.546538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:19.547075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:19.555254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:19.555760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:19.556199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:19.556882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:19.557329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:19.557754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:19.698185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:19.705857 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e09a832f-064f-4f09-86e2-5918f7b41217 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.163387 Aug 30 18:10:19.706435 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2907/6079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:19 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:20.726930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:20.727581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:20.735135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.736023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.742688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.743525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.744001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.744442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.900240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:20.921860 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-367903fc-9c2c-45ef-a6d0-b430638e48f9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.198760 Aug 30 18:10:20.925342 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3173/6080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:20 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:21.948869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:21.949653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:21.956182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:21.956766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:21.957295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:21.958552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:21.959069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:21.959593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:22.140276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:22.149608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e0de526b-4169-4a81-a2e3-a64f66eb3085 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.206143 Aug 30 18:10:22.150205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2908/6081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:21 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:23.170373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:23.170994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:23.178680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:23.179078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:23.179548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:23.180247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:23.180702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:23.181131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:23.322594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:23.330403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-11251917-5071-4906-a638-994a11fc30d3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.164064 Aug 30 18:10:23.330987 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3174/6082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:23 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:24.045692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "name": "network-vif-plugged", "status": "completed", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:24.054989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:24.062038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.062853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.063408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.077623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] Creating event network-vif-plugged:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h1-852771-11 Aug 30 18:10:24.083572 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-846063a3-32b8-48ba-8c34-5ba56e83672b req-c4d0fdf4-dae2-4f49-a0e0-1fcc2d40cfd3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041544 Aug 30 18:10:24.084341 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2909/6083] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:24.353236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:24.353855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:24.357412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:24.361099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:24.367604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.368440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.369140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.370110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.370809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.371465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.568843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:24.576897 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6761f6e6-8658-436e-92aa-2aa170d1f76b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.228387 Aug 30 18:10:24.578456 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3175/6084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:24 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:25.603002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:25.603888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:25.610297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:25.610780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:25.611216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:25.611953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:25.612459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:25.612892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:25.761635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:25.769363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c864412b-ca38-47f2-95a7-f1afd32a2a3a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1392 microversion: 2.1 time: 0.174308 Aug 30 18:10:25.770803 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2910/6085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:25 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:26.790399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:26.791083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:26.797935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.798417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.798846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:26.799556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.800005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.800426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:26.937458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:26.945528 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7188944b-dd5b-4d44-9923-bfa3b45d7e70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1564 microversion: 2.1 time: 0.159137 Aug 30 18:10:26.946119 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3176/6086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:26 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:26.966064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:26.966693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:26.974512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.974996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.975436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:26.976159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.976617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.977051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:27.119848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:27.127994 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6e58e633-6c27-4314-8cdb-ab3fe0adee36 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1564 microversion: 2.1 time: 0.165677 Aug 30 18:10:27.128847 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2911/6087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:26 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:28.804118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:28.804991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:28.807705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:28.810625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:28.817860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.819230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.819905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.823126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.823830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.824441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.839529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.840126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.840559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.863095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] Creating event network-changed:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h1-852771-11 Aug 30 18:10:28.869644 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-bfea660b-3a89-479e-a984-66a2ce2a3c11 req-5a0045b7-ec08-429e-b3b0-9bb4abe5a9f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062847 Aug 30 18:10:28.870263 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2912/6088] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:28.985817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:28.995558 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-21d26169-5a43-41b0-b3ed-064b85102a95 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1564 microversion: 2.1 time: 0.196239 Aug 30 18:10:28.996185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3177/6089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:28 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:33.503650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-263732514", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "09795d71-d6ed-47eb-a7db-7f074311ddf3"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:33.558142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] validate_networks() for [('09795d71-d6ed-47eb-a7db-7f074311ddf3', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:10:33.907269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:10:33.907722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:10:33.908192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:10:33.908597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:10:33.909000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:10:33.918530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:33.919001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:33.919429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:33.920175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:33.920621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:33.921039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:33.938651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Getting quotas for project b046b28afebe4a6491f833122649d358. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:10:33.944535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Getting quotas for user d0f03685be2e4271ade7b07e1644dbed and project b046b28afebe4a6491f833122649d358. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:10:33.957124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:10:33.959656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:10:34.005400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-426576d0-7b13-4d01-a65e-67d3764b91fe tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637587 Aug 30 18:10:34.006122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2913/6090] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:10:34.017906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac7dea26-be32-4d1c-884b-a5de5d3d9922 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:34.018558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac7dea26-be32-4d1c-884b-a5de5d3d9922 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:34.074135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac7dea26-be32-4d1c-884b-a5de5d3d9922 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:34.080934 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac7dea26-be32-4d1c-884b-a5de5d3d9922 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1214 microversion: 2.1 time: 0.067302 Aug 30 18:10:34.081519 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3178/6091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:34 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:35.103133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:35.103836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:35.111122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:35.111629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:35.112065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:35.112753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:35.113205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:35.113626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:35.187432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:35.195933 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a0f4e42b-20df-4f03-8771-db96d7701379 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1272 microversion: 2.1 time: 0.097564 Aug 30 18:10:35.196512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2914/6092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:35 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:36.218309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:36.218885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:36.227555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.228063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.228493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.229376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.229828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.230250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.246054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3", "tag": "6e85bce6-6f33-4c6f-bd25-062d4bbea917"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:36.257903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.259284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.259918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.274213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] Creating event network-changed:6e85bce6-6f33-4c6f-bd25-062d4bbea917 for instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 on n-h2-852771-11 Aug 30 18:10:36.279413 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a427e23b-75ae-4cf7-89df-dc18d9888373 req-d94734bb-1c60-4024-a4ea-76fdc02e76b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038947 Aug 30 18:10:36.280060 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2915/6093] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:10:36.382954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:36.390915 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41663191-1948-49e8-a6b8-446336c39a30 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.177209 Aug 30 18:10:36.391520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3179/6094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:36 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:37.415172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:37.415917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:37.422249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:37.422729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:37.423166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:37.423887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:37.424339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:37.424765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:37.647236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:37.655110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-306a8d35-efe1-4f40-b47b-a96e8257f133 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.246070 Aug 30 18:10:37.655835 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2916/6095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:37 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:38.677371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:38.678088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:38.684553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.685040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.685476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.686167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.686620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.687045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.070476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:39.078383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c5369f5-ff80-4d0c-98dc-ed7248968cff tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.405484 Aug 30 18:10:39.078962 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3180/6096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:38 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:40.099772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.100294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:40.107169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.107680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.108115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.108829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.109275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.109695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.244738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:40.252546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-24a13b2e-433a-42e7-bd83-020ade325b00 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.157159 Aug 30 18:10:40.253122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2917/6097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:40 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:41.274580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.275238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:41.282374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:41.282865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:41.283310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:41.284043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:41.284504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:41.284935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:41.422825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:41.430647 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-197cbc6e-853d-413e-bfa0-6012162f496b tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.160956 Aug 30 18:10:41.431239 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3181/6098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:42.450641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:42.451257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:42.458142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:42.459298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:42.459768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:42.460458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:42.460905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:42.461325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:42.592994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:42.601337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fdab1ee1-0926-4620-be71-48ec3da09e93 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.154604 Aug 30 18:10:42.601930 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2918/6099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:42 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:43.074458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3", "name": "network-vif-plugged", "status": "completed", "tag": "6e85bce6-6f33-4c6f-bd25-062d4bbea917"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:43.085166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.085647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.086132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.091698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=65 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:43.097847 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] Creating event network-vif-plugged:6e85bce6-6f33-4c6f-bd25-062d4bbea917 for instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 on n-h2-852771-11 Aug 30 18:10:43.103703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d9ba65d2-f431-44ea-aa07-04b1ef478f54 req-714b8efb-840e-4c67-90a4-838b9ea12ea9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032924 Aug 30 18:10:43.104505 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3182/6100] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:43.621903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:43.622539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:43.625317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:43.630793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.631267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.631720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.632402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.632855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.633276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.636740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=69 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:43.761372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:43.769229 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36aa67c2-026c-4252-8dd4-c8fc4bc3da1f tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1314 microversion: 2.1 time: 0.151751 Aug 30 18:10:43.769801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2919/6101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:43 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:44.788084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:44.793083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:44.793793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:44.800320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.800812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.801257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.802600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.803102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.803583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.943202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:44.951378 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86c705ad-e65c-4d02-aabb-f0fd075681fb tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1501 microversion: 2.1 time: 0.164836 Aug 30 18:10:44.952031 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3183/6102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:44 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:44.972350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:44.972992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:44.975645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:44.976311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:44.983349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.983862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.984303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.984995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.985451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.985875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.119528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:45.127184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c49b086-706a-498b-80e2-41f53eb0aa63 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1501 microversion: 2.1 time: 0.159357 Aug 30 18:10:45.127785 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2920/6103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:44 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:45.147926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:45.148470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:45.154432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.154920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.155361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.156083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.156543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.156973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.179742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lazy-loading 'flavor' on Instance uuid 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:45.246144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-276685f2-fe66-4cf7-8f5a-841ed61eeaa6 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.102010 Aug 30 18:10:45.246702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3184/6104] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:45 2022] POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:10:45.254643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:45.255824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:45.262116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.262620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.263035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.263760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.264206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.264812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.397311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:45.405188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3018322-8c0a-462a-9a04-3c257df98107 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1509 microversion: 2.1 time: 0.154264 Aug 30 18:10:45.405811 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2921/6105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:45 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:46.428965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:46.429674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:46.435906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.436396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.436835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.437527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.437981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.438410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.573786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:46.581525 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f648e3c4-cfde-48a6-8ce1-80750783ea95 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1492 microversion: 2.1 time: 0.158066 Aug 30 18:10:46.582103 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3185/6106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:46 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:46.602834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:46.603386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:46.610144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.610622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.611052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.611758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.612204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.612658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.679824 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5fa6185-dcf7-4e7b-9168-ce25cd1e66ea tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.081219 Aug 30 18:10:46.681175 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2922/6107] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:46 2022] POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:46.688667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:46.689286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:46.696326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.696815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.697262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.697957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.698415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.698864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.840772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:46.848960 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d323b1b1-43c6-4ab5-a34f-1a59aa8f99ee tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1498 microversion: 2.1 time: 0.164330 Aug 30 18:10:46.849839 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3186/6108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:46 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:47.872124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:47.872812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:47.878962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:47.879441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:47.879915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:47.881226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:47.881678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:47.882099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.013177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:48.021147 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a7f9a703-8e48-413d-aba4-5386ffbdc617 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1501 microversion: 2.1 time: 0.154379 Aug 30 18:10:48.021724 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2923/6109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:47 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:48.041443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:48.041980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:48.049166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.049647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.050084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.050768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.051216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.051677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.075701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lazy-loading 'flavor' on Instance uuid 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:48.138954 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-26893135-e9e9-4d82-b7df-bd28d63079bc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.100780 Aug 30 18:10:48.139535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3187/6110] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:48 2022] POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:48.148795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:48.149412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:48.155807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.156290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.156728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.157470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.157871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.158311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.296188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:48.304084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22a7b01e-0c26-424d-9155-8114530c9c67 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1509 microversion: 2.1 time: 0.160255 Aug 30 18:10:48.304785 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2924/6111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:48 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:49.325652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.326353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:49.333550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.334164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.334607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.335326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.335816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.336237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.472636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.481231 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8dedbce9-d55f-434f-afb0-749b241b5333 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1492 microversion: 2.1 time: 0.159832 Aug 30 18:10:49.481832 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3188/6112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:49.502030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:49.502593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:49.510075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.510553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.510985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.511699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.512148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.512572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.581816 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-220d8d1f-484e-4bfb-866a-445f885bc3db tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.083500 Aug 30 18:10:49.582498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2925/6113] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:49 2022] POST /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:49.590826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.591441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:49.597956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.598449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.598981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.600110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.600572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.601026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.737254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.745797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b62a9a0c-9806-46d5-bf8e-b089c363e40d tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1498 microversion: 2.1 time: 0.159051 Aug 30 18:10:49.746379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3189/6114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:50.280655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:50.283917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:50.290408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.290895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.291339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.292093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.292550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.292977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.344938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9fbf3a9-57f3-46d2-8dce-b0dc215b4836 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action" status: 200 len: 24573 microversion: 2.1 time: 0.068469 Aug 30 18:10:50.345878 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2926/6115] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:50 2022] POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:50.767076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.767682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:50.775223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.775742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.776189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.776885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.777344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.777775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.908947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:50.916766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2423520-13c1-48ed-867f-75190ded47f8 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1501 microversion: 2.1 time: 0.153701 Aug 30 18:10:50.917346 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3190/6116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:50.937734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.938329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:50.946460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.946939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.947381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.948099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.948556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.948984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.975888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:10:51.052795 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa0f2da8-cbc0-4b08-9753-86a40df23690 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 204 len: 0 microversion: 2.1 time: 0.118374 Aug 30 18:10:51.053476 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2927/6117] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:10:50 2022] DELETE /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:10:51.062836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:51.063417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:51.070646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:51.071139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:51.071622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:51.072326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:51.072780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:51.073210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:51.204140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:51.212168 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86852f13-d2df-4abe-9a9f-5a791ccec663 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1507 microversion: 2.1 time: 0.153497 Aug 30 18:10:51.212755 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3191/6118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:51 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:52.233960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:52.234664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:52.242643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:52.243127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:52.243594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:52.244289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:52.244740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:52.245167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:52.378047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:52.386604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-83641d26-4250-46b1-ae9e-a9a902b6c206 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1507 microversion: 2.1 time: 0.157046 Aug 30 18:10:52.387186 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2928/6119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:52 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:53.233288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3", "name": "network-vif-deleted", "tag": "6e85bce6-6f33-4c6f-bd25-062d4bbea917"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:53.244685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.245241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.245735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:53.258755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] Creating event network-vif-deleted:6e85bce6-6f33-4c6f-bd25-062d4bbea917 for instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 on n-h2-852771-11 Aug 30 18:10:53.263837 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d6f70618-4db5-4ef9-a69e-90e768834730 req-3f2298dc-702b-4a7f-adcb-56429b63d580 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034219 Aug 30 18:10:53.264535 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3192/6120] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:53.407982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:53.408547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:53.415570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.416059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.416498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:53.417190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.417645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.418146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:53.451633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.452471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.453251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:53.454076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lazy-loading 'fault' on Instance uuid 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:53.499471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f03685be2e4271ade7b07e1644dbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046b28afebe4a6491f833122649d358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:53.507936 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3134232f-bcfb-495d-9308-9d46cb6250b3 tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 200 len: 1304 microversion: 2.1 time: 0.103817 Aug 30 18:10:53.508513 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2929/6121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:53 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:54.531916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:54.532533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] [instance: 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:54.539375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:54.539878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:54.540314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:54.540995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:54.541445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:54.541864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:54.555848 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] HTTP exception thrown: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Request method failure captured: Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 HTTP/1.1 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlKXF0NJ9IDQ2DIiIhK9u6vmMBJTqeMfLGVr1YY_-ePJ2gF_tjVc4rsmh1Y2g-9uMbKY5RNBfuxSIAl-NRiMFTLPN2KYx7T1PNSUry8_BhGCJhPywyw0dg18cOsekFFlMD6TxUmPxQmlezmRies3Ug1ch6tOVLZ3Eng8nZDmJvXrypM Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: b046b28afebe4a6491f833122649d358 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestServerAdvancedOps-1269867146 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b046b28afebe4a6491f833122649d358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b046b28afebe4a6491f833122649d358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b046b28afebe4a6491f833122649d358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b046b28afebe4a6491f833122649d358"}]}] Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestServerAdvancedOps-1269867146 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: b046b28afebe4a6491f833122649d358 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestServerAdvancedOps-1269867146 Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestServerAdvancedOps-1269867146-project Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d0f03685be2e4271ade7b07e1644dbed Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestServerAdvancedOps-1269867146-project Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3'} Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:54.557520 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] Returning 404 to user: Instance 1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48582852-00a1-4846-93f9-66c1b99000cc tempest-TestServerAdvancedOps-1269867146 tempest-TestServerAdvancedOps-1269867146-project] 10.222.0.50 "GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3" status: 404 len: 111 microversion: 2.1 time: 0.032209 Aug 30 18:10:54.562356 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3193/6122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:54 2022] GET /compute/v2.1/servers/1173fd4a-34cd-4354-8aa0-ef3be7ea0dc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:01.598166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:01.598871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:01.606433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:01.606931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:01.607370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:01.608152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:01.608604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:01.609313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:01.765884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:01.774729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b987933-8f28-46be-b54c-64e39e6b61f3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1682 microversion: 2.1 time: 0.398254 Aug 30 18:11:01.775394 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2930/6123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:01 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1682 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:01.874773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:01.877111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:01.880958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=36 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:01.887039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:01.887569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:01.888012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:01.888709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:01.889159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:01.889581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:01.942185 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5a1bf7f0-ea4b-48c0-ae16-dc97d4cae67a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action" status: 200 len: 32640 microversion: 2.1 time: 0.071110 Aug 30 18:11:01.944677 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3194/6124] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:11:01 2022] POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action => generated 32640 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:11:02.437904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:02.438579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:02.445737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.446433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.447085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:02.448006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.448755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.449351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:02.623663 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a40df037-6612-4a8d-b103-ea47ba496ffe tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1835 microversion: 2.1 time: 0.511644 Aug 30 18:11:02.635750 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2931/6125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:02 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1835 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:02.657154 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:02.660491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:02.669876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.670352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.670929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:02.672138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.672827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.673557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:02.702530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lazy-loading 'flavor' on Instance uuid fc031baa-2002-4b39-afe8-2efbf4cb6c27 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:11:02.718051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Going to try to live migrate instance to another host {{(pid=122124) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:11:04.140969 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-002dc330-13a0-4b3d-93bb-607364142df9 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action" status: 202 len: 0 microversion: 2.1 time: 1.489996 Aug 30 18:11:04.142935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3195/6126] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:11:02 2022] POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action => generated 0 bytes in 1493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:11:04.153978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:04.155317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:04.183080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:04.187527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:04.189887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:04.191043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:04.195245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:04.196247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:04.219332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:04.832036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:04.841421 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f44d1d3c-18eb-4fef-b4f1-72d7080f54bf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.692239 Aug 30 18:11:04.845417 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2932/6127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:04 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:05.870283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:05.872334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:05.887362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:05.887914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:05.888360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:05.889095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:05.889549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:05.889981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:05.956249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:06.162552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "name": "network-vif-unplugged", "status": "completed", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:06.179546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:06.180523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:06.181214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:06.206680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] Creating event network-vif-unplugged:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h1-852771-11 Aug 30 18:11:06.216534 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f0b0f9ce-586d-4e1c-97bc-98ce13bfe560 req-f23ab172-9c39-4bdf-b0fe-c7f3270a1be3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070689 Aug 30 18:11:06.218273 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2933/6128] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:06.448939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:06.460725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-25e45eba-e8f6-4121-936c-609e82fbcdbc tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.594190 Aug 30 18:11:06.461330 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3196/6129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:05 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:07.482832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:07.484288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:07.492711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:07.493591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:07.494097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:07.495079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:07.497046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:07.498090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:07.674586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:07.684273 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e43dea32-acf7-4f67-ab33-fd3719e02b97 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.205731 Aug 30 18:11:07.684871 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2934/6130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:07 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:08.245353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:08.257048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:08.257556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:08.257989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:08.271859 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] Creating event network-changed:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h1-852771-11 Aug 30 18:11:08.286400 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8d2c3f6b-2701-4e2f-b428-cb15033d84b4 req-6452bd3a-4798-4faa-b130-af8168b9e039 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042266 Aug 30 18:11:08.287843 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3197/6131] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:08.707161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:08.708480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:08.721622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:08.722120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:08.722562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:08.723417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:08.723913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:08.724341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:08.978776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:08.988363 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a775697-3a6c-42ed-9cfc-c280e4793368 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.285943 Aug 30 18:11:08.990270 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2935/6132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:08 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:09.400781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-416753821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3ef96296-5966-41d4-abbd-299997e08a21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:09.465002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:09.867284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:09.867745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:09.869652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:09.870079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:09.870497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:09.882025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:09.882513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:09.882954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:09.883872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:09.884442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:09.884877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:09.903986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:09.909666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:09.977087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:09.979216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ef96296-5966-41d4-abbd-299997e08a21',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:10.016889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:10.017504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:10.025657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:10.026234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:10.026745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:10.027576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:10.028122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:10.028592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:10.125813 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-272e1c9c-d425-4805-9a4f-eee6a0e8e7b4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730165 Aug 30 18:11:10.126588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3198/6133] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:10.140811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-41e89098-4349-4444-98a2-879c1ff25139 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:10.145937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-41e89098-4349-4444-98a2-879c1ff25139 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:10.199773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:10.212155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-41e89098-4349-4444-98a2-879c1ff25139 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:10.213517 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99ba9da4-f624-4561-ad51-381c9c083c9f tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.200354 Aug 30 18:11:10.214536 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2936/6134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:10 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:10.222155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-41e89098-4349-4444-98a2-879c1ff25139 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1056 microversion: 2.1 time: 0.085353 Aug 30 18:11:10.222899 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3199/6135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:10 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:11.245928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:11.247413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:11.248549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:11.249238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:11.256799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.257386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.257875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.258691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:11.259722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.260490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.261230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:11.263671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.264844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:11.268251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.268726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.269340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:11.349696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:11.360471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df7ba1e8-526a-4cf5-959d-f92babe50077 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1162 microversion: 2.1 time: 0.116412 Aug 30 18:11:11.361096 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3200/6136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:11 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1162 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:11.872036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:11.881647 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5fcf44a9-a35c-4e03-9060-f2d91637ad14 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.640862 Aug 30 18:11:11.882334 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2937/6137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:11 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:12.382785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:12.384377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:12.392411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:12.393332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:12.394437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:12.395721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:12.397091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:12.397982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:12.485704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:12.496235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b6eb23f7-7d96-401e-bc66-bff89f3333d5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1172 microversion: 2.1 time: 0.117671 Aug 30 18:11:12.507632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3201/6138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:12 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1172 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:12.904570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:12.905318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:12.925120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:12.925569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:12.926118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:12.926913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:12.927470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:12.928108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.285005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:13.302331 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07ec6d0c-ccc4-41be-85ba-fcf3318a2f26 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.401624 Aug 30 18:11:13.304706 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2938/6139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:12 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:13.518539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:13.519283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:13.526922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.527505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.528244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.528954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.529418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.529847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.677293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:13.686421 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-adf4e438-ca4e-4bb4-9424-0577a2054db9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1214 microversion: 2.1 time: 0.171989 Aug 30 18:11:13.687329 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3202/6140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:13 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:14.199799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4390d12c-0d93-4298-aff0-536f5ccb5947", "tag": "9a34aac0-248c-409d-890c-da6e1bc29bf7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:14.205500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:14.211439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:14.212372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:14.212986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:14.227672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] Creating event network-changed:9a34aac0-248c-409d-890c-da6e1bc29bf7 for instance 4390d12c-0d93-4298-aff0-536f5ccb5947 on n-h2-852771-11 Aug 30 18:11:14.233913 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2ad5617a-058d-4b34-a5c5-f194dac018b7 req-fd721b18-3b86-4695-a6df-a2855bb91800 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038599 Aug 30 18:11:14.234725 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2939/6141] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:14.328958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:14.330531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:14.337816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:14.338751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:14.339439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:14.340854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:14.341520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:14.342158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:14.519863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:14.530507 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-20da4ecb-f502-4eda-bbf6-ca745594e321 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1692 microversion: 2.1 time: 0.205958 Aug 30 18:11:14.531113 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3203/6142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:14 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:14.712811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:14.713522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:14.720596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:14.721091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:14.721788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:14.722510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:14.722972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:14.723395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.070374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:15.078750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-57e2da42-dbd4-4df6-8d92-6c94199f075e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1214 microversion: 2.1 time: 0.370369 Aug 30 18:11:15.079337 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2940/6143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:14 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1214 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:15.554614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.555886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:15.563563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.564055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.564518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.565222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.565669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.566090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.712221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:15.720304 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36bde282-ea74-4670-9f4a-2510edd0604d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1682 microversion: 2.1 time: 0.170755 Aug 30 18:11:15.720893 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3204/6144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:15 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:15.742543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.743776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:15.751708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.752222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.752638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.753346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.753798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.754228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.893620 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-485bf102-232c-40ca-8768-b6e416ff8f76 tempest-TestNetworkAdvancedServerOps-375832556 tempest-TestNetworkAdvancedServerOps-375832556-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1835 microversion: 2.1 time: 0.155258 Aug 30 18:11:15.894490 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2941/6145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:15 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1835 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:15.916470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.917092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:15.923163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.923692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.924170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:15.924901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:15.925358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:15.925792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:16.063811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:16.073221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1795e82f-2d81-4639-8c55-ec5797fb1b63 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1682 microversion: 2.1 time: 0.161426 Aug 30 18:11:16.073814 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3205/6146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:15 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:16.108880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:16.109763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:16.116265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:16.116877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:16.117623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:16.118565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:16.119148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:16.119712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:16.614551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:16.622531 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-933306d3-167a-48f4-ade0-3ebd24d42693 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1214 microversion: 2.1 time: 0.518226 Aug 30 18:11:16.623122 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2942/6147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:16 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1214 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:17.643561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:17.644160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:17.651261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:17.651777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:17.652216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:17.652913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:17.653367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:17.653792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:17.784417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:17.792927 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6dde4606-bb42-4bef-a1f8-23ca7036bbe0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.153344 Aug 30 18:11:17.793480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3206/6148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:17 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:18.579489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:18.582596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:18.589630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:18.590152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:18.590585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:18.591279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:18.591753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:18.592176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:18.642145 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dd05c597-25a4-4ab2-8ef3-5e3457ba2b4e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action" status: 200 len: 38626 microversion: 2.1 time: 0.066337 Aug 30 18:11:18.643517 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2943/6149] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:11:18 2022] POST /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27/action => generated 38626 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:11:18.813905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:18.814517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:18.821971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:18.822454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:18.822886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:18.823613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:18.824067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:18.824490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:18.955226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:18.963339 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b978b22f-60b6-47b6-b59c-0e541a7b7ed8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.153349 Aug 30 18:11:18.963989 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3207/6150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:18 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:19.642108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:19.643296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:19.647680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:19.652355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.652836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.653268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.653965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.654581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.655003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.660194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.660907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.661585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.674449 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] Creating event network-changed:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h2-852771-11 Aug 30 18:11:19.680837 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b796449f-b191-453a-8f0f-da318ad86ec6 req-ca47c55e-5b9b-45ae-812f-5e9ba991d873 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040931 Aug 30 18:11:19.681758 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3208/6151] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:19.683681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:11:19.777177 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-348455e6-0d97-4ea1-bb84-770cec090c9c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 204 len: 0 microversion: 2.1 time: 0.140411 Aug 30 18:11:19.778399 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2944/6152] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:11:19 2022] DELETE /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:11:19.788992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:19.789699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:19.797988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.798746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.799819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.800744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.801369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.802008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.896574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:19.946683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:19.954967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d1888f3-cc0f-47e1-9758-c207f9e56997 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1688 microversion: 2.1 time: 0.170625 Aug 30 18:11:19.955587 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3209/6153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:19 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:19.985897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:19.986918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:19.994076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.994818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.995429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.996408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.996857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.997337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.202883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:20.211517 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ceaca0b6-c6f4-431a-94ae-654a9381b106 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.230159 Aug 30 18:11:20.212339 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2945/6154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:19 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:20.977565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:20.978437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:20.980570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:20.987463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:20.988043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:20.988571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.989335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:20.989878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:20.990310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.027598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.028029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.028517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.028944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lazy-loading 'fault' on Instance uuid fc031baa-2002-4b39-afe8-2efbf4cb6c27 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:11:21.073123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:21.080289 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-01692435-1c0f-481d-9cf1-4391c4ea6ae9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 200 len: 1356 microversion: 2.1 time: 0.107189 Aug 30 18:11:21.080743 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3210/6155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:20 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:21.232566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:21.233208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:21.240199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.240741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.241284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.241993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.242450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.242879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.372934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:21.380735 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a96fee48-9e41-4c75-9463-18e62d76d1b8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.152087 Aug 30 18:11:21.381947 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2946/6156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:21 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:21.696187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc031baa-2002-4b39-afe8-2efbf4cb6c27", "name": "network-vif-deleted", "tag": "e07b7168-d959-414f-ad53-3be3ade4e35a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:21.705456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.705927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.706354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.717468 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] Creating event network-vif-deleted:e07b7168-d959-414f-ad53-3be3ade4e35a for instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 on n-h2-852771-11 Aug 30 18:11:21.722730 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4e038caa-a7f7-4deb-b8ac-86445efe9d22 req-0bdd31f8-3b69-4454-9c37-b67c1ff18d20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Aug 30 18:11:21.723721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3211/6157] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:22.102833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:22.103369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: fc031baa-2002-4b39-afe8-2efbf4cb6c27] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:22.110033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:22.110512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:22.110950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:22.111678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:22.112132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:22.112557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:22.126515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] HTTP exception thrown: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Request method failure captured: Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 HTTP/1.1 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlGDwXmImJOpEs8dvPBn9r-uyIf9kUDlojS3mwmrJzSPSAps_CJQoqoDeiezhgu1NqiXGGSafMF1julVC5XM_xI8eLxFOKCaS_1lZb2uBaeSqlmNEC-USSPCXaAOwFbgYHiBAkWOHakWOSe2AimNS0Neqtzlrk4SLwJI2KrFpj_INKs Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c4a340bef6214caf85d78be544a88327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c4a340bef6214caf85d78be544a88327"}]}] Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b45d9856716b4bbabc9eacbed7b8fa2d Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'fc031baa-2002-4b39-afe8-2efbf4cb6c27'} Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:22.128169 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Returning 404 to user: Instance fc031baa-2002-4b39-afe8-2efbf4cb6c27 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-792c98cb-f4b2-44e3-8d97-6a292691d86d tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27" status: 404 len: 111 microversion: 2.1 time: 0.031366 Aug 30 18:11:22.134336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2947/6158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:22 2022] GET /compute/v2.1/servers/fc031baa-2002-4b39-afe8-2efbf4cb6c27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:22.403656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:22.404294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:22.411098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:22.411611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:22.412056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:22.413426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:22.413878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:22.414314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:22.555620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:22.564254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b9217a9-650e-4a12-bb85-c9c8c867042f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.165228 Aug 30 18:11:22.564869 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3212/6159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:22 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:23.587043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:23.588418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:23.596929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.597774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.598259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.599207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.599958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.600382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.839637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:23.848617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-710c63c4-8268-4994-b88f-749acac3fdac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.267011 Aug 30 18:11:23.849205 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2948/6160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:23 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:24.870307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:24.871735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:24.879569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.880009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.880470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:24.881187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.881647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.882205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:25.027521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:25.035949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dc30741d-4062-4a8d-ac49-502a89ba4fff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.169641 Aug 30 18:11:25.036536 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3213/6161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:24 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:25.439774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4390d12c-0d93-4298-aff0-536f5ccb5947", "name": "network-vif-plugged", "status": "completed", "tag": "9a34aac0-248c-409d-890c-da6e1bc29bf7"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:25.457877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:25.458243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:25.458799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:25.472471 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] Creating event network-vif-plugged:9a34aac0-248c-409d-890c-da6e1bc29bf7 for instance 4390d12c-0d93-4298-aff0-536f5ccb5947 on n-h2-852771-11 Aug 30 18:11:25.478314 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-26059da4-fd35-4879-b727-a578abe7e4e8 req-1294dc23-5766-4ee2-a491-6496ca9c404c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048094 Aug 30 18:11:25.479434 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2949/6162] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:26.057698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:26.058944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:26.066193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.066950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.067587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.068744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.069373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.069970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.129999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0763052-5cb4-4f29-a93e-7931f78e4eb8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '.version_select at 0x7f2d98f0dee0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:26.154715 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0763052-5cb4-4f29-a93e-7931f78e4eb8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690890916" status: 202 len: 0 microversion: 2.1 time: 0.028966 Aug 30 18:11:26.155780 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2950/6163] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 30 18:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690890916 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:11:26.187954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5fb0e371-b0dd-4066-9376-9b3adfbdcf3c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: .version_select at 0x7f2d986d5940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1959422453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk6DRJTqP853ZSJePEp4eZMJ1El3jdCZduH/YaohgqXHX60tv3BsXm6JUuW55NLQejQIZOoj+eKrHCznT/BNHFRxiZ4rnV/IwRU+tQkM3qm0M4NqeNs5hq5z2F1TbSEVA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:26.205124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5fb0e371-b0dd-4066-9376-9b3adfbdcf3c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:26.211725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5fb0e371-b0dd-4066-9376-9b3adfbdcf3c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:26.221056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:26.229400 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b677b189-976c-410a-8eef-0705392496cb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1202 microversion: 2.1 time: 0.176056 Aug 30 18:11:26.229935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3214/6164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:26 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:26.239020 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5fb0e371-b0dd-4066-9376-9b3adfbdcf3c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055614 Aug 30 18:11:26.240040 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2951/6165] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:11:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:27.253630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.254264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.261777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.262526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.263156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.264470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.265307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.265756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.410058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:27.418592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b18ff87a-6582-4788-ae74-82bd4096b50a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1388 microversion: 2.1 time: 0.170182 Aug 30 18:11:27.419361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3215/6166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:27 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:27.439121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.439876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.448540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.449369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.449906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.450524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.450980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.451405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.454436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:27.597564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:27.606205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d74cd46-2ebd-4108-810f-3dafefc3df25 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1388 microversion: 2.1 time: 0.170922 Aug 30 18:11:27.606791 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2952/6167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:27 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1388 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:27.625993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.626689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.633620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.634185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.634718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.635499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.636037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.636536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.639381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:27.867152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:27.875309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9485d92b-1558-432f-8e3b-0b93d294f8dc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1388 microversion: 2.1 time: 0.253120 Aug 30 18:11:27.875950 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3216/6168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:27 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:27.896263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.896816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.902811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.903287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.903746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.904429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.904875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.905289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.933046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:11:28.010305 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1391dac-677e-47ed-b6d5-5daaf7530fa5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 204 len: 0 microversion: 2.1 time: 0.117610 Aug 30 18:11:28.011051 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2953/6169] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:11:27 2022] DELETE /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:11:28.020083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:28.020697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:28.027117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.027639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.028081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.028778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.029228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.029652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.239625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:28.249010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d68ef6bf-4886-4af1-b26f-cc423155018e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1394 microversion: 2.1 time: 0.232384 Aug 30 18:11:28.249010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3217/6170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:28 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1394 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:29.269800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:29.270473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:29.282675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:29.283169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:29.283630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:29.284338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:29.284785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:29.285213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:29.495342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:29.508860 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98e0113a-5168-4903-80ea-73a1f7a0797b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1394 microversion: 2.1 time: 0.240615 Aug 30 18:11:29.510078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2954/6171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:29 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1394 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:29.976284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4390d12c-0d93-4298-aff0-536f5ccb5947", "name": "network-vif-deleted", "tag": "9a34aac0-248c-409d-890c-da6e1bc29bf7"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:29.990133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:29.991680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:29.992289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.009456 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] Creating event network-vif-deleted:9a34aac0-248c-409d-890c-da6e1bc29bf7 for instance 4390d12c-0d93-4298-aff0-536f5ccb5947 on n-h2-852771-11 Aug 30 18:11:30.019459 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a651164d-36dc-48f2-a314-efc741dd5b16 req-96a22115-b713-4c8a-9a13-fc47a7beaa89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051867 Aug 30 18:11:30.020108 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3218/6172] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:30.530369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:30.531629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:30.539722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:30.540514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:30.540946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.542876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:30.543624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:30.544253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.614914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:30.623948 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de82a769-a7f0-4c1d-b31c-edcc13536784 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1187 microversion: 2.1 time: 0.097249 Aug 30 18:11:30.639887 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2955/6173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:30 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:31.648068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:31.649757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:31.659996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.660674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.662080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.664105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.664785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.666115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.757537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:31.765973 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-db63db13-1aec-4465-b2a6-84c494d948ba tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1187 microversion: 2.1 time: 0.123023 Aug 30 18:11:31.767856 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3219/6174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:31 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:32.719783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-415000438", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "71bed61f-538a-46a8-a833-40f8e3fa536d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1959422453", "security_groups": [{"name": "tempest-secgroup-smoke-534122115"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:32.788650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:32.789276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:32.792399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:32.798995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.800818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.802012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.803989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.804560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.805572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.899085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:32.904317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] validate_networks() for [('71bed61f-538a-46a8-a833-40f8e3fa536d', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:32.914023 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-58c97af4-83e0-4202-9688-f963d0f44b28 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1187 microversion: 2.1 time: 0.128567 Aug 30 18:11:32.914622 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3220/6175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:32 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1187 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:33.541149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:33.541870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:33.542581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:33.543217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:33.543891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:33.554481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.555359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.556099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.557063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.557752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.558403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.582255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:33.589634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Getting quotas for user b45d9856716b4bbabc9eacbed7b8fa2d and project c4a340bef6214caf85d78be544a88327. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:33.626521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:33.631802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:33.745870 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-27ca29d5-0d59-4b1a-a28c-7f3c6b035fbb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031178 Aug 30 18:11:33.747027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2956/6176] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:33.759815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3dd4b6dd-3ffe-4284-8da9-24141b46dcf6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:33.760781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3dd4b6dd-3ffe-4284-8da9-24141b46dcf6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:33.831640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3dd4b6dd-3ffe-4284-8da9-24141b46dcf6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:33.841385 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3dd4b6dd-3ffe-4284-8da9-24141b46dcf6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1266 microversion: 2.1 time: 0.086090 Aug 30 18:11:33.842285 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3221/6177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:33 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:33.936716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:33.937800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:33.945125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.945740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.946401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.947285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.947826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.948251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.023427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:34.038942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-78834b69-0f3f-4dfb-a9f5-23a1209db033 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1187 microversion: 2.1 time: 0.106165 Aug 30 18:11:34.039812 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2957/6178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:33 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:34.863424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:34.864116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:34.874885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.877838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.882658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.884307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.884971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.885588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.997280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:35.008845 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de5b3369-8162-4941-805f-8b9849bca398 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1326 microversion: 2.1 time: 0.149878 Aug 30 18:11:35.009825 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3222/6179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:34 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:35.061896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:35.062421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:35.074264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.075034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.075594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.076394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.078836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.079440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.178184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:35.195389 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5a8af4f-2b34-47dc-ac9c-a33f4094d8c3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 200 len: 1187 microversion: 2.1 time: 0.137924 Aug 30 18:11:35.196357 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2958/6180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:35 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:36.031209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:36.031871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:36.039774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.040263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.040697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.041395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.041841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.042539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.181162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:36.188995 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6ff1bf9a-107d-47f6-a676-2abac61ed94b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.161576 Aug 30 18:11:36.189587 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3223/6181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:36 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:36.216650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:36.217356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 4390d12c-0d93-4298-aff0-536f5ccb5947] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:36.225923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.226686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.227346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.228111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.228563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.228988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.243067 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 HTTP/1.1 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4390d12c-0d93-4298-aff0-536f5ccb5947'} Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:36.244769 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 4390d12c-0d93-4298-aff0-536f5ccb5947 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6b5ce6ce-f301-402d-af50-6b796f3f4998 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947" status: 404 len: 111 microversion: 2.1 time: 0.033545 Aug 30 18:11:36.249492 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2959/6182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:36 2022] GET /compute/v2.1/servers/4390d12c-0d93-4298-aff0-536f5ccb5947 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:36.426311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:36.437720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.439065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.439791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.466328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] Creating event network-changed:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:11:36.471336 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a85f1320-2f9c-4bfd-b7be-971d54cd6569 req-d5f384d8-bff7-4701-9df8-01e13ef342ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048675 Aug 30 18:11:36.473282 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3224/6183] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:37.209957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:37.211057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:37.217463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:37.218147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:37.218375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:37.219082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:37.219559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:37.219986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:37.360726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:37.369758 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3333f0f8-d472-4e5b-a6c2-9bea9b8106e3 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.163817 Aug 30 18:11:37.370344 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2960/6184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:37 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:38.391809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:38.392509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:38.399935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:38.400423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:38.401085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:38.401790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:38.402245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:38.402672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:38.555281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:38.563352 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43772032-987f-4582-b8ac-adbba0238919 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.176839 Aug 30 18:11:38.564067 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3225/6185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:38 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:39.586100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:39.586715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:39.594557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:39.595054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:39.595529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:39.596229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:39.596679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:39.597129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:39.753609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:39.762979 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9815ccfb-0188-4b48-baa0-77975da626b4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.181288 Aug 30 18:11:39.763586 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2961/6186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:39 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:40.785181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:40.786528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:40.794414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.795036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.795490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:40.796311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.796765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.797243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:40.952642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:40.961805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a6502428-830d-4604-b7c3-397bd3416516 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.181029 Aug 30 18:11:40.962395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3226/6187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:40 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:41.255726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-21976890", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5770915e-2c96-4f66-ac55-4b36b93c4a00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:41.318335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:41.692666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:41.693088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:41.693559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:41.693996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:41.694838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:41.703702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.704176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.704610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:41.705333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.705783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.706205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:41.723600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:41.729763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:41.785908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:41.788486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5770915e-2c96-4f66-ac55-4b36b93c4a00',volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:41.889694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:41.916246 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-425a2ba4-cf54-4442-8775-d184ca38eab3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664373 Aug 30 18:11:41.916912 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2962/6188] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:41.927797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fe82a86-faa8-4287-855d-1d309cee5f3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:41.928873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1fe82a86-faa8-4287-855d-1d309cee5f3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:41.983749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1fe82a86-faa8-4287-855d-1d309cee5f3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:41.983935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:41.984423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:41.991993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.992164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fe82a86-faa8-4287-855d-1d309cee5f3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1055 microversion: 2.1 time: 0.067973 Aug 30 18:11:41.992522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.997681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:41.997864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3227/6189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:41 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1055 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:41.997972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.997972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.997972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:42.136299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:42.143963 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5caa50c-bb27-4afd-ab98-742d80f60693 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.165069 Aug 30 18:11:42.144544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2963/6190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:41 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:42.329679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "name": "network-vif-plugged", "status": "completed", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:42.342380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:42.342871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:42.343381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:42.355317 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] Creating event network-vif-plugged:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:11:42.360414 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5fb38f58-f943-4ed6-a50a-efaac6ddd7f8 req-40763655-facd-4d98-a06f-a36e81b96fa2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Aug 30 18:11:42.361364 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3228/6191] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:43.013007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:43.013646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:43.020595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.021079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.021513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.022761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.023202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.023680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.094297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:43.104007 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-26e723cb-09bf-4f11-a80a-1f6c56777aae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1171 microversion: 2.1 time: 0.094784 Aug 30 18:11:43.109042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2964/6192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:43 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1171 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:43.168536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:43.169395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:43.176438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.177080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.177642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.178582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.179705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.180291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.333130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:43.342326 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a721e637-4445-4f47-b0af-81933e628a8b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1391 microversion: 2.1 time: 0.179828 Aug 30 18:11:43.357224 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3229/6193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:43 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:44.126571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:44.127182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:44.139352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.140719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.141458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.142294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.142692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.143317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.357999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:44.367916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:44.369114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:44.370625 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f98855a6-5dba-490e-9a3b-72fe6c73582b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1213 microversion: 2.1 time: 0.247462 Aug 30 18:11:44.371899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2965/6194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:44 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1213 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:44.379451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.380572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.381015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.381824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.382268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.382997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.545805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:44.561567 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0efbd5c5-1715-45ae-9781-fd4ccde12132 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1564 microversion: 2.1 time: 0.200335 Aug 30 18:11:44.562192 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3230/6195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:44 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1564 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:44.583153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:44.584471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:44.591637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.592128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.592571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.593287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.593740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.594315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.642416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ccce6f-abb8-446e-bf02-6afa787a5777", "tag": "3b35fb06-2559-43e8-9467-820d3d435972"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:44.656216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.656712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.657131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.676168 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] Creating event network-changed:3b35fb06-2559-43e8-9467-820d3d435972 for instance a7ccce6f-abb8-446e-bf02-6afa787a5777 on n-h2-852771-11 Aug 30 18:11:44.685494 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9f62e420-3683-46f5-acd7-ee8e1bd4a0ff req-91e6cf13-ed9f-487d-a36e-5b4c01993e52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Aug 30 18:11:44.686478 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3231/6196] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:44.901001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:44.909292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36e62441-e900-43b5-9be3-b3fd1f020833 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1564 microversion: 2.1 time: 0.330200 Aug 30 18:11:44.910281 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2966/6197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:44 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1564 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:45.393865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:45.394579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:45.401927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.402420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.403052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.404388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.405034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.405631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.667151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:45.677788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-355c107f-7c49-47ae-a2d1-2bd3f85dc1e7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1213 microversion: 2.1 time: 0.289226 Aug 30 18:11:45.679976 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3232/6198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:45 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:46.700151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:46.701250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:46.711845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.712567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.713247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.714007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.714531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.715071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.855549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:46.863521 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b9d312cd-5e35-479e-82f9-8884adec0a98 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1213 microversion: 2.1 time: 0.167278 Aug 30 18:11:46.864197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2967/6199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:46 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:47.189251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:47.189867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:47.191736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:47.202730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.204510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.205687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.205832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.205951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.206065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.206494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.206964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.207457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.222742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] Creating event network-changed:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:11:47.229753 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b7665364-6999-4043-b80b-678e861b95f2 req-f9fa110f-a079-4b70-9a2b-4f4952ca9923 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041504 Aug 30 18:11:47.230419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2968/6200] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:47.412543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:47.421861 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dac7af3f-1de3-4004-ae2b-ed44278cce61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1564 microversion: 2.1 time: 0.236736 Aug 30 18:11:47.436204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3233/6201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:47 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:47.886983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:47.888020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:47.894804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.895600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.896101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.896894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.898470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.898976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:48.055298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:48.058103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:48.065289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-91453600-df99-4416-b75f-930ac83b0c9d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1213 microversion: 2.1 time: 0.183893 Aug 30 18:11:48.079377 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2969/6202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:47 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:49.088547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:49.089167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:49.096103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:49.096590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:49.097032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.097721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:49.098179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:49.098861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.225727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:49.233468 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d9500ee-c910-405c-bd0e-644ce59557b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.149872 Aug 30 18:11:49.234063 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3234/6203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:49 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:50.254234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:50.254872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:50.263593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.264093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.264535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.265242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.265911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.266111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.396817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:50.405166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e283bed-c7e5-4aed-b578-c3cb95450b35 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.154856 Aug 30 18:11:50.405691 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2970/6204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:50 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:51.426418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:51.426943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:51.434089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:51.434566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:51.434993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:51.435705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:51.436151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:51.436571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:51.565564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:51.574174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-906d7d70-19da-493a-bec8-ab256b990381 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.151815 Aug 30 18:11:51.574749 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3235/6205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:51 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:52.595870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:52.596531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:52.599617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:52.601343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:52.607385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:52.607891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:52.608319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:52.609007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:52.609452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:52.609867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:52.743141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:52.750965 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ee63878f-c0b8-4de3-9324-f676106a2575 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.159058 Aug 30 18:11:52.751567 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2971/6206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:52 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:53.771132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:53.771768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:53.774070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:53.780530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:53.781005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:53.781437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:53.782120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:53.782570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:53.782988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:53.917785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:53.925454 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-188498c5-1247-4470-b244-7c2e7ec53ffb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.158256 Aug 30 18:11:53.926029 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3236/6207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:53 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:54.946247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:54.947063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:54.954252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:54.954763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:54.955195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:54.955905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:54.956351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:54.956771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:55.088540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:55.096308 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ebf8d3a-0346-4c5e-977e-00d250c7663e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.153970 Aug 30 18:11:55.096879 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2972/6208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:54 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:56.117482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:56.118106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:56.125249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.125736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.126167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:56.126855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.127303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.127748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:56.142319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=100 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:56.258458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:56.266390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cb4d3c0c-72f9-4d52-b764-b4eacb522be8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.152797 Aug 30 18:11:56.266994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3237/6209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:56 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:57.286745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:57.287384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:57.294731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:57.295212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:57.295670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:57.296351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:57.296856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:57.297275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:57.432876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:57.440742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65b6bd03-ea53-4288-8f98-86084dfc795b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.157944 Aug 30 18:11:57.441355 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2973/6210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:57 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:58.460834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:58.461447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:58.469466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.469958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.470400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.471093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.471576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.472006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.605492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:58.613278 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44bafa8c-0d0c-47d6-ac92-967dcd1daad5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.156496 Aug 30 18:11:58.613861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3238/6211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:58 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:59.464837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ccce6f-abb8-446e-bf02-6afa787a5777", "name": "network-vif-plugged", "status": "completed", "tag": "3b35fb06-2559-43e8-9467-820d3d435972"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:59.477300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.477976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.478412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.490299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] Creating event network-vif-plugged:3b35fb06-2559-43e8-9467-820d3d435972 for instance a7ccce6f-abb8-446e-bf02-6afa787a5777 on n-h2-852771-11 Aug 30 18:11:59.496500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-81d78f29-13a8-4957-8bfc-6b4b24214e9b req-85ce3553-c4e2-4ac9-b415-08dad0778ea5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Aug 30 18:11:59.497115 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2974/6212] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:59.633291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:59.633914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:59.641084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.641573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.642018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.642724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.643182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.643639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.770411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:59.778766 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e6e986d8-f4c6-4ff2-8c15-a54dcb7d00b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1201 microversion: 2.1 time: 0.149367 Aug 30 18:11:59.779281 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3239/6213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:59 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1201 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:00.800837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:00.801545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:00.809207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.809688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.810124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:00.810823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.811291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.811757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:00.940399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:00.948852 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-450996d7-bbbc-41b6-9feb-15d863871aa2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1387 microversion: 2.1 time: 0.152279 Aug 30 18:12:00.949467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2975/6214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:00 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1387 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:00.968497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:00.969122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:00.976219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.976708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.977151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:00.977842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.978305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.979253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.107911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:01.115876 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8287cfc4-d698-493e-a594-a5797301bdef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1387 microversion: 2.1 time: 0.151180 Aug 30 18:12:01.116470 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3240/6215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:00 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1387 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:01.136484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:01.137105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:01.143056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.143575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.144018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.144741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.145193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.145624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.276784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:01.284669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c02319f4-a731-438b-a06f-d7c72f1ad9fe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1387 microversion: 2.1 time: 0.152478 Aug 30 18:12:01.285249 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2976/6216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:01 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1387 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:01.305522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:01.305950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:01.313214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.313703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.314143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.314849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.315314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.315777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.342434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:12:01.420621 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7e9c0e6-3634-4f44-9f9a-300693600d81 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 204 len: 0 microversion: 2.1 time: 0.118541 Aug 30 18:12:01.421263 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3241/6217] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:01 2022] DELETE /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:01.429759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:01.430369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:01.436478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.436962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.437395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.438080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.438530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.438952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.568110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:01.576116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9017119-2811-4dad-a933-9fb43b46bbbd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1393 microversion: 2.1 time: 0.150215 Aug 30 18:12:01.576699 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2977/6218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:01 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:02.598312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:02.598954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:02.606909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.607395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.607855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.608541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.608989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.609411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.742195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:02.751017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15e50341-3381-42cd-ba9e-395539b4f3c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1393 microversion: 2.1 time: 0.157109 Aug 30 18:12:02.751624 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3242/6219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:02 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:03.282523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ccce6f-abb8-446e-bf02-6afa787a5777", "name": "network-vif-deleted", "tag": "3b35fb06-2559-43e8-9467-820d3d435972"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:03.293464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:03.293947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:03.294419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:03.308453 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] Creating event network-vif-deleted:3b35fb06-2559-43e8-9467-820d3d435972 for instance a7ccce6f-abb8-446e-bf02-6afa787a5777 on n-h2-852771-11 Aug 30 18:12:03.316335 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1f64e4cb-2584-4553-af83-4bd7d960944d req-1b8e7071-7844-422c-8d6e-290a324018dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036941 Aug 30 18:12:03.317585 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2978/6220] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:03.772478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:03.773099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:03.776042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:03.781726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:03.782210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:03.782651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:03.783375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:03.783855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:03.784282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:03.850208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:03.858409 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c117a230-2e50-4f50-ab53-d29d80df55e4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1186 microversion: 2.1 time: 0.089866 Aug 30 18:12:03.858991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3243/6221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:03 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:04.881769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:04.882466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:04.889512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:04.890000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:04.890435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:04.891144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:04.891617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:04.892044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:04.958423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:04.966570 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5a60151-7c44-4e62-8f6e-3201f7f952ae tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1186 microversion: 2.1 time: 0.090088 Aug 30 18:12:04.967153 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2979/6222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:04 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:05.988988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:05.989537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:05.996147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.996628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.997065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.997763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.998216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.998638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:06.060659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:06.068604 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-32eedf07-bb33-43b3-b1f3-99d957cae3a6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1186 microversion: 2.1 time: 0.083966 Aug 30 18:12:06.069187 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3244/6223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:05 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:07.090955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:07.091595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:07.098434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:07.098910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:07.099624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:07.100312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:07.100763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:07.101184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:07.163808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:07.171991 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c6a8c87-d345-4579-989b-01a25dbee7ee tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 200 len: 1186 microversion: 2.1 time: 0.085692 Aug 30 18:12:07.172666 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2980/6224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:07 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:08.192257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:08.192870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: a7ccce6f-abb8-446e-bf02-6afa787a5777] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:08.200400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.200893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.201327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.202017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.202476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.202902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.217423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 HTTP/1.1 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a7ccce6f-abb8-446e-bf02-6afa787a5777'} Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:08.219210 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance a7ccce6f-abb8-446e-bf02-6afa787a5777 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5725eb2f-26c1-462d-9786-0d6cea9808a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777" status: 404 len: 111 microversion: 2.1 time: 0.032476 Aug 30 18:12:08.225247 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3245/6225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:08 2022] GET /compute/v2.1/servers/a7ccce6f-abb8-446e-bf02-6afa787a5777 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:12:08.683312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:08.685442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:08.692311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.692791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.693223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.693909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.694356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.694775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.752931 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1729e53f-6c40-4391-b2eb-2a85eb48361c tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action" status: 200 len: 24567 microversion: 2.1 time: 0.074187 Aug 30 18:12:08.753810 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2981/6226] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:12:08 2022] POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:12:19.779666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "565db0f0-616b-43a3-8762-95a8e129a515"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:19.782387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:19.785504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:19.786553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:19.794429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.794954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.795470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.796207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.796667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.797097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.879653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:19.880081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:19.880556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:19.880964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:19.881388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:19.943444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:19.950659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.951162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.951625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.952344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.952799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.953224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.982703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7572a526-51e7-46ed-8f06-60217e23a86b tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action" status: 202 len: 1138 microversion: 2.1 time: 0.207290 Aug 30 18:12:19.983365 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3246/6227] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:12:19 2022] POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action => generated 1138 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 18:12:20.007701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:20.008401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:20.013191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=38 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:20.013853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=63 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:20.021786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:20.022389 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:20.023105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:20.023914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:20.024368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:20.024793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:20.198971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:20.208341 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5032a5f3-101a-4f3a-815e-011c33ded0aa tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.208619 Aug 30 18:12:20.209198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2982/6228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:19 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:21.231123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:21.231905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:21.238793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:21.239284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:21.239753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:21.240456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:21.240912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:21.241341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:21.383328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:21.392045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9909254-9c01-4562-8fff-a89b7f3a9550 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.165491 Aug 30 18:12:21.392648 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3247/6229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:21 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:22.414028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:22.414838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:22.422307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.422781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.423215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:22.423929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.424376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.424852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:22.558313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:22.566614 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e62abc2a-d9fc-4c80-a2eb-40b1520b9dda tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.156446 Aug 30 18:12:22.567335 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2983/6230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:22 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:23.589786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:23.590427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:23.598149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:23.598638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:23.599106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:23.599840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:23.600549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:23.600977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:23.734452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:23.742420 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05baa3c4-9009-4c31-a421-8ee046738fdf tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.157434 Aug 30 18:12:23.743009 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3248/6231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:23 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:24.764543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:24.765089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:24.772022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.772500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.772933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:24.773621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.774067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.774487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:24.910306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:24.918338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6cc73df1-840d-4fcf-b3c4-5a2dbc323c07 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.158461 Aug 30 18:12:24.919008 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2984/6232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:24 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:25.938785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:25.939467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:25.947121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.947633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.948770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.949492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.949942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.950361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:26.118594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:26.129362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-972e8d3e-e525-4c30-aba4-41191711c1a5 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.194378 Aug 30 18:12:26.131054 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3249/6233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:25 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:27.153001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:27.153636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:27.160662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:27.161185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:27.161643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:27.162330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:27.162788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:27.163217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:27.307686 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:27.316212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afb18231-abe8-4ed5-8180-ba214b126fb6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.167623 Aug 30 18:12:27.316825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2985/6234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:27 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:28.337150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:28.337762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:28.345256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:28.345754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:28.346190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:28.346874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:28.347325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:28.347780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:28.487108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:28.495046 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-be534e0b-5b47-4dcd-b58a-8d81346ff8e8 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.161671 Aug 30 18:12:28.495808 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3250/6235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:28 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:29.155701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860182131", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "febb46b2-6a55-4c4f-a64d-952cbab8d7d9", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:29.245880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:29.516984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:29.517576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:29.524381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:29.524862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:29.525297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:29.526014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:29.526471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:29.526975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:29.617724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:29.618145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:29.618661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:29.619069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:29.619506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:29.629238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:29.629720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:29.630154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:29.630882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:29.631334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:29.631785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:29.649303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:29.654734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:29.658598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:29.667230 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f4c198bf-897b-4ae9-b55a-df11ba7d2973 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.153666 Aug 30 18:12:29.667838 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3251/6236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:29 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:29.668138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:29.670186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='febb46b2-6a55-4c4f-a64d-952cbab8d7d9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:29.742329 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5eafe57d-aa8c-499f-aeec-a297adcb4af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590552 Aug 30 18:12:29.743148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2986/6237] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:29.754332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a4e142f-0292-4c49-a90a-21e848351234 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:29.754953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a4e142f-0292-4c49-a90a-21e848351234 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:29.812593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a4e142f-0292-4c49-a90a-21e848351234 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:29.819690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a4e142f-0292-4c49-a90a-21e848351234 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1057 microversion: 2.1 time: 0.069252 Aug 30 18:12:29.820265 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3252/6238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:29 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1057 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:30.689632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:30.690576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:30.699180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.700035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.700712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.701514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.702074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.702579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.841225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:30.841986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:30.853597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.854143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.854938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.855941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.856411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.856850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.928285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:30.938098 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78a4ce72-86c8-41a1-b17d-23020c2dea07 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1127 microversion: 2.1 time: 0.101937 Aug 30 18:12:30.951694 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3253/6239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:30 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1127 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:30.951911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:30.956332 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-611f31ae-61b8-4f7a-9fb2-3e80c0f7e10a tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.270963 Aug 30 18:12:30.957131 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2987/6240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:30 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:31.961426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:31.962098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:31.970050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.970461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.970907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.971680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.972149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.972755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.978339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:31.978958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:31.992405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.992903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.993345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.994072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.994539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.995621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.152080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.160447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-efa92b87-390a-41a3-9b17-2fb3dc1616fb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.203268 Aug 30 18:12:32.161245 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3254/6241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:31 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:32.302689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.322701 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-683d064c-7421-4468-aae1-0080c7303199 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.348534 Aug 30 18:12:32.325904 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2988/6242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:31 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:32.553590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d59952f-ea9c-443b-bcb0-86a22d9a1e43", "tag": "42b647d6-a57a-4ec4-a486-1d419921b248"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:32.569254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:32.569917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:32.570534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.584794 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] Creating event network-changed:42b647d6-a57a-4ec4-a486-1d419921b248 for instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 on n-h2-852771-11 Aug 30 18:12:32.591515 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-49d694b3-1425-4fbc-b13f-78998fa327c8 req-f13995fe-708a-4eab-82f6-59b4fb553b1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041556 Aug 30 18:12:32.592135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3255/6243] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:33.186503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:33.187851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:33.195179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:33.195792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:33.196297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:33.197083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:33.197595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:33.198640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:33.348669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:33.349471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:33.358690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:33.359332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:33.359905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:33.360878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:33.361744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:33.362371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:33.435402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:33.445804 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6409d9a4-19ba-4e5f-805a-bb3106a89402 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.263929 Aug 30 18:12:33.446547 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2989/6244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:33 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:33.521353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:33.530305 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44f145fc-952a-4992-a201-987fffa700e9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.186285 Aug 30 18:12:33.531442 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3256/6245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:33 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:34.470088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:34.471087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:34.483168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.484023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.484787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.485665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.486513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.487215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.553417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:34.554042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:34.563925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.564430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.565000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.565708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.566161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.566586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.663427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:34.671331 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ccbce6cc-e2cf-4c5d-97c3-6a2539684442 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.207891 Aug 30 18:12:34.675327 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2990/6246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:34 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:34.723132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:34.732846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cead0eac-7acc-4357-9e4d-8763f0452486 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.183611 Aug 30 18:12:34.733428 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3257/6247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:34 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:35.701538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:35.702550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:35.718244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.719071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.719991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.721001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.721774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.722931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.756303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:35.756940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:35.767415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.768582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.768582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.770792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.772171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.773152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.900249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:35.911075 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cccdfcbd-5e1d-43b5-b44a-4cc7485013a0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.220496 Aug 30 18:12:35.914735 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2991/6248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:35 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:35.980403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:35.989487 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23917596-8fe6-41a4-8cf2-2a9f031263eb tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1692 microversion: 2.1 time: 0.238084 Aug 30 18:12:35.990278 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3258/6249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:35 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:36.942129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:36.942731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:36.951140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.951967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.952397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.953101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.953581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.953979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.014400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:37.015688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:37.022687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.023501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.024404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.025190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.025815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.026464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.124439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:37.133576 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-871ed221-0383-4212-93a2-f84d1622a8a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.195360 Aug 30 18:12:37.148134 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2992/6250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:36 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:37.212167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:37.221177 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e55049d5-8daf-4d1b-9427-ba4ffad50a61 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1698 microversion: 2.1 time: 0.210497 Aug 30 18:12:37.231558 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3259/6251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:37 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1698 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:38.157545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:38.158073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:38.164974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.165464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.166125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.167915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.168108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.168510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.245723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:38.246428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:38.252966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.253456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.253894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.254655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.256280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.256280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.361694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.369306 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f426fe3-409a-4f7c-adca-2cb80137dde5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.215660 Aug 30 18:12:38.382549 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2993/6252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:38 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:38.427067 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.435949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b0100f25-1091-40f4-904c-f80be79075d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1698 microversion: 2.1 time: 0.195544 Aug 30 18:12:38.436526 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3260/6253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:38 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:39.391332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.391976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.398804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.399283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.399751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.400442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.400927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.402006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.458157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.458874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.466700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.467258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.467810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.468576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.469096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.469546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.532883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.540894 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-439341f2-d20c-440a-b08e-e12602efb09c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.153292 Aug 30 18:12:39.541640 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2994/6254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:39.606419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.614310 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dd0b32b7-3526-4e71-b746-32e4f56c66ff tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1683 microversion: 2.1 time: 0.160092 Aug 30 18:12:39.614888 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3261/6255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:40.562836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:40.564075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:40.570726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:40.572326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:40.575803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.576523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.577221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.578534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.579203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.579965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.659278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "name": "network-vif-unplugged", "status": "completed", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:40.676666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:40.680159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.680159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.680384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.694147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:40.706817 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] Creating event network-vif-unplugged:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:12:40.737100 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-73797945-5784-47ec-a0a3-ce29639a57d0 req-977c5c93-f3bd-458a-b3b8-54d55977af97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081352 Aug 30 18:12:40.737722 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3262/6256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:40.760366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:40.770040 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c34702e8-0583-46da-b40b-922e32dd3249 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.211696 Aug 30 18:12:40.771343 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2995/6257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:40 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:41.795661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:41.796457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:41.803207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.804032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.804466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.805300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.805754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.806175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.945017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:41.953651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b55ba8a-a0e1-4539-9ceb-4a8eb7102ea5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.165257 Aug 30 18:12:41.954356 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3263/6258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:41 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:42.789178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "name": "network-vif-plugged", "status": "completed", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:42.800842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.801438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.801868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.814236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] Creating event network-vif-plugged:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:12:42.819832 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d59f2b08-932e-4286-9a3f-b0d3ff8fbb47 req-0d13f486-7b63-40bb-9d41-c06f4efb29af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Aug 30 18:12:42.820612 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2996/6259] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:12:42.974189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:42.974821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:42.982105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.982587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.983028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.983754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.984208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.984633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.116143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.123844 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-257d90a5-56f5-47e9-be55-cd7495d8fe7a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.153550 Aug 30 18:12:43.124413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3264/6260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:42 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:44.145103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:44.145809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:44.153192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.153673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.154114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.154808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.155266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.155719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.287455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:44.295717 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-794e1230-a72c-4ebd-a5a2-a4a7d620afb7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1169 microversion: 2.1 time: 0.154830 Aug 30 18:12:44.296555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2997/6261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:44 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:45.318346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:45.318966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:45.326736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.327223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.327700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:45.328417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.328844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.329280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:45.476450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:45.485253 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9e5e16d-c236-4375-8138-e0d4837d288a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1215 microversion: 2.1 time: 0.171726 Aug 30 18:12:45.485850 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3265/6262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:45 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:46.506169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:46.506783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:46.513745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.514219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.514650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.515384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.515818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.516238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.642018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:46.649757 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f852093-77d6-4fb3-8921-aefcf8cdd9b2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.147659 Aug 30 18:12:46.650341 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2998/6263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:46 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:47.671218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:47.671866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:47.678696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.679174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.679637 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.680331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.680779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.681199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.814289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:47.822068 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-054b9197-485a-4b1f-81d0-26be2ce4d0aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.155407 Aug 30 18:12:47.822644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3266/6264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:47 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:48.842782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:48.843398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:48.850412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.850898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.851628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.852352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.852810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.853239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.986722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:48.990356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:48.995504 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5148fb9-896c-42d4-8dc7-2c568ae52075 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.156636 Aug 30 18:12:48.996090 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 2999/6265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:48 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:50.017439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:50.018091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:50.021031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=49 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:50.026520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.027007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.027451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.028832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.029296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.029724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.166099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.174324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7047881-ec7d-4907-a436-ba17ab00de75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.160828 Aug 30 18:12:50.174911 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3267/6266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:50 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:51.195028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:51.195658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:51.198493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:51.204715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.205196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.205637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.206436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.206875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.207306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.348328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:51.356355 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87aedaca-6f6d-41f7-8e01-c4aeaf2b7580 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.165589 Aug 30 18:12:51.356938 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3000/6267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:51 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:52.378031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:52.378701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:52.385810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.386295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.386732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.388094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.388590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.389016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.521843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.529754 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-600f184f-d16b-4809-8660-3d1ed6a4190a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.156026 Aug 30 18:12:52.530549 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3268/6268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:52 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:53.550319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:53.550856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:53.557764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.558242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.558674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.559388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.559991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.560443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.697514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:53.705714 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-858de78d-4f07-4624-920f-bb65f61cf715 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.159362 Aug 30 18:12:53.706308 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3001/6269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:53 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:54.726250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:54.727117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:54.734164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.734664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.735099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.735801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.736249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.736665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.868336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:54.876957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-294b5b31-0ea3-4ef8-875c-a5c17573396e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.154685 Aug 30 18:12:54.877554 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3269/6270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:54 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:55.732102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d59952f-ea9c-443b-bcb0-86a22d9a1e43", "name": "network-vif-plugged", "status": "completed", "tag": "42b647d6-a57a-4ec4-a486-1d419921b248"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:55.742638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.743369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.743715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.755746 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] Creating event network-vif-plugged:42b647d6-a57a-4ec4-a486-1d419921b248 for instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 on n-h2-852771-11 Aug 30 18:12:55.760700 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f5cd24e9-c647-49a3-ab19-aaf6f5c6f623 req-25a6a42d-84a0-4153-ad44-e2e5cbc07802 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Aug 30 18:12:55.761375 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3002/6271] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:55.898173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:55.898784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:55.906391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.906873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.907309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.908025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.908477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.908895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.038715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:56.046667 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ddb6c46e-e3d9-4606-ace3-ab99db618273 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1203 microversion: 2.1 time: 0.152428 Aug 30 18:12:56.047242 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3270/6272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:55 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.069420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.070122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.076773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.077257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.077696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.078391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.078841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.079267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.213701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.222571 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cd149996-6e2c-43be-9a67-881f0ef62f04 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1389 microversion: 2.1 time: 0.158213 Aug 30 18:12:57.223156 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3003/6273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.242911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.243665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.250555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.251033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.251466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.252174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.252624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.253045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.382581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.391199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bbdf0f88-67ba-4404-9e91-4d5cf20f5e5e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1389 microversion: 2.1 time: 0.152228 Aug 30 18:12:57.391827 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3271/6274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.411156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.411812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.417923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.418408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.418872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.419590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.420051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.420478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.549040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.556844 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c65d28d3-1c6e-421e-b5fe-b802ee13a5ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1389 microversion: 2.1 time: 0.149687 Aug 30 18:12:57.557419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3004/6275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.633487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.633988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.640349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.640836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.641273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.641969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.642430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.642854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.667836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:12:57.744540 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43d2c81d-259c-4469-83a5-a81c90d08192 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 204 len: 0 microversion: 2.1 time: 0.114616 Aug 30 18:12:57.745142 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3272/6276] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:57 2022] DELETE /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:57.753407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.753979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.760037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.760526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.760957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.761640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.762091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.762669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.892143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.899975 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8a3cac55-be9e-43b6-83d5-dad83af987b5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1395 microversion: 2.1 time: 0.150460 Aug 30 18:12:57.900550 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3005/6277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1395 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:58.922891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:58.923621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:58.930431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.930918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.931359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.932078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.932534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.932959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.064392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:59.072156 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e76144db-0191-4336-aa27-0f3d035f233a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1395 microversion: 2.1 time: 0.154549 Aug 30 18:12:59.072732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3273/6278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:58 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:59.722305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d59952f-ea9c-443b-bcb0-86a22d9a1e43", "name": "network-vif-deleted", "tag": "42b647d6-a57a-4ec4-a486-1d419921b248"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:59.733574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.734150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.735036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.752797 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] Creating event network-vif-deleted:42b647d6-a57a-4ec4-a486-1d419921b248 for instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 on n-h2-852771-11 Aug 30 18:12:59.758212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e4f2f514-38f4-4133-9795-b77ad79b372e req-f1140f7b-3d3f-4871-89dd-b1efa85fdcfd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119271 Aug 30 18:12:59.759555 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3006/6279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:00.094709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:00.095360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:00.102768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.103502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.104042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.104804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.105355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.105843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.173041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:00.181055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-15ca4004-f211-48ad-9b31-ef1978e68237 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1188 microversion: 2.1 time: 0.090742 Aug 30 18:13:00.181638 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3274/6280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:00 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:01.206276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:01.207151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:01.214576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.215059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.216175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.216784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.217383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.217812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.286496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:01.294828 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-715e8258-d647-4710-8956-cda94d2dd321 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1188 microversion: 2.1 time: 0.092707 Aug 30 18:13:01.295415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3007/6281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:01 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:02.322352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:02.322974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:02.330110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.330598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.331038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.331761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.332218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.332647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.397265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:02.405630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b66f9c15-8a0a-4239-862f-03bb06396f47 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1188 microversion: 2.1 time: 0.087171 Aug 30 18:13:02.406207 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3275/6282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:02 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:03.426091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:03.426701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:03.433790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.434889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.435327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.436039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.436484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.436903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.507958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:03.517142 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de10d870-a596-47d2-9c75-0a79575cfd94 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 200 len: 1188 microversion: 2.1 time: 0.094873 Aug 30 18:13:03.517674 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3008/6283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:03 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:03.816585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:03.818747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:03.826821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.827306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.828484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.829385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.830138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.830739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.886528 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3336a82c-5284-4738-b8eb-277ffe055fc6 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action" status: 200 len: 24572 microversion: 2.1 time: 0.073956 Aug 30 18:13:03.888768 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3276/6284] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:03 2022] POST /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:13:04.538343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:04.538963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:04.545819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.546314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.546756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.547515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.547972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.548404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.564088 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 HTTP/1.1 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0d59952f-ea9c-443b-bcb0-86a22d9a1e43'} Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:04.565798 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-85e83434-5444-4312-9cf3-8b24995e26a4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 404 len: 111 microversion: 2.1 time: 0.033051 Aug 30 18:13:04.570467 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3009/6285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:04 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:06.718910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.719528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.726790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.727558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.728024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.728704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.729161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.729594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.744907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 HTTP/1.1 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '0d59952f-ea9c-443b-bcb0-86a22d9a1e43'} Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:06.746565 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-05ca7588-92dc-4db2-9289-86634f507934 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 404 len: 111 microversion: 2.1 time: 0.035122 Aug 30 18:13:06.751897 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3277/6286] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:06 2022] DELETE /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:06.758090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.758701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 0d59952f-ea9c-443b-bcb0-86a22d9a1e43] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.766080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.766568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.767004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.767757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.768212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.768637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.783271 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 HTTP/1.1 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '0d59952f-ea9c-443b-bcb0-86a22d9a1e43'} Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.784837 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 0d59952f-ea9c-443b-bcb0-86a22d9a1e43 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69448637-a43c-490d-a660-f457f61d4777 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43" status: 404 len: 111 microversion: 2.1 time: 0.032013 Aug 30 18:13:06.789989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3010/6287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers/0d59952f-ea9c-443b-bcb0-86a22d9a1e43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:16.142702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:16.144029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:16.153837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.155443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.156562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.157788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.158482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.159341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.166331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:16.197414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:16.215217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:16.226223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.227254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.228210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.242128 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] Creating event network-changed:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:13:16.248223 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6a013a6a-2805-4d8c-89ef-59c83421a0dc req-4c46b411-9c6e-4f6d-bc69-d4cbad2fd725 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109770 Aug 30 18:13:16.249354 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3011/6288] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:13:16.326034 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e7832e45-9c40-4686-8bb0-7e6d4f6a2123 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 204 len: 0 microversion: 2.1 time: 0.189753 Aug 30 18:13:16.331024 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3278/6289] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:16 2022] DELETE /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:16.337032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:16.337731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:16.344720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.345347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.345978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.346701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.347158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.347615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.500709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:16.508645 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-02fa3398-3caf-4323-b184-39f5a8654cef tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1689 microversion: 2.1 time: 0.175841 Aug 30 18:13:16.524178 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3012/6290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:16 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:17.531369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.532089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:17.540486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.540978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.541411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.544243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.544243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.544243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.709385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.719063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-809427d9-77f8-43d7-a2b8-6c584987ce70 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1689 microversion: 2.1 time: 0.191838 Aug 30 18:13:17.724851 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3279/6291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:18.641220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b14b09-819c-4017-88bc-1aa723915a33", "name": "network-vif-deleted", "tag": "3f85a376-0a3b-450d-a1e3-90b32b226276"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:18.673337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.673816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.674269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.687439 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] Creating event network-vif-deleted:3f85a376-0a3b-450d-a1e3-90b32b226276 for instance c5b14b09-819c-4017-88bc-1aa723915a33 on n-h1-852771-11 Aug 30 18:13:18.692523 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-53a6a579-0d5c-4e1a-8bbc-956c855abe7a req-bbc149c9-8567-490e-9779-441b8cee426b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055183 Aug 30 18:13:18.693138 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3013/6292] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:18.743922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.744521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:18.752852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.753615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.754057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.754772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.755231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.755738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.796202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.796769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.797219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.797674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lazy-loading 'fault' on Instance uuid c5b14b09-819c-4017-88bc-1aa723915a33 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:18.862907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b45d9856716b4bbabc9eacbed7b8fa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a340bef6214caf85d78be544a88327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:18.871127 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f94c6f3d-1a86-4622-a7f3-80b7d300b4d4 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 200 len: 1356 microversion: 2.1 time: 0.132578 Aug 30 18:13:18.871729 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3280/6293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:18 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 1356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:19.893731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.896531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [instance: c5b14b09-819c-4017-88bc-1aa723915a33] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.903071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.903592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.904036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.904790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.905249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.905790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.919570 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] HTTP exception thrown: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Request method failure captured: Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 HTTP/1.1 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlGDwXmImJOpEs8dvPBn9r-uyIf9kUDlojS3mwmrJzSPSAps_CJQoqoDeiezhgu1NqiXGGSafMF1julVC5XM_xI8eLxFOKCaS_1lZb2uBaeSqlmNEC-USSPCXaAOwFbgYHiBAkWOHakWOSe2AimNS0Neqtzlrk4SLwJI2KrFpj_INKs Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4a340bef6214caf85d78be544a88327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c4a340bef6214caf85d78be544a88327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c4a340bef6214caf85d78be544a88327"}]}] Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: c4a340bef6214caf85d78be544a88327 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1001259681 Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: b45d9856716b4bbabc9eacbed7b8fa2d Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1001259681-project Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c5b14b09-819c-4017-88bc-1aa723915a33'} Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.921947 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Returning 404 to user: Instance c5b14b09-819c-4017-88bc-1aa723915a33 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de69c3d7-e19e-48e8-b5ea-6516f5508dd9 tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33" status: 404 len: 111 microversion: 2.1 time: 0.035123 Aug 30 18:13:19.927282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3014/6294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/c5b14b09-819c-4017-88bc-1aa723915a33 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:23.729816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f856e8c8-ec91-4cad-88db-4bef4b36337e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] Calling method '.version_select at 0x7f2d93540c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:23.754677 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f856e8c8-ec91-4cad-88db-4bef4b36337e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:13:24.762554 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-f856e8c8-ec91-4cad-88db-4bef4b36337e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60658. Aug 30 18:13:24.769978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:24.786423 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f856e8c8-ec91-4cad-88db-4bef4b36337e tempest-TestNetworkAdvancedServerOps-1001259681 tempest-TestNetworkAdvancedServerOps-1001259681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1959422453" status: 202 len: 0 microversion: 2.1 time: 1.061392 Aug 30 18:13:24.787038 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3281/6295] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1959422453 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:27.591903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1216634909", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9759418f-5f36-462f-b432-5112f06d778a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:27.604848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=30 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:27.663224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:28.075933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:28.076915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:28.077393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:28.077996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:28.078404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:28.087913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.088390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.088820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:28.089569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.090073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.090497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:28.098308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=63 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:28.110944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:28.116401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:28.175237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:28.177380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9759418f-5f36-462f-b432-5112f06d778a',volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:28.314205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e74224e4-794b-4a30-b1d8-b2f6d20fd723 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726245 Aug 30 18:13:28.314860 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3015/6296] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:28.328861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2fa2a99-fcc1-44cf-8242-3205fd0eb0b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:28.329490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2fa2a99-fcc1-44cf-8242-3205fd0eb0b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:28.391687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2fa2a99-fcc1-44cf-8242-3205fd0eb0b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:28.398757 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2fa2a99-fcc1-44cf-8242-3205fd0eb0b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1071 microversion: 2.1 time: 0.076312 Aug 30 18:13:28.399339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3282/6297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:28 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1071 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:29.421862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:29.422470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:29.430803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.431448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.431919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.432616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.433066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.433488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.518260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:29.527435 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c916fd45-9f6e-47d6-bd72-17164ff35489 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1187 microversion: 2.1 time: 0.110441 Aug 30 18:13:29.530891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3016/6298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:29 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:30.551376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:30.552179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:30.554187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:30.563422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.564010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.564511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.565279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.565796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.566284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.714402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:30.724870 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98b5d729-2288-494e-8a97-c0a97c345964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1229 microversion: 2.1 time: 0.179475 Aug 30 18:13:30.726341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3283/6299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:30 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1229 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:30.734598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b618f28-b8d1-455c-bc16-e2cfc30c92b4", "tag": "037230a0-39ee-4265-af4c-353cb53b63ff"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:30.748006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.748520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.749037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.761611 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] Creating event network-changed:037230a0-39ee-4265-af4c-353cb53b63ff for instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 on n-h2-852771-11 Aug 30 18:13:30.767159 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ed0325af-5309-4efb-92d1-6af5a4a3a16b req-08ed1b5c-ac96-40d6-84be-b2e1a575bcc8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037343 Aug 30 18:13:30.768046 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3017/6300] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:31.746518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:31.747646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:31.756063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.756730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.757273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.758251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.758838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.759373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.908766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:31.917275 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfbe5ebc-3f50-4a2d-936c-ec0a6066be84 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1229 microversion: 2.1 time: 0.174804 Aug 30 18:13:31.917864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3284/6301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:31 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1229 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:32.940421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.941125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:32.947426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.947931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.948362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.949040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.949486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.949900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.089034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:33.097583 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d08e8cc0-066b-4442-a1a5-591afdb972d1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1229 microversion: 2.1 time: 0.162834 Aug 30 18:13:33.098171 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3018/6302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1229 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:34.118726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:34.119378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:34.126662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.127176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.127649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.128376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.128839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.129279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.269604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:34.282383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-68485779-1094-4e27-9749-bf0492073400 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1229 microversion: 2.1 time: 0.167569 Aug 30 18:13:34.283660 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3285/6303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:34 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:35.305525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:35.306133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:35.313145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:35.313622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:35.314062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:35.314742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:35.315190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:35.315637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:35.451688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:35.459834 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ccb96de-6792-46ed-ae7a-6ca031014792 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.158902 Aug 30 18:13:35.460409 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3019/6304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:35 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:36.482091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:36.482701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:36.488948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.489428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.489859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.490539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.490988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.491409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.623259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:36.631672 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d2afaed4-986c-4042-ab5b-0738f0313e3b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.153856 Aug 30 18:13:36.632249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3286/6305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:36 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:37.652796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:37.653403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:37.661959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.662435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.662894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.663604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.664050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.664467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.793957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:37.801829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50161342-f435-4c15-8046-ca29e604a651 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.152944 Aug 30 18:13:37.802406 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3020/6306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:37 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:38.822281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:38.822938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:38.825981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:38.832512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:38.833001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:38.833444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:38.834142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:38.834603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:38.835033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:38.967604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:38.975505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eba0273b-d156-4a9e-a324-db7c06cbf727 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.157135 Aug 30 18:13:38.976086 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3287/6307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:38 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:39.996694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:39.997297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:39.999304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:40.000116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:40.007217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.007724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.008162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.008889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.009351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.009905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.144966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.152875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b4e26bb3-78c5-4cf3-b7dd-417303800e08 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.160162 Aug 30 18:13:40.153638 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3021/6308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:39 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:41.174967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:41.175664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:41.182470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.182950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.183380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.184086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.184538 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.184956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.314155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:41.323114 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-782f7789-ccbb-419c-a5dd-40e3a766eb91 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.152725 Aug 30 18:13:41.323734 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3288/6309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:41 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:42.343982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:42.344574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:42.351622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.352100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.352535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.353227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.353929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.354348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.483822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.492698 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d3835de-1e88-4b29-b6a7-0b3c2df37074 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.152687 Aug 30 18:13:42.493279 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3022/6310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:42 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:43.514212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:43.514895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:43.522508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:43.522989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:43.523426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:43.524134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:43.524580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:43.524999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:43.659998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:43.667806 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-99288cad-8226-4934-b7e1-690343c7f835 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.157505 Aug 30 18:13:43.668382 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3289/6311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:43 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:44.688328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:44.688948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:44.695922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.696401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.696837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.697527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.697982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.698403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.834222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:44.842461 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69803dfd-6cf0-414c-9136-459a05584b6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.157952 Aug 30 18:13:44.843229 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3023/6312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:44 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:45.863854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.864474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.872292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.872784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.873314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.874186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.874647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.875068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.014684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.024314 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69b2a500-1a3d-438c-90de-cc9770c3b687 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.164403 Aug 30 18:13:46.025251 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3290/6313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:45 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:46.161525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b618f28-b8d1-455c-bc16-e2cfc30c92b4", "name": "network-vif-plugged", "status": "completed", "tag": "037230a0-39ee-4265-af4c-353cb53b63ff"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:46.170930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.171406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.171868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.182560 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] Creating event network-vif-plugged:037230a0-39ee-4265-af4c-353cb53b63ff for instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 on n-h2-852771-11 Aug 30 18:13:46.187646 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ec6bc0e5-b6c9-405f-ba3b-978ebeaa37f0 req-7252ec15-2256-46bb-bf40-78a0b0e95413 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185235 Aug 30 18:13:46.188234 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3024/6314] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:13:47.045114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:47.045768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:47.053354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.053844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.054288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.054984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.055442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.055898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.190129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:47.198265 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e21058a6-349a-44f5-bae3-f3463218758c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1217 microversion: 2.1 time: 0.157113 Aug 30 18:13:47.198844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3291/6315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:47 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:48.220068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:48.220750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.227603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.228078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.228507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.229443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.229889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.230305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.365218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.373127 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0aa2742a-f759-425d-acf4-a5231ecfe096 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1403 microversion: 2.1 time: 0.158188 Aug 30 18:13:48.373684 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3025/6316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:48 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:48.394278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:48.395086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.401984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.402469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.402909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.403630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.404086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.404516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.534545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.542495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-860fad4d-f6c5-4b2e-8376-96a60cca95d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1403 microversion: 2.1 time: 0.152737 Aug 30 18:13:48.543079 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3292/6317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:48 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:48.562882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1030030642"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:48.565818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.571817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.572291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.572724 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.573400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.573845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.574262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.667776 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Attempting to quiesce instance before volume snapshot. Aug 30 18:13:48.722186 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 30 18:13:48.790547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Creating snapshot from volume 9759418f-5f36-462f-b432-5112f06d778a. {{(pid=122123) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 30 18:13:49.621082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b054251-96cd-47c5-88ce-b439cbc60b3f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4/action" status: 202 len: 0 microversion: 2.1 time: 1.061999 Aug 30 18:13:49.623511 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3026/6318] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:48 2022] POST /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4/action => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 30 18:13:50.777109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-489925604", "imageRef": "d687823e-86ca-4cf3-83b6-2d62d4f64d9f", "flavorRef": "452", "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:50.834097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:51.307493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:51.307939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:51.308415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:51.308824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:51.309239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:51.318884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.319362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.319879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.320965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.321599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.322160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.339659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:51.345003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:51.357991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:51.360599 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ba44d423-9f32-428c-b4a1-688a52e24389',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:51.448601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e0c8b72-f842-42f6-bba0-7c2779b92eff tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675287 Aug 30 18:13:51.449242 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3293/6319] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:51.461968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff78fb87-2845-4a0f-9ac3-11f62aabe9b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:51.462680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff78fb87-2845-4a0f-9ac3-11f62aabe9b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:51.519518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff78fb87-2845-4a0f-9ac3-11f62aabe9b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:51.526643 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff78fb87-2845-4a0f-9ac3-11f62aabe9b1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1229 microversion: 2.1 time: 0.069760 Aug 30 18:13:51.527310 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3027/6320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:51 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1229 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:52.549873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.550635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.559102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.559618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.560246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.560945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.561543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.561981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.631444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.641433 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85f51c40-d685-4144-a89a-9fbb74b0eb42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1299 microversion: 2.1 time: 0.096535 Aug 30 18:13:52.642337 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3294/6321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:52 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:53.670559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:53.671768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:53.681703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.682377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.683078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.683995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.684614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.685345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.914861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5426ed6-fc8e-4501-a285-89ee8daf2279", "tag": "c65c73ec-60ca-4190-9b1b-bfb68f1d7394"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:53.934809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.935263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.937227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.944328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:53.949241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] Creating event network-changed:c65c73ec-60ca-4190-9b1b-bfb68f1d7394 for instance b5426ed6-fc8e-4501-a285-89ee8daf2279 on n-h1-852771-11 Aug 30 18:13:53.954500 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-209c9f7b-7afa-4194-b738-b5d523da90f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.294605 Aug 30 18:13:53.954825 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-11dfe1af-dd0d-4e61-948a-406bff9c3405 req-ab27ee98-8069-445d-bf73-2b04d1c712d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044558 Aug 30 18:13:53.956055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3295/6322] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:13:53.968998 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3028/6323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:53 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:54.977158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:54.977846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:54.984998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.985483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.985919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.986700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.987161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.987624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.122764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.130845 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d322fa76-663f-4a00-9a41-d116232179a1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.157601 Aug 30 18:13:55.131427 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3029/6324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:54 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:56.153904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:56.154724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:56.158133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:56.162815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.163514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.163970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.164775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.165249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.165680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.377787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:56.396173 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f13b312-37b8-46ac-b07a-2bdc998263c4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.247380 Aug 30 18:13:56.396799 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3296/6325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:56 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:57.418729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:57.419436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:57.428856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.429393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.429851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.430570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.431070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.431611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.632207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.656748 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a696f77d-a62c-4100-8454-3521e3a423c2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.241597 Aug 30 18:13:57.659447 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3030/6326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:57 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:58.685050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:58.686606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:58.695059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.695606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.696049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.696871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.697328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.697755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.868259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:58.875778 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ea7b28e-b384-4dfe-a5cf-968b8926dafd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.197238 Aug 30 18:13:58.876467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3297/6327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:58 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:59.899269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:59.899972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:59.902992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:59.908408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.909184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.909754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.910483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.910944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.911392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.916197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:00.082081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.090875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff91610e-7a96-431a-8433-a87a1a255397 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.195407 Aug 30 18:14:00.091831 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3031/6328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:59 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:01.112012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:01.112768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:01.119957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.120436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.120870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.121556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.122005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.122425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.126391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=83 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:01.256766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.264532 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83bdd3d5-9466-4498-a16b-6ec66af6071d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.156924 Aug 30 18:14:01.265413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3298/6329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:01 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:02.285748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.286380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.290304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:02.294453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.294954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.295409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.296179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.296676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.297117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.431658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:02.439460 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2c9a84cf-19eb-4121-851a-de482ccadb92 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.157634 Aug 30 18:14:02.440061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3032/6330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:03.461031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.461848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.465293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:03.466093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:03.472918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.473454 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.473930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.474636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.475096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.475546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.612209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:03.620424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a960b0c-1210-4e46-b29b-09aadc71b144 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.163476 Aug 30 18:14:03.621030 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3299/6331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:04.642991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:04.643560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:04.650530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.651105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.651691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.652576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.653043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.653654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.798737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:04.807023 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07ffba80-4369-4602-a22a-c21bf6ef1251 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.168749 Aug 30 18:14:04.807628 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3033/6332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:04 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:05.828123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:05.828829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:05.836370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.836910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.837355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.838058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.838515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.838946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.980659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:05.989411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7af7d585-6996-4bab-a130-39bd82a5b3db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1341 microversion: 2.1 time: 0.165311 Aug 30 18:14:05.990018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3300/6333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:05 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:07.010688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:07.011329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:07.018963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:07.019618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:07.020270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:07.021146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:07.021639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:07.022215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:07.167682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:07.176026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e514bbdd-bdae-49c6-8968-2d9f75fe54eb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1387 microversion: 2.1 time: 0.169624 Aug 30 18:14:07.176614 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3034/6334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:07 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:08.199796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:08.200418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:08.208386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:08.208866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:08.209306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:08.209991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:08.210439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:08.210857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:08.348363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:08.356669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0f87a343-94d9-4850-bc3a-11916988ffd0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.160874 Aug 30 18:14:08.357253 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3301/6335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:08 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:09.379722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:09.380366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:09.387253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.387773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.388221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.388917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.389376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.389809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.532105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:09.540544 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e0e7f92a-3fde-404b-8903-9b8cfac783b7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.165409 Aug 30 18:14:09.541126 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3035/6336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:09 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:10.562311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:10.562880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:10.570898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.575890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.576397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.577135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.577609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.578043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.720903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:10.730924 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a4fae640-470a-4fb8-864c-c587a9154215 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.172452 Aug 30 18:14:10.731520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3302/6337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:10 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:11.755668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:11.756364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:11.764867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.765523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.766141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.766943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.767568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.768183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.910590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.918537 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae258bcb-b88b-4032-b483-3036ddbee266 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.168672 Aug 30 18:14:11.919123 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3036/6338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:11 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:12.940100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:12.940742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:12.947592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.948070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.948505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:12.949185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.949633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.950053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.084432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:13.092244 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-129b7fa8-4cb1-497b-8ac7-48956adda0de tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.155992 Aug 30 18:14:13.092826 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3303/6339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:12 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:14.117169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:14.117905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:14.125993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:14.126468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:14.127195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:14.128707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:14.129460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:14.129816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:14.366748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:14.376782 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c97a652-38dd-4393-8ed6-dc003672b9f1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.264566 Aug 30 18:14:14.377548 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3037/6340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:14 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:15.399170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:15.400559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:15.407788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.408280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.408718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.410151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.410708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.411142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.555735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.565043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d94273e7-b654-42d7-a6e2-ccd69159d5c6 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.170085 Aug 30 18:14:15.566432 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3304/6341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:15 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:16.592206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.593196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.601571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.602069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.602512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.603208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.603699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.604159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.744930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.753389 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-420b4aac-c95b-45c2-9197-6dc45f3c1ba4 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.167092 Aug 30 18:14:16.754884 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3038/6342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:17.044196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5426ed6-fc8e-4501-a285-89ee8daf2279", "name": "network-vif-plugged", "status": "completed", "tag": "c65c73ec-60ca-4190-9b1b-bfb68f1d7394"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:17.058569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.059368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.059936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.072827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] Creating event network-vif-plugged:c65c73ec-60ca-4190-9b1b-bfb68f1d7394 for instance b5426ed6-fc8e-4501-a285-89ee8daf2279 on n-h1-852771-11 Aug 30 18:14:17.078966 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1bd6d6fa-dcf8-41b5-9d39-4a6107c5206a req-c139d991-6d3b-4815-8051-49a52f3137f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038841 Aug 30 18:14:17.079898 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3305/6343] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:17.777081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:17.777634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:17.784453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.784939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.785410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.786110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.786561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.786991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.920388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:17.929095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-28140530-4051-48dc-bc4d-e52216514929 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1375 microversion: 2.1 time: 0.155934 Aug 30 18:14:17.929746 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3039/6344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:17 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:18.955320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.956062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.962613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.963101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.963552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.964250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.964724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.965149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.101071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.109407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aa5f3449-5770-475d-974b-3d9dbf65bf14 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1561 microversion: 2.1 time: 0.159130 Aug 30 18:14:19.110035 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3306/6345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.130388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.131034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.138271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.138843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.139290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.140008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.140467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.140898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.351248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.359396 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36b3ea00-0405-411e-9429-83f704609775 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1561 microversion: 2.1 time: 0.233000 Aug 30 18:14:19.360010 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3040/6346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.437874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.438369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.444670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.445166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.445683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.446371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.446821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.447240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.474960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:14:19.555522 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ce87462a-5eae-4959-90d9-7d15e9bd93a5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 204 len: 0 microversion: 2.1 time: 0.121344 Aug 30 18:14:19.556142 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3307/6347] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:19 2022] DELETE /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:19.565387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.565640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.572386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.572882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.573334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.574043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.574505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.574946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.712921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.720900 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-54bd90ae-559e-4c8f-8a09-3ac59ea746d8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1567 microversion: 2.1 time: 0.159977 Aug 30 18:14:19.721478 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3041/6348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:20.742322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:20.742945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:20.749781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.750293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.750729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.751415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.751894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.752318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.892378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.901136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1707dee4-8e63-4663-b7a3-be6ae53c503d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1567 microversion: 2.1 time: 0.163828 Aug 30 18:14:20.901730 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3308/6349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:20 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:21.706939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5426ed6-fc8e-4501-a285-89ee8daf2279", "name": "network-vif-deleted", "tag": "c65c73ec-60ca-4190-9b1b-bfb68f1d7394"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:21.727021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.727534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.728029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.747389 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] Creating event network-vif-deleted:c65c73ec-60ca-4190-9b1b-bfb68f1d7394 for instance b5426ed6-fc8e-4501-a285-89ee8daf2279 on n-h1-852771-11 Aug 30 18:14:21.753116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-08da94db-868e-4971-bae0-3163c18e853c req-872fe56d-29a8-43b7-b5c3-98e13634b178 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051797 Aug 30 18:14:21.753914 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3042/6350] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:21.922324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.922888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:21.930465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.930957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.931397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.932151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.932613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.933044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.997266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:22.005789 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3cf6c0d4-d273-4e7e-91d0-bed4e771ccca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1360 microversion: 2.1 time: 0.086956 Aug 30 18:14:22.006360 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3309/6351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:14:23.028445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:23.029159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:23.035415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.035965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.036903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.037610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.038078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.038505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.107453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:23.116018 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7a70d638-3330-4484-8cd0-46461d567f6f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1360 microversion: 2.1 time: 0.092693 Aug 30 18:14:23.116597 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3043/6352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:23 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:24.137574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.138501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:24.145698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.146230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.146680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.147397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.147891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.148330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.216871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.225418 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae034f40-44ed-4705-9cd2-da095705c979 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1360 microversion: 2.1 time: 0.091773 Aug 30 18:14:24.226012 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3310/6353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:24 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:25.247146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.247813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:25.255590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.256094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.256543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.257254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.257720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.258168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.325243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.334904 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2670a841-260c-4bca-a47b-08b998e022d3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1360 microversion: 2.1 time: 0.091682 Aug 30 18:14:25.335765 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3044/6354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:26.359516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:26.360194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:26.363741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:26.371628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.372193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.372658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.373421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.373947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.374472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.412049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.412667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.412999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.413541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lazy-loading 'fault' on Instance uuid b5426ed6-fc8e-4501-a285-89ee8daf2279 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:26.474993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:26.487882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f97e1288-e77c-44e7-9ee3-1be11d9176b9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 200 len: 1365 microversion: 2.1 time: 0.133203 Aug 30 18:14:26.488979 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3311/6355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:26 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:27.510517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:27.511325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:27.518594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.519015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.519500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:27.520205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.520674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.521099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:27.535330 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 HTTP/1.1 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b5426ed6-fc8e-4501-a285-89ee8daf2279'} Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:27.537984 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-492c4d0e-a96e-42d9-9e00-847d432d266c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 404 len: 111 microversion: 2.1 time: 0.033028 Aug 30 18:14:27.544294 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3045/6356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:27 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:31.826362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.826866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.834502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.834984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.835421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.836141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.836595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.837022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.840974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:31.864514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:14:31.938118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-56294d9b-b797-4466-bbf7-8595a4fb786f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 204 len: 0 microversion: 2.1 time: 0.115272 Aug 30 18:14:31.938757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3312/6357] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:31 2022] DELETE /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:31.947438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.948090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.951081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=30 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:31.956732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.957308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.957765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.959116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.959623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.960070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.962809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=82 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:32.089386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:32.097222 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c0b1f32-c64b-4b1c-bc9f-a74a7e4cd856 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1409 microversion: 2.1 time: 0.153649 Aug 30 18:14:32.097799 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3046/6358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:31 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.118918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.119659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.126493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.126972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.127405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.128117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.128603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.129025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.259028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:33.267195 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6904c477-f20e-4c87-9947-fbc105e11993 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1409 microversion: 2.1 time: 0.152804 Aug 30 18:14:33.267852 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3313/6359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:33 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.845505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b618f28-b8d1-455c-bc16-e2cfc30c92b4", "name": "network-vif-deleted", "tag": "037230a0-39ee-4265-af4c-353cb53b63ff"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:33.857951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.858436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.858872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.871826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] Creating event network-vif-deleted:037230a0-39ee-4265-af4c-353cb53b63ff for instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 on n-h2-852771-11 Aug 30 18:14:33.876964 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6672e1c1-70d2-423b-ac18-d5a5c2ed5e9b req-e7596fd3-c2fd-4977-9018-3bab83f5802c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Aug 30 18:14:33.877858 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3047/6360] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:34.289794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:34.290410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:34.297279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.297761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.298193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.298882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.299334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.299781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.368088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.376840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-516a6dfe-483c-4bce-8227-994fc9a13141 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1202 microversion: 2.1 time: 0.091897 Aug 30 18:14:34.377417 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3314/6361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:34 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:35.398971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:35.399858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:35.407170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:35.407710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:35.408162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:35.408877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:35.409370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:35.409811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:35.479254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:35.487806 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-accb7109-fe55-44fd-b6d1-8698fe304d2a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1202 microversion: 2.1 time: 0.093148 Aug 30 18:14:35.488409 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3048/6362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:35 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:36.509332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:36.509897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:36.516326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.516806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.517250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.517948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.518412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.518843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.580936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.589806 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1af1a66c-cbbb-4906-ac8c-4ef5504468bf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1202 microversion: 2.1 time: 0.085239 Aug 30 18:14:36.590396 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3315/6363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:36 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:37.611052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:37.611820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:37.618820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.619399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.619885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.620578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.621034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.621465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.689798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:37.697855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50333cbe-5ca1-40ed-8203-3156fa683263 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 200 len: 1202 microversion: 2.1 time: 0.090665 Aug 30 18:14:37.698468 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3049/6364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:37 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:38.719884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:38.720655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:38.728528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.729026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.729468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.730431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.731305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.731791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.747830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 HTTP/1.1 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5b618f28-b8d1-455c-bc16-e2cfc30c92b4'} Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:38.749429 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9b6aff1-2d7c-43a2-b57d-43528a79f95a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 404 len: 111 microversion: 2.1 time: 0.035213 Aug 30 18:14:38.753983 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3316/6365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:38 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:40.899165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:40.899743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:40.907020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.907548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.907997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.908704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.909167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.909605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.924573 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 HTTP/1.1 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'b5426ed6-fc8e-4501-a285-89ee8daf2279'} Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:40.926425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-35ec7f94-06f7-49fa-92b3-7e5a84d0082e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 404 len: 111 microversion: 2.1 time: 0.033544 Aug 30 18:14:40.931311 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3050/6366] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:40 2022] DELETE /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:40.936823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:40.937440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: b5426ed6-fc8e-4501-a285-89ee8daf2279] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:40.944853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.945340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.945780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.946473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.946923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.947345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.961871 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 HTTP/1.1 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'b5426ed6-fc8e-4501-a285-89ee8daf2279'} Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.963416 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance b5426ed6-fc8e-4501-a285-89ee8daf2279 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a190062b-6edc-4cc7-b68e-f9a1e513c87a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279" status: 404 len: 111 microversion: 2.1 time: 0.031945 Aug 30 18:14:40.968182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3317/6367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:40 2022] GET /compute/v2.1/servers/b5426ed6-fc8e-4501-a285-89ee8daf2279 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:14:41.345298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:41.345944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:41.352284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.352859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.353403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.354182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.354727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.355175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.369968 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 HTTP/1.1 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5b618f28-b8d1-455c-bc16-e2cfc30c92b4'} Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:41.371582 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4f8a0d2e-4ee2-4b75-bf91-6ace6bc67b22 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 404 len: 111 microversion: 2.1 time: 0.031656 Aug 30 18:14:41.376858 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3051/6368] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:41 2022] DELETE /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:14:41.382450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:41.383063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 5b618f28-b8d1-455c-bc16-e2cfc30c92b4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:41.389127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.389592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.390023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.390710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.391159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.391608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.405000 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 HTTP/1.1 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5b618f28-b8d1-455c-bc16-e2cfc30c92b4'} Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:41.406513 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 5b618f28-b8d1-455c-bc16-e2cfc30c92b4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0ebf32a8-51fe-4b97-a7da-ca33ee607c80 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4" status: 404 len: 111 microversion: 2.1 time: 0.029951 Aug 30 18:14:41.411508 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3318/6369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:41 2022] GET /compute/v2.1/servers/5b618f28-b8d1-455c-bc16-e2cfc30c92b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:41.483372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: .version_select at 0x7f2d935560d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1927489816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaG5BkatgbzlwNPMBfa2sSeTU6Un87HiBZVIEnApB6Se7SEuXGyUQtjbJxgV0EaRkg6wLpOM8ch5BKKyxw1fz+x4RomscRAzp5+VZoTJ9pSKBhiP0K1yedsf5Wy1eVbHg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:41.499834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:41.505862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:41.519322 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:14:42.527748 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [39b00306-4754-4ed7-9070-25b484b9e9a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 32772. Aug 30 18:14:42.542566 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2f045ba-c4c3-4a45-8752-c738970dddd3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.063373 Aug 30 18:14:42.543168 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3052/6370] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:14:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:14:58.714350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1593925331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927489816", "security_groups": [{"name": "tempest-secgroup-smoke-1299399809"}], "block_device_mapping_v2": [{"uuid": "c8d0e0fc-985a-4b54-ae52-5f708dfa0189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:58.725521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:58.726167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:58.834760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:59.212547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:59.212970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:59.213446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:59.213879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:59.214337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:59.223164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.223687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.224124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.225385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.225985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.226410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.243905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:59.249119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:59.307152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:59.309307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8d0e0fc-985a-4b54-ae52-5f708dfa0189',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:59.438431 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f3d6faa7-3c13-4599-ab28-74723bbbd68c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727915 Aug 30 18:14:59.439102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3319/6371] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:14:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:14:59.448172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=23 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:59.449151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:59.449821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:59.453914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d7f471c3-c75e-4239-8ed8-bb349afd40e3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.454665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d7f471c3-c75e-4239-8ed8-bb349afd40e3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:59.516578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d7f471c3-c75e-4239-8ed8-bb349afd40e3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.524462 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d7f471c3-c75e-4239-8ed8-bb349afd40e3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1095 microversion: 2.1 time: 0.078327 Aug 30 18:14:59.525041 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3053/6372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:00.545329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:00.546821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:00.557912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.558691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.559390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.560487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.561190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.561855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.628128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:00.636120 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-26dbc1dc-0e30-4757-9592-ef4dc64913ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1211 microversion: 2.1 time: 0.095037 Aug 30 18:15:00.643844 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3320/6373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:00 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:01.659303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:01.660315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:01.668186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.668700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.669188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.669908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.670377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.670967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.876260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:01.885266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b6817afa-c8c0-4e17-8e1e-065febaa75f9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1279 microversion: 2.1 time: 0.231606 Aug 30 18:15:01.885917 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3054/6374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:01 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:01.954153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98c3f3c-2f46-4ef0-afc5-21773030464c", "tag": "b31be8ba-3a38-4547-bcd0-c50208219281"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:01.965955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.967283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.967993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.984578 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] Creating event network-changed:b31be8ba-3a38-4547-bcd0-c50208219281 for instance f98c3f3c-2f46-4ef0-afc5-21773030464c on n-h1-852771-11 Aug 30 18:15:01.990165 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-bd42502a-02a9-4abe-9805-2ed3337b7848 req-ec1fcb64-7584-4aa5-bfa7-92b494ba3f19 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042964 Aug 30 18:15:01.992000 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3321/6375] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:02.906756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:02.907374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:02.914908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:02.915406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:02.915968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:02.916695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:02.917159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:02.917605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.053566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:03.061622 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a41c28ba-452c-425c-9653-8b772e0d6994 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1279 microversion: 2.1 time: 0.159264 Aug 30 18:15:03.062300 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3055/6376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:02 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:04.083366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:04.084025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:04.090535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.091024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.091462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.092180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.092634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.093061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.223922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:04.232613 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad94bff1-95e9-47b6-9737-ee9b6599aebc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1279 microversion: 2.1 time: 0.154413 Aug 30 18:15:04.233193 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3322/6377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:04 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:05.253756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:05.254376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:05.262271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.263087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.263752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.264649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.264954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.265397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.411146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:05.421016 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12d00099-ff6e-4d36-8ec7-81c0522d2a1e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1279 microversion: 2.1 time: 0.171326 Aug 30 18:15:05.421654 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3056/6378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:05 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:06.444373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:06.445114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:06.451237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:06.451745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:06.452182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:06.452862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:06.453314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:06.453733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:06.589571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:06.597403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-89fdd56b-dec6-4864-bd2d-b462bc1d837f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.157620 Aug 30 18:15:06.597992 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3323/6379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:06 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:07.618856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:07.619415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:07.626280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.626802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.627256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.627987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.628453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.628893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.757938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:07.765941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b10618db-e2e8-4dc0-89c6-f87cf947985e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.151115 Aug 30 18:15:07.766540 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3057/6380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:07 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:08.791286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:08.791917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:08.798757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:08.799237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:08.799706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:08.800394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:08.800843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:08.801264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:08.933330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:08.941100 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-59544d67-ed09-4608-96ec-cb8ce09ff4d0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.154394 Aug 30 18:15:08.941670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3324/6381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:08 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:09.962263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:09.962878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:09.965720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:09.971305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.971821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.972268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.972993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.973451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.973913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:10.114062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:10.122536 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eacfa2ce-2537-4d57-bfd1-0533806fe863 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.164247 Aug 30 18:15:10.123059 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3058/6382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:09 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:11.142278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:11.142898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:11.144903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:11.145568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:11.153180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.153670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.154116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.154820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.155277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.155743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.290293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:11.298175 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98e70268-1400-464d-9603-084e25d230f8 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.159835 Aug 30 18:15:11.298765 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3325/6383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:11 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:15:12.318964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:12.319642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:12.326520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:12.327042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:12.327580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:12.328292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:12.328778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:12.329314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:12.461867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:12.469683 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dc639742-b6c2-4864-a821-f552a7d5f3a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.154611 Aug 30 18:15:12.470464 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3059/6384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:12 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:13.490367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:13.491008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:13.499870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.500362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.500801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:13.501505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.501989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.502418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:13.635581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:13.643249 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8aa8e9da-03d1-4172-90ce-2bf31a2db44b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.156800 Aug 30 18:15:13.643864 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3326/6385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:13 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:14.664943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:14.665494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:14.672324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.672812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.673254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.673948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.674407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.674867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.805176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:14.812985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-068e0ad4-1acd-48d7-9a8a-bb9b486a3509 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.152709 Aug 30 18:15:14.813557 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3060/6386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:14 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:15.405000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98c3f3c-2f46-4ef0-afc5-21773030464c", "name": "network-vif-plugged", "status": "completed", "tag": "b31be8ba-3a38-4547-bcd0-c50208219281"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:15.417003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.417724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.418164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.430179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] Creating event network-vif-plugged:b31be8ba-3a38-4547-bcd0-c50208219281 for instance f98c3f3c-2f46-4ef0-afc5-21773030464c on n-h1-852771-11 Aug 30 18:15:15.435278 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1ada2304-c388-4c7d-845d-d491e97a783b req-3ae43976-fc8a-4b15-9eee-b66f03c1c809 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034026 Aug 30 18:15:15.436009 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3327/6387] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:15.833651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:15.834273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:15.841172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.841658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.842103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.842795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.843253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.843719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.974158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:15.982398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfb39fb3-d79b-4221-9a1c-eb3ee551b66f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1267 microversion: 2.1 time: 0.152505 Aug 30 18:15:15.982970 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3061/6388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:15 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:17.005412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:17.006111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:17.012776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.013250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.013708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.014393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.014843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.015264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.145533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:17.154262 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37a270bb-599f-40c4-bc7c-bcfcd598c3a9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1453 microversion: 2.1 time: 0.154202 Aug 30 18:15:17.154842 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3328/6389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:16 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:17.174423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:17.175045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:17.182620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.183547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.183681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.184382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.184846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.185283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.321509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:17.329724 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29b648fe-52dc-4067-9bb3-b8f85d83a803 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1453 microversion: 2.1 time: 0.159071 Aug 30 18:15:17.330334 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3062/6390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:17 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:19.613109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98c3f3c-2f46-4ef0-afc5-21773030464c", "tag": "b31be8ba-3a38-4547-bcd0-c50208219281"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:19.624065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.624540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.625153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.637187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] Creating event network-changed:b31be8ba-3a38-4547-bcd0-c50208219281 for instance f98c3f3c-2f46-4ef0-afc5-21773030464c on n-h1-852771-11 Aug 30 18:15:19.642287 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-02e573d0-ed98-44f8-8baf-5724aab42d30 req-e4092586-1fc8-4072-a93f-201d3e356647 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032936 Aug 30 18:15:19.642885 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3329/6391] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:15.135545 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:17:15.136625 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:17:15.137219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:15.137964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=54 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:15.138870 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:17:15.139010 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c (ip 10.222.0.50) !!! Aug 30 18:17:15.140251 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:17:15.140388 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c (ip 10.222.0.50) !!! Aug 30 18:17:15.209412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:15.209923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:15.216632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.217127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.217575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.218271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.218732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.219167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.245249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:15.326100 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-19ac3f61-8803-40ff-8150-dd3576788f5b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 204 len: 0 microversion: 2.1 time: 0.192240 Aug 30 18:17:15.326692 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3063/6392] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:15 2022] DELETE /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:15.333869 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:17:15.335341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:15.336480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=50 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:15.339053 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:17:15.339402 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c (ip 10.222.0.50) !!! Aug 30 18:17:15.352186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:15.353159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:15.361519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.362001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.362428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.363118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.363594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.364015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.646308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:15.654839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e1427dc6-4b9a-4ff8-83d6-7b6da6f227a2 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1577 microversion: 2.1 time: 0.323692 Aug 30 18:17:15.655435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3330/6393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:15 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1577 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:16.678649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:16.679279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:16.689218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.689709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.690154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.690851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.691312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.691771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.709874 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33052. Aug 30 18:17:16.710585 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33054. Aug 30 18:17:16.963412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:16.971354 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-265b3bca-40d0-4eb9-ab56-99fa62a15930 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1577 microversion: 2.1 time: 0.297613 Aug 30 18:17:16.971968 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3064/6394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:16 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:17.794272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98c3f3c-2f46-4ef0-afc5-21773030464c", "name": "network-vif-deleted", "tag": "b31be8ba-3a38-4547-bcd0-c50208219281"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:17.812702 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33064. Aug 30 18:17:17.818633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.819346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.819894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.834010 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] Creating event network-vif-deleted:b31be8ba-3a38-4547-bcd0-c50208219281 for instance f98c3f3c-2f46-4ef0-afc5-21773030464c on n-h1-852771-11 Aug 30 18:17:17.840540 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c8260be1-e8b1-434c-a3a9-c19cb787173d req-c0f17f57-9c0d-4157-ae2a-75395923019a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049931 Aug 30 18:17:17.841240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3331/6395] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:17:17.994655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.997762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:18.007495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.008011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.008710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.010831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.012263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.012893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.086081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.097044 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7a4ee36b-fa2a-4a61-b170-ce506f3ef5cd tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1226 microversion: 2.1 time: 0.106966 Aug 30 18:17:18.097639 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3065/6396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:19.119873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:19.120469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:19.126632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.127114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.127574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:19.128263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.128714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.129133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:19.193453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:19.202077 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d840b9f-51c3-4b4f-98f5-02a4871fd0ef tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1226 microversion: 2.1 time: 0.087476 Aug 30 18:17:19.203070 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3332/6397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:19 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:20.224087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:20.224750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:20.232782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.233286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.233739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.234457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.234920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.235637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.303896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:20.312034 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4830875b-499d-4099-99e0-e35126c81af3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1226 microversion: 2.1 time: 0.091920 Aug 30 18:17:20.312762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3066/6398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:20 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:21.332954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:21.333493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:21.340860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.341340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.341845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.342535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.342984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.343407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.406171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:21.414370 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b29d6af-e73a-4726-99c7-0b1720b07260 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1226 microversion: 2.1 time: 0.085362 Aug 30 18:17:21.415594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3333/6399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:21 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:22.435772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:22.436388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:22.443842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.444338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.444783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.445514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.445977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.446918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.478639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.479127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.479608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.480058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lazy-loading 'fault' on Instance uuid f98c3f3c-2f46-4ef0-afc5-21773030464c {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:22.523245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.532723 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c60b6ff-d63a-48c5-a24b-96bd476cf153 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 200 len: 1231 microversion: 2.1 time: 0.100809 Aug 30 18:17:22.533321 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3067/6400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:22 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:23.553795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:23.554354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:23.561796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.562280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.562717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.563411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.563887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.564312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.578683 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c HTTP/1.1 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f98c3f3c-2f46-4ef0-afc5-21773030464c'} Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:23.580357 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-678649d2-3afc-4422-a3ef-ea2447a868ca tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 404 len: 111 microversion: 2.1 time: 0.032049 Aug 30 18:17:23.585930 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3334/6401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:23 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:23.630266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2076229898", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927489816", "security_groups": [{"name": "tempest-secgroup-smoke-1299399809"}], "block_device_mapping_v2": [{"uuid": "c8d0e0fc-985a-4b54-ae52-5f708dfa0189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:23.748635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:24.163707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:24.164135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:24.164658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:24.165338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:24.165909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:24.174831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:24.175326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:24.175804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:24.176542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:24.177005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:24.177445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:24.195067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:24.201341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:24.260088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:24.262298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8d0e0fc-985a-4b54-ae52-5f708dfa0189',volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:24.391966 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9821c9cb-ab46-42c0-8a7f-ac98ed803b6d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765465 Aug 30 18:17:24.393097 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3068/6402] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:24.404668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7d31223b-49bf-41cd-92ac-073c4b361b10 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:24.405286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7d31223b-49bf-41cd-92ac-073c4b361b10 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:24.461096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7d31223b-49bf-41cd-92ac-073c4b361b10 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:24.468365 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7d31223b-49bf-41cd-92ac-073c4b361b10 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1095 microversion: 2.1 time: 0.068558 Aug 30 18:17:24.468937 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3335/6403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:24 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:25.494721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d38287c-84fb-474a-8d3e-a32a0e4ddf6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:25.495980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5d38287c-84fb-474a-8d3e-a32a0e4ddf6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:25.550049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5d38287c-84fb-474a-8d3e-a32a0e4ddf6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:25.557595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d38287c-84fb-474a-8d3e-a32a0e4ddf6e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1095 microversion: 2.1 time: 0.072373 Aug 30 18:17:25.558174 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3069/6404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:25 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:26.578643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e396f82-138f-4b30-9db7-f6c11559697a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:26.579219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e396f82-138f-4b30-9db7-f6c11559697a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:26.639854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3e396f82-138f-4b30-9db7-f6c11559697a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:26.647082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e396f82-138f-4b30-9db7-f6c11559697a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1095 microversion: 2.1 time: 0.072692 Aug 30 18:17:26.647981 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3336/6405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:26 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:27.669061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-780acadc-b110-46d3-a385-96aa14ec0ec5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:27.669700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-780acadc-b110-46d3-a385-96aa14ec0ec5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:27.723921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-780acadc-b110-46d3-a385-96aa14ec0ec5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.731442 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-780acadc-b110-46d3-a385-96aa14ec0ec5 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1095 microversion: 2.1 time: 0.066944 Aug 30 18:17:27.732088 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3070/6406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:27 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:28.754491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.755471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:28.763022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.763690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.764680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.765449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.765972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.766597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.833812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:28.843989 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4aee669a-15ab-4575-8031-36152e623a03 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1211 microversion: 2.1 time: 0.094843 Aug 30 18:17:28.845068 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3337/6407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:28 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:29.866166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:29.866790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:29.874580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.875273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.876203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.876913 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.877427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.877866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.112847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:30.123750 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a071d495-1cc5-429f-8ed2-314a60a5125f tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1279 microversion: 2.1 time: 0.261189 Aug 30 18:17:30.124658 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3071/6408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:29 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:30.207341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1", "tag": "00552923-f1cf-499c-bcd6-ea6b619df988"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:30.218483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.218966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.219410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.231509 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] Creating event network-changed:00552923-f1cf-499c-bcd6-ea6b619df988 for instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 on n-h2-852771-11 Aug 30 18:17:30.237124 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-caa44f25-5de1-43c5-9eff-80edbbd25a0e req-a875c99f-3b7d-4de6-bd92-aa08c02bcc60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Aug 30 18:17:30.237738 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3338/6409] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:31.146972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:31.147573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.155859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.156359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.156813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.157523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.157985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.158421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.315617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:31.324808 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fdd46e8-3006-4b0a-94ac-0bc55e5b1b85 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1279 microversion: 2.1 time: 0.181777 Aug 30 18:17:31.325392 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3072/6410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:31 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:32.348116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.348816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.355183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.355708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.356145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.356831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.357280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.357700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.499896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.507689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8fa0dbcc-e20a-403b-b6cc-64ffbab0d008 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1279 microversion: 2.1 time: 0.164827 Aug 30 18:17:32.508295 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3339/6411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:32 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:33.530286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:33.530990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:33.537848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.538392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.538783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.539501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.539970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.540400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.676338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:33.684708 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8695729b-0c83-4853-98aa-4dc7f8e59ee3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1279 microversion: 2.1 time: 0.158924 Aug 30 18:17:33.685284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3073/6412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:33 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:34.706532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:34.707524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:34.714952 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.715445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.715929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.716636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.717122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.717544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.859901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:34.868580 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fca5b431-3b2c-4fb3-9e27-3daeaa4698f7 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.165303 Aug 30 18:17:34.869324 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3340/6413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:34 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:35.890295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:35.890860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:35.892725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:35.899147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:35.900221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:35.900674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:35.901387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:35.901854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:35.902302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.031382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:36.039187 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e16eb9c0-543b-4510-a8a0-7dcd1cf2430d tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.152892 Aug 30 18:17:36.039804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3074/6414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:35 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:37.060013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:37.060642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:37.063118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=4 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:37.068736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:37.069253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:37.069696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:37.070395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:37.070856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:37.071805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:37.203214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:37.211057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-387af516-2eb1-4c32-96a5-5bdf074c0624 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.155145 Aug 30 18:17:37.211711 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3341/6415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:37 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:38.233435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:38.234059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:38.237010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:38.242693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.243198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.243677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.244383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.244847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.245286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.374264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:38.381968 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c1635d1a-fa4e-4e81-b719-3f366dd2c1aa tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.152477 Aug 30 18:17:38.382544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3075/6416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:38 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:39.402466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:39.403084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:39.410194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.410675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.411105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.411824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.412272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.412692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.547463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:39.555171 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-320ad8ca-499a-47ee-9204-4fc81cba5a05 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.156933 Aug 30 18:17:39.556412 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3342/6417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:39 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:40.576718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.577261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:40.584188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.584685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.585133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.585869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.586332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.587534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.733856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:40.741979 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-862cadb2-a380-4e15-885d-84ee0086cf5a tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.169253 Aug 30 18:17:40.742565 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3076/6418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:41.762916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:41.763564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:41.770349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.770834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.771270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.771990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.772455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.772885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.901914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:41.909576 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82bcc4c7-37b5-4ec8-ab15-7c6df4d88e4b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.150836 Aug 30 18:17:41.910157 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3343/6419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:41 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:42.930570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:42.931775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:42.938871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:42.939367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:42.939844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:42.940548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:42.941011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:42.941447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:43.075082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:43.083036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5991d512-918d-4b6d-861b-7c41df52fd16 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.156374 Aug 30 18:17:43.083667 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3077/6420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:42 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:44.103993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:44.104613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:44.111796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:44.112283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:44.112722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:44.113413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:44.113865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:44.114314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:44.248141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:44.255940 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5a5dc98-d4c7-4aae-acfa-b484f3575c75 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.155940 Aug 30 18:17:44.256520 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3344/6421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:44 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:45.237817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1", "name": "network-vif-plugged", "status": "completed", "tag": "00552923-f1cf-499c-bcd6-ea6b619df988"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:45.243705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:45.249891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.250383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.250836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.254955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:45.263872 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] Creating event network-vif-plugged:00552923-f1cf-499c-bcd6-ea6b619df988 for instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 on n-h2-852771-11 Aug 30 18:17:45.269282 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-229dcac6-83c5-40b0-9f8e-44e3cfcc92a2 req-0f5ebc73-2137-4846-b67f-825cda2eadff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 Aug 30 18:17:45.269896 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3078/6422] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:45.277786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:45.278424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:45.286091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.286837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.287273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.288002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.288455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.289145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.431585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:45.433923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=71 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:45.440609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c81592bc-d219-48f6-b10d-9187a1bc4528 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1267 microversion: 2.1 time: 0.167306 Aug 30 18:17:45.441525 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3345/6423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:45 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:46.464012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:46.464732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:46.472674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.473168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.473619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.474355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.474817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.475253 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.607314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:46.615455 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-68f9440a-6ea5-4443-97b8-c5f0d2699172 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1454 microversion: 2.1 time: 0.156906 Aug 30 18:17:46.616061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3079/6424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:46 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:46.636183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:46.636796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:46.639428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=37 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:46.644784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.645264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.645692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.646376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.646821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.647239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.776117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:46.783755 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa07aba2-0236-422e-93ea-7d462d968e09 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1454 microversion: 2.1 time: 0.151991 Aug 30 18:17:46.784325 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3346/6425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:46 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:48.752105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1", "tag": "00552923-f1cf-499c-bcd6-ea6b619df988"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:48.761952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:48.762440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:48.762880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.773731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] Creating event network-changed:00552923-f1cf-499c-bcd6-ea6b619df988 for instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 on n-h2-852771-11 Aug 30 18:17:48.780660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-49f4f152-a36e-42d2-8538-ce2032c43731 req-72940110-3e96-47af-912c-dc411e814b6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032790 Aug 30 18:17:48.781264 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3080/6426] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:38.549293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:38.550044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:38.554414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2102168725", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927489816", "security_groups": [{"name": "tempest-secgroup-smoke-1299399809"}], "block_device_mapping_v2": [{"uuid": "594a8db6-8bb4-4af2-9793-9dbc5d90ec3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a505cb6a-6528-4f59-9e4a-ebb04c5030ee"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:38.666703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] validate_networks() for [('a505cb6a-6528-4f59-9e4a-ebb04c5030ee', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:39.077857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:19:39.078850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:19:39.079358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:19:39.079804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:19:39.080218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:19:39.089205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.089688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.090156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.091008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.091464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.091913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.110316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:39.115873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Getting quotas for user aa12b3c3be294ffcb966ef4ff5c99e8f and project 4a197b92d746401a83f6d1c3942673a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:39.174423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:19:39.176695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='594a8db6-8bb4-4af2-9793-9dbc5d90ec3b',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:19:39.301365 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [c3bc900b-d1e4-46e5-87b5-9c6e2a7c96b9] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:19:40.310164 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [c3bc900b-d1e4-46e5-87b5-9c6e2a7c96b9] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33258. Aug 30 18:19:40.314324 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-702c5d29-e4b8-4248-a2a2-0bf4bf2e6ecc tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.767501 Aug 30 18:19:40.314987 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3347/6427] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:19:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:19:40.325723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:40.326478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:40.334924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf598bb7-73e1-4dfb-a9ba-5623d0304bda tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:40.335687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf598bb7-73e1-4dfb-a9ba-5623d0304bda tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.393441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf598bb7-73e1-4dfb-a9ba-5623d0304bda tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.400990 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf598bb7-73e1-4dfb-a9ba-5623d0304bda tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1095 microversion: 2.1 time: 0.078694 Aug 30 18:19:40.402423 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3081/6428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:40 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:41.425569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:41.426225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:41.432378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.433080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.433519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.434275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.434788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.435211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.506120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:41.515188 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5f04998e-77e1-4748-9671-103e10904b1b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1211 microversion: 2.1 time: 0.095720 Aug 30 18:19:41.527512 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3348/6429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:42.541262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:42.544187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:42.556268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.556771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.557415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.558320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.559165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.559941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.068212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:43.076188 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87655780-f979-4684-9ae4-3c7e775e9d42 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1279 microversion: 2.1 time: 0.541679 Aug 30 18:19:43.076929 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3082/6430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:42 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1279 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:43.226440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0f8ebe-8834-44da-9b97-cde1d0dea21c", "tag": "9c3ec1e7-8085-440f-9a7c-60416ef2875b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:43.237337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.237814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.238535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.251658 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] Creating event network-changed:9c3ec1e7-8085-440f-9a7c-60416ef2875b for instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c on n-h1-852771-11 Aug 30 18:19:43.257030 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6b105cfa-cc26-4f59-ab50-1b1fc75ea077 req-d2c46fcc-ab07-4807-8634-c28ed56e54be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117747 Aug 30 18:19:43.259633 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3349/6431] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:44.098009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:44.098638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:44.106310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.106801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.107334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.108092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.108552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.108983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.241967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:44.249895 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e29fa1a9-f874-4d15-8831-04dbc47c2e58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1279 microversion: 2.1 time: 0.156565 Aug 30 18:19:44.250473 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3083/6432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:44 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:45.272509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:45.273220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:45.281015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.281507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.281942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.282661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.283113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.283566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.420001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.434873 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-886960d3-cec7-46d8-8348-4075723856ac tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1279 microversion: 2.1 time: 0.166918 Aug 30 18:19:45.435490 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3350/6433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:45 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:46.459347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:46.460592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:46.464554 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:19:46.464768 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:19:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c (ip 10.222.0.50) !!! Aug 30 18:19:46.482251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.483098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.483812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.484972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.485611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.486425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.638434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:46.649636 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40ebfb5d-e723-4fbe-8583-a151d308ddfe tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.196599 Aug 30 18:19:46.650408 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3084/6434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:46 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:47.672867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:47.674073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:47.681542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.682071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.682569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:47.683268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.683749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.684205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:47.823022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:47.831812 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44590fbc-1007-4c6e-a882-5ddbbb041479 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.163069 Aug 30 18:19:47.832474 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3351/6435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:47 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:48.853832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:48.854649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:48.861463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.861950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.862395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.863088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.863839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.864271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.003136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:49.012003 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7c48b00-fef1-4d3e-9273-f8e02176161c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.162254 Aug 30 18:19:49.012604 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3085/6436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:48 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:50.035184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:50.035839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:50.038630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:50.039411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:50.045333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.045820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.046259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.046953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.047407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.047901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.186620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:50.194368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c03c39b-556d-4ca0-b66c-db4a6856e193 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.164329 Aug 30 18:19:50.194952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3352/6437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:50 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:51.216285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:51.216935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:51.219693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:51.226298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.226791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.227239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.227963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.228466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.228904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.360181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:51.369340 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bfc1fe32-8952-4045-bd49-02e0b9cf6d39 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.156998 Aug 30 18:19:51.369923 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3086/6438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:51 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:52.389867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:52.390434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:52.397252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.397732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.398165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.398847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.399296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.399739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.534123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:52.542048 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb115a55-13d2-4973-bca8-5e136491da33 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.156202 Aug 30 18:19:52.542626 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3353/6439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:52 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:53.565005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:53.565574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:53.572518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:53.573018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:53.573470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:53.574164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:53.574628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:53.575066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:53.710755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:53.718525 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5387d50e-a511-4da6-a089-a82457f3564c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.158689 Aug 30 18:19:53.719099 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3087/6440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:53 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:54.739935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:54.740585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:54.747838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:54.748333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:54.748777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:54.749481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:54.749942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:54.750371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:54.888551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:54.896846 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-49dc9ff2-9a1d-4f58-b0ed-b1ab301d7e00 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.161958 Aug 30 18:19:54.897426 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3354/6441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:54 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:55.917282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:55.917894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:55.925661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:55.926150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:55.926593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:55.927291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:55.927782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:55.928218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.056426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:56.064162 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bada5dee-ad67-440b-b180-4a4e8470a6db tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.150791 Aug 30 18:19:56.064745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3088/6442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:55 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:56.781183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0f8ebe-8834-44da-9b97-cde1d0dea21c", "name": "network-vif-plugged", "status": "completed", "tag": "9c3ec1e7-8085-440f-9a7c-60416ef2875b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:56.790715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.791146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.791663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.803592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] Creating event network-vif-plugged:9c3ec1e7-8085-440f-9a7c-60416ef2875b for instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c on n-h1-852771-11 Aug 30 18:19:56.808506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-38470a48-5153-414d-b9cf-a719ce7440e9 req-c849d033-c895-450a-9181-2558e3f65642 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092609 Aug 30 18:19:56.809094 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3355/6443] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:57.084698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:57.085316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:57.092479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:57.092983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:57.093440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:57.094185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:57.094708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:57.095360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:57.227342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:57.235181 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9567dddd-fc71-4120-bbd1-f77aa3b59644 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1267 microversion: 2.1 time: 0.154426 Aug 30 18:19:57.236546 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3089/6444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:57 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:58.259082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.259815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.266358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.266900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.267338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.268055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.268501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.268923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.402318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:58.410501 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf51dc39-6a0a-4847-9599-038065cefb58 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1453 microversion: 2.1 time: 0.156606 Aug 30 18:19:58.411092 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3356/6445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:58 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:58.431419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.432089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.439535 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.440285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.440740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.441456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.441923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.442368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.572159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:58.580372 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06dc90c4-2e50-4b01-93a6-a9abc866d797 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1453 microversion: 2.1 time: 0.152809 Aug 30 18:19:58.580946 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3090/6446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:58 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:00.201892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0f8ebe-8834-44da-9b97-cde1d0dea21c", "tag": "9c3ec1e7-8085-440f-9a7c-60416ef2875b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:00.212484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:00.212970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:00.213428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:00.225126 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] Creating event network-changed:9c3ec1e7-8085-440f-9a7c-60416ef2875b for instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c on n-h1-852771-11 Aug 30 18:20:00.230222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-75885f58-39cc-4d22-b75b-ee02178842c9 req-14fc7e6a-15fb-4c37-af7f-5bf5ea9baaf0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Aug 30 18:20:00.231060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3357/6447] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:30.616369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:30.617195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=54 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:30.621979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:30.622518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:30.622896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=50 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:30.623184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:30.627754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0f8ebe-8834-44da-9b97-cde1d0dea21c", "tag": "9c3ec1e7-8085-440f-9a7c-60416ef2875b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:30.631742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.632226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.632667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.633578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.634041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.634473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.639274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.639772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.640407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.653398 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] Creating event network-changed:9c3ec1e7-8085-440f-9a7c-60416ef2875b for instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c on n-h1-852771-11 Aug 30 18:21:30.659651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-79365bab-6ad2-466d-a13f-3923d6826ae5 req-1bad9ea8-fa19-4f43-a85d-d0e67ba8f358 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040698 Aug 30 18:21:30.660454 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3358/6448] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:30.663093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:30.732993 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [512316ed-47c9-46c9-94d4-a679bcd11866] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:21:31.742014 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [512316ed-47c9-46c9-94d4-a679bcd11866] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33358. Aug 30 18:21:31.762353 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f7745059-371f-42dd-a099-9b1a268681c0 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 204 len: 0 microversion: 2.1 time: 1.148910 Aug 30 18:21:31.762976 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3091/6449] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:30 2022] DELETE /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:31.774520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:31.775264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:31.781632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.782056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.782490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.783180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.783683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.784107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.921318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:31.929390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd2bdeb6-497b-414e-84fe-3dd23a58ad55 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1459 microversion: 2.1 time: 0.161115 Aug 30 18:21:31.929991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3359/6450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:31 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:32.950955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:32.951771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:32.959641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:32.960139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:32.960584 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:32.961278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:32.961737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:32.962170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.095359 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:33.104292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ebf9596c-e6e9-4703-9901-3be2c2584dbf tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1459 microversion: 2.1 time: 0.157626 Aug 30 18:21:33.104875 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3092/6451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:32 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:33.692516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0f8ebe-8834-44da-9b97-cde1d0dea21c", "name": "network-vif-deleted", "tag": "9c3ec1e7-8085-440f-9a7c-60416ef2875b"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:33.704027 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.704507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.704947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.717045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] Creating event network-vif-deleted:9c3ec1e7-8085-440f-9a7c-60416ef2875b for instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c on n-h1-852771-11 Aug 30 18:21:33.721833 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-039c8ea3-423d-405b-bb01-c6f3a4d28364 req-390d1eb3-2a62-4f5f-b5ab-6300be0f9051 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Aug 30 18:21:33.722533 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3360/6452] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:34.126377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:34.126999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:34.134076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:34.134570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:34.135015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:34.135737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:34.136198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:34.136630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:34.199035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:34.207025 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-db6ff592-2bac-4dba-ad65-9a087108ece1 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1226 microversion: 2.1 time: 0.084650 Aug 30 18:21:34.207579 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3093/6453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:34 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:35.230091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:35.230800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:35.237167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.237658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.238101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.238803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.239262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.240503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.305332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.313860 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de605376-5448-4847-99e9-e56bf4bc735b tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1226 microversion: 2.1 time: 0.088867 Aug 30 18:21:35.314463 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3361/6454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:35 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:36.335008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:36.335665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:36.342814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.343314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.343797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.344503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.344971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.345407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.411793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:36.420013 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0927ef59-b6d6-4d3f-98d9-35994cb7e3ce tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1226 microversion: 2.1 time: 0.089620 Aug 30 18:21:36.420596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3094/6455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:36 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:37.441295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:37.441897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:37.448788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.449270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.449702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.450388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.450837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.451258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.514812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.523290 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73b7c21d-11cb-4549-9aef-0b6ac691e645 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 200 len: 1226 microversion: 2.1 time: 0.085910 Aug 30 18:21:37.523912 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3362/6456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:37 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:38.544045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.544672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: 8c0f8ebe-8834-44da-9b97-cde1d0dea21c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:38.551867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.552974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.553422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.554116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.554580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.555014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.568373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c HTTP/1.1 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '8c0f8ebe-8834-44da-9b97-cde1d0dea21c'} Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:38.570425 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance 8c0f8ebe-8834-44da-9b97-cde1d0dea21c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a711b7ef-97eb-4f62-8491-4c4759c15ad3 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c" status: 404 len: 111 microversion: 2.1 time: 0.031667 Aug 30 18:21:38.576072 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3095/6457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/servers/8c0f8ebe-8834-44da-9b97-cde1d0dea21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:44.793663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:44.794193 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:44.796333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1", "tag": "00552923-f1cf-499c-bcd6-ea6b619df988"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:44.801535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.802443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.803218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.804018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.804596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.805254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.807701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.808706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.809291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.821373 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] Creating event network-changed:00552923-f1cf-499c-bcd6-ea6b619df988 for instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 on n-h2-852771-11 Aug 30 18:21:44.826640 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b5904cd7-bb99-4a8f-b754-bc33b3d3795e req-d1f18594-ad4e-440c-a66f-2ec12b7e254b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034759 Aug 30 18:21:44.827713 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3096/6458] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:44.831773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:44.928365 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8253794f-13c6-47f5-b369-55c459a94afb tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 204 len: 0 microversion: 2.1 time: 0.138530 Aug 30 18:21:44.929619 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3363/6459] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:44 2022] DELETE /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:44.938011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:44.938920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:44.945619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.946222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.946935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.947793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.948494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.949134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.108331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.116621 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-928746e5-8186-4080-a9e3-a95763c5f00c tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1579 microversion: 2.1 time: 0.182799 Aug 30 18:21:45.117200 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3097/6460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:44 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:46.138231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:46.138975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:46.146609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.147140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.147608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.148309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.148767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.149200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.283436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.291541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c239bf6-32d2-417e-9074-99230fb5bad9 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1579 microversion: 2.1 time: 0.157588 Aug 30 18:21:46.292126 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3364/6461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:46 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:47.173884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1", "name": "network-vif-deleted", "tag": "00552923-f1cf-499c-bcd6-ea6b619df988"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:47.184404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.184897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.185341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.198041 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] Creating event network-vif-deleted:00552923-f1cf-499c-bcd6-ea6b619df988 for instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 on n-h2-852771-11 Aug 30 18:21:47.203367 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-700ccd1f-440a-4bfc-aa22-c54f8fec4b86 req-44b31633-f965-4298-921a-0a5974aaa112 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032934 Aug 30 18:21:47.204142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3098/6462] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:47.313145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:47.313770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:47.321400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.321881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.322561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.323254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.323737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.324170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.392062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:47.400720 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-23bfef19-3321-46ea-915f-d3b4f1651569 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1226 microversion: 2.1 time: 0.091550 Aug 30 18:21:47.401317 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3365/6463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:47 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:48.423058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:48.423832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:48.430731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.431226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.431705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.432410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.432876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.433317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.498897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.507680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07221524-df1f-41a6-9310-a5caaa81f490 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1226 microversion: 2.1 time: 0.089728 Aug 30 18:21:48.508282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3099/6464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:48 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:49.528415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:49.528997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:49.536019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.537151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.537775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.538495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.538958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.539387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.604200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:49.612113 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f5454b30-1788-4c14-953e-565c1c79541e tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1226 microversion: 2.1 time: 0.087810 Aug 30 18:21:49.612693 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3366/6465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:49 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:50.633394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:50.633925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:50.640799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.641309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.641754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.642456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.642914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.643344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.709703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa12b3c3be294ffcb966ef4ff5c99e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a197b92d746401a83f6d1c3942673a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.717546 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff6f425d-c8ea-45c3-b4d0-8c5ff22ce9ed tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 200 len: 1226 microversion: 2.1 time: 0.088333 Aug 30 18:21:50.718127 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3100/6466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:50 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:51.738172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:51.738788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:51.746367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.746850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.747286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.748001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.748456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.748909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.762786 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 HTTP/1.1 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1'} Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:51.764438 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-08e213a9-6892-4a58-a251-0295d52d7515 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1" status: 404 len: 111 microversion: 2.1 time: 0.031595 Aug 30 18:21:51.769435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3367/6467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:51 2022] GET /compute/v2.1/servers/cdf1d369-3e3a-44c5-a26e-6ae12d05d9b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:52.218557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:52.219117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:52.226995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.227516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.227963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.228672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.229136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.229573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.244088 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c HTTP/1.1 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'f98c3f3c-2f46-4ef0-afc5-21773030464c'} Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:52.245746 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4bd82dc7-a4c5-444d-8160-8c8a7464a964 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 404 len: 111 microversion: 2.1 time: 0.032555 Aug 30 18:21:52.250901 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3101/6468] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:52 2022] DELETE /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:52.255764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:52.256480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] [instance: f98c3f3c-2f46-4ef0-afc5-21773030464c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:52.262846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.263345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.263818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.264529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.265207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.265404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.279852 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] HTTP exception thrown: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Request method failure captured: Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c HTTP/1.1 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlK1-Hz9sng3ii_4UpTCTPKfc7RF-Jxa7165rocKOqHIJarsdcpjqmTL0E9UWTlecYNqQNdIx_-9rWB9eEguLCV_0p25nIEhcx1x5ZQUbbKN8soyEVabxq-5dxLq7cG1hiHnxBRPq3xxI6U4r6WGB0ZYpEp2mq2KNWTTLPambxTcx_k Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a197b92d746401a83f6d1c3942673a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a197b92d746401a83f6d1c3942673a8"}]}] Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 4a197b92d746401a83f6d1c3942673a8 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestVolumeBootPattern-2037815997 Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: aa12b3c3be294ffcb966ef4ff5c99e8f Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestVolumeBootPattern-2037815997-project Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'f98c3f3c-2f46-4ef0-afc5-21773030464c'} Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:52.281430 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Returning 404 to user: Instance f98c3f3c-2f46-4ef0-afc5-21773030464c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a8dd063-8829-4a59-aaad-662ca50fa304 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c" status: 404 len: 111 microversion: 2.1 time: 0.030965 Aug 30 18:21:52.286594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3368/6469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:52 2022] GET /compute/v2.1/servers/f98c3f3c-2f46-4ef0-afc5-21773030464c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:55.704824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66a91ecc-daf5-4a24-97ae-5b23b44a0133 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] Calling method '.version_select at 0x7f2d936b88b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:55.760984 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66a91ecc-daf5-4a24-97ae-5b23b44a0133 tempest-TestVolumeBootPattern-2037815997 tempest-TestVolumeBootPattern-2037815997-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927489816" status: 202 len: 0 microversion: 2.1 time: 0.060610 Aug 30 18:21:55.762903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3102/6470] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 18:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927489816 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:13.320686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:13.321428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:13.444658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1373809193", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:13.499210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] validate_networks() for None {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:22:13.769487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:22:13.769906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:22:13.770420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:22:13.771157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:22:13.772164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:22:13.781041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.781520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.781950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.782677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.783125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.783574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.800189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Getting quotas for project ac6eddd4fda3408ba93d149af033cb87. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:13.805444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Getting quotas for user 2dc4c7979dc94e3baf61f7525df2923b and project ac6eddd4fda3408ba93d149af033cb87. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:13.817809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:22:13.820744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:22:13.864828 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ff21edf-6759-4a0d-aa70-746a02575065 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550503 Aug 30 18:22:13.866251 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3369/6471] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:22:13.876734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:13.877772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:13.886626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f08489a1-5a7e-4577-8c42-fcae76f79da5 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:13.887027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f08489a1-5a7e-4577-8c42-fcae76f79da5 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:13.946530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f08489a1-5a7e-4577-8c42-fcae76f79da5 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:13.953605 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f08489a1-5a7e-4577-8c42-fcae76f79da5 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1222 microversion: 2.1 time: 0.079080 Aug 30 18:22:13.954174 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3103/6472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:13 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:14.976782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.977401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:14.984765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.985263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.985706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.986420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.986873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.987299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:15.054545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:15.062747 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a2bab411-8893-4551-8a81-7f07488eef09 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1280 microversion: 2.1 time: 0.092204 Aug 30 18:22:15.063342 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3370/6473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:14 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:16.085666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:16.086325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:16.094314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:16.095060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:16.095705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:16.096618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:16.097150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:16.097799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:16.360819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:16.369762 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9501906a-eb6e-4c68-81c7-af51dc14d82c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.288627 Aug 30 18:22:16.370444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3104/6474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:16 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:16.683829 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:22:16.684472 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 30 18:22:16.690425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728dd4af-adb7-4579-8d3d-ea79b4ec5b1a", "tag": "e7538ba3-1b1c-4012-b51d-8cbf9c94cccc"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:16.702293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:16.703055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:16.703512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:16.715762 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] Creating event network-changed:e7538ba3-1b1c-4012-b51d-8cbf9c94cccc for instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a on n-h2-852771-11 Aug 30 18:22:16.720825 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b0e1efbf-7aab-44ef-98fc-0e780c9a3ca2 req-9c360544-2bb0-4e12-a2ce-71af3ac14fa3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037882 Aug 30 18:22:16.721699 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3371/6475] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:17.391151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:17.391792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:17.394148 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:22:17.394281 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:22:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a (ip 10.222.0.50) !!! Aug 30 18:22:17.401418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:17.401919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:17.402394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:17.403186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:17.403684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:17.404131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:17.639448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:17.647957 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a4eeeb60-4354-4c0e-8c2a-f5fd0d20ddc0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.260892 Aug 30 18:22:17.648533 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3105/6476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:17 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:18.670431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:18.671141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:18.677467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:18.678171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:18.678627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:18.679325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:18.679890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:18.680325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:18.872508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:18.880208 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5337d49c-9200-4b8f-afac-fa1d66dcd580 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.214949 Aug 30 18:22:18.881276 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3372/6477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:18 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:19.902111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:19.902734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:19.909607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:19.910100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:19.910547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:19.911252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:19.911780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:19.912791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:20.042390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:20.050103 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-290dc9c0-b2ea-4330-8d96-59018337e240 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.151922 Aug 30 18:22:20.050680 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3106/6478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:19 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:21.070491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:21.071052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:21.077835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:21.078315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:21.078750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:21.079435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:21.079910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:21.080332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:21.211986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:21.220012 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bc21cd76-fc5c-455f-9b76-1f7a2d834b1d tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.153676 Aug 30 18:22:21.220616 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3373/6479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:21 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:22.241447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:22.242046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:22.248928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:22.249415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:22.249856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:22.250544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:22.251001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:22.251429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:22.387591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:22.395257 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65826c90-6463-4021-baa4-2b0a85f02bba tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.158438 Aug 30 18:22:22.395866 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3107/6480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:22 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:22.623278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728dd4af-adb7-4579-8d3d-ea79b4ec5b1a", "name": "network-vif-plugged", "status": "completed", "tag": "e7538ba3-1b1c-4012-b51d-8cbf9c94cccc"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:22.635755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:22.636240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:22.636674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:22.647716 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] Creating event network-vif-plugged:e7538ba3-1b1c-4012-b51d-8cbf9c94cccc for instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a on n-h2-852771-11 Aug 30 18:22:22.652777 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f945649e-3f05-4a3e-8d62-97897b69c20c req-c8dfe88e-be0a-4ba5-b6bb-b4216dfd4d58 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Aug 30 18:22:22.653567 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3374/6481] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:23.415603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:23.416238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:23.423014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:23.423528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:23.423980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:23.424672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:23.425131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:23.425560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:23.558434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:23.566262 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-47219985-9720-43c7-881e-960f647d2d9b tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1322 microversion: 2.1 time: 0.154581 Aug 30 18:22:23.566834 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3108/6482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:23 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:24.586794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:24.587516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:24.590407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:24.591068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:24.597576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:24.598053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:24.598486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:24.599308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:24.599841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:24.600268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:24.728319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:24.736287 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eccb98ba-79ac-4795-bd4c-aeb3e26c9261 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1472 microversion: 2.1 time: 0.153864 Aug 30 18:22:24.736870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3375/6483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:24 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:24.761041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:24.813809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a29b123-9052-423b-b7be-078d3c5140d7 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '.version_select at 0x7f2d936a3af0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:24.885835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a29b123-9052-423b-b7be-078d3c5140d7 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a3bcfbe11f4841618889ed444ecb8416" status: 200 len: 371 microversion: 2.1 time: 0.129203 Aug 30 18:22:24.886819 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3109/6484] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 18:22:24 2022] GET /compute/v2.1/os-quota-sets/a3bcfbe11f4841618889ed444ecb8416 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:24.898608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f27093b4-5a5e-4e00-a014-ba96fdcc0df5 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2117420099", "id": 1041436623, "os-flavor-access:is_public": "True"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:24.916902 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f27093b4-5a5e-4e00-a014-ba96fdcc0df5 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022467 Aug 30 18:22:24.917483 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3376/6485] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:24 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:24.929507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1041436623"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:24.931834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:24.937861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:24.938388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:24.938816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:24.939530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:24.939992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:24.940422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.078639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8895fbd5880a42e0ab558dc0461476fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bcfbe11f4841618889ed444ecb8416', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:25.085395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2117420099 {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:22:25.091968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.092453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.092891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.093614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.094065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.094493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.115380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Getting quotas for project ac6eddd4fda3408ba93d149af033cb87. Resources: {'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:25.120413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Getting quotas for user 2dc4c7979dc94e3baf61f7525df2923b and project ac6eddd4fda3408ba93d149af033cb87. Resources: {'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:25.132221 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.compute.api [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] ram quota exceeded for a3bcfbe11f4841618889ed444ecb8416, tried to resize instance. Aug 30 18:22:25.132757 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Request method failure captured: Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action HTTP/1.1 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 39 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlVVMajw6qqu6zNpsjkLe1nWOdlh-za0O2ffAJ8IpbjotpWwzenG5I7GNMTI05FcbysvRZz8pDauxxFMuf4I1a3mkAqieAIMhxENEBnAb_KsSZqcy_X0vTlnbmEnGz-Fk_7hPKs4RCRHkOVUHZxqkwoGjZ4OfFtPJJGF4-gD6Qzsuo8 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: a3bcfbe11f4841618889ed444ecb8416 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Role: admin,reader,member Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: admin,reader,member Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3bcfbe11f4841618889ed444ecb8416"}]}] Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: a3bcfbe11f4841618889ed444ecb8416 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-406888474-project-admin Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 8895fbd5880a42e0ab558dc0461476fd Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-406888474-project-admin Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: {"resize": {"flavorRef": "1041436623"}} Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '728dd4af-adb7-4579-8d3d-ea79b4ec5b1a', 'body': {'resize': {'flavorRef': '1041436623'}}} Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.134699 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff2bb070-cf90-4b95-9cc4-627e172223ce tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action" status: 403 len: 118 microversion: 2.1 time: 0.211045 Aug 30 18:22:25.138346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3110/6486] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:24 2022] POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action => generated 118 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:22:25.144923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-161bde4d-865b-4c3b-97f9-57bd33412b14 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.162679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-161bde4d-865b-4c3b-97f9-57bd33412b14 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1041436623" status: 202 len: 0 microversion: 2.1 time: 0.021441 Aug 30 18:22:25.163221 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3377/6487] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 18:22:25 2022] DELETE /compute/v2.1/flavors/1041436623 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:25.170854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2b8de3d-2ce4-46f6-8a6b-26bcbc0873de tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.191368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2b8de3d-2ce4-46f6-8a6b-26bcbc0873de tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024032 Aug 30 18:22:25.191958 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3111/6488] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 18:22:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:25.212261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad3eb054-3d2c-4131-9041-0ea81970f91a tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '.version_select at 0x7f2d93670430>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.284390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad3eb054-3d2c-4131-9041-0ea81970f91a tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a3bcfbe11f4841618889ed444ecb8416" status: 200 len: 371 microversion: 2.1 time: 0.076417 Aug 30 18:22:25.284975 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3378/6489] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 30 18:22:25 2022] GET /compute/v2.1/os-quota-sets/a3bcfbe11f4841618889ed444ecb8416 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:25.296150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32eabaac-1756-4be4-99eb-29b2ecd5a1e8 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1640932711", "id": 1074468335, "os-flavor-access:is_public": "True"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:25.315998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32eabaac-1756-4be4-99eb-29b2ecd5a1e8 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023591 Aug 30 18:22:25.316618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3112/6490] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:25 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:25.329045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1074468335"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:25.331322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:25.337548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.338031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.338466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.339161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.339649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.340082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.426488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8895fbd5880a42e0ab558dc0461476fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bcfbe11f4841618889ed444ecb8416', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:25.433577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1640932711 {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:22:25.442305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.443441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.443981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.444716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.445172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.445625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.472263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Getting quotas for project ac6eddd4fda3408ba93d149af033cb87. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:25.477497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Getting quotas for user 2dc4c7979dc94e3baf61f7525df2923b and project ac6eddd4fda3408ba93d149af033cb87. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:25.493914 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.compute.api [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] cores quota exceeded for a3bcfbe11f4841618889ed444ecb8416, tried to resize instance. Aug 30 18:22:25.494571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Request method failure captured: Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action HTTP/1.1 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 39 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlVVMajw6qqu6zNpsjkLe1nWOdlh-za0O2ffAJ8IpbjotpWwzenG5I7GNMTI05FcbysvRZz8pDauxxFMuf4I1a3mkAqieAIMhxENEBnAb_KsSZqcy_X0vTlnbmEnGz-Fk_7hPKs4RCRHkOVUHZxqkwoGjZ4OfFtPJJGF4-gD6Qzsuo8 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: a3bcfbe11f4841618889ed444ecb8416 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Role: admin,reader,member Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: admin,reader,member Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3bcfbe11f4841618889ed444ecb8416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3bcfbe11f4841618889ed444ecb8416"}]}] Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: a3bcfbe11f4841618889ed444ecb8416 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-406888474 Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersAdminNegativeTestJSON-406888474-project-admin Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 8895fbd5880a42e0ab558dc0461476fd Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-406888474-project-admin Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: {"resize": {"flavorRef": "1074468335"}} Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '728dd4af-adb7-4579-8d3d-ea79b4ec5b1a', 'body': {'resize': {'flavorRef': '1074468335'}}} Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.496979 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a300dab-f4e7-48a1-98da-2c0f7f1c9daf tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action" status: 403 len: 113 microversion: 2.1 time: 0.173452 Aug 30 18:22:25.500167 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3379/6491] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:25 2022] POST /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a/action => generated 113 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:22:25.508057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-218c36c5-e595-4784-aae5-010a5f697951 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.525313 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-218c36c5-e595-4784-aae5-010a5f697951 tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1074468335" status: 202 len: 0 microversion: 2.1 time: 0.021954 Aug 30 18:22:25.525907 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3113/6492] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 30 18:22:25 2022] DELETE /compute/v2.1/flavors/1074468335 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:25.533658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9891852-e588-4df8-8933-2f089b5c6efa tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.554320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9891852-e588-4df8-8933-2f089b5c6efa tempest-ServersAdminNegativeTestJSON-406888474 tempest-ServersAdminNegativeTestJSON-406888474-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024291 Aug 30 18:22:25.554872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3380/6493] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 30 18:22:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:25.574021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.574528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:25.580694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.581133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.581580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.582287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.582752 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.583194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.608822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:22:25.686860 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd08fbe5-8a6a-40bc-99b8-eaf8305d14f0 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "DELETE /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 204 len: 0 microversion: 2.1 time: 0.116310 Aug 30 18:22:25.687470 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3114/6494] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:22:25 2022] DELETE /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:22:25.696766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.697375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:25.704428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.704904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.705336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.706016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:25.706459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:25.706878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:25.841069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:25.848916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-786135df-7a86-4e4d-a9b9-988dc4a5ce4a tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1478 microversion: 2.1 time: 0.156648 Aug 30 18:22:25.849765 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3381/6495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:25 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:26.871066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:26.881493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:26.881984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:27.105096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc4c7979dc94e3baf61f7525df2923b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6eddd4fda3408ba93d149af033cb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:27.113103 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-681f0356-a02f-4e53-bc82-730d3c605471 tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 200 len: 1478 microversion: 2.1 time: 0.246499 Aug 30 18:22:27.127395 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3115/6496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:26 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:27.450858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728dd4af-adb7-4579-8d3d-ea79b4ec5b1a", "name": "network-vif-deleted", "tag": "e7538ba3-1b1c-4012-b51d-8cbf9c94cccc"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:27.463066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:27.463585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:27.464023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:27.757004 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] Creating event network-vif-deleted:e7538ba3-1b1c-4012-b51d-8cbf9c94cccc for instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a on n-h2-852771-11 Aug 30 18:22:27.761968 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e54ec5b1-42bf-44a9-8e14-4da332809d0d req-1fbbead0-8356-4dc9-8cfc-3825f2e05b13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314902 Aug 30 18:22:27.762576 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3382/6497] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:28.134175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:28.134795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] [instance: 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:28.141921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:28.142415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:28.142856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:28.143580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:28.144038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:28.144468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:28.158476 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] HTTP exception thrown: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Request method failure captured: Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a HTTP/1.1 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlVUTD-greCBNy6SUOyu9qCjJTkDEqhk1y2C8fU3xxzVprk5bY8lgwRJp66MczgIoK2E7F5tZwxCpYftGwvOteOKzxD8gjrC9lUcXetXMCkHiATjW9l2ZJeLK0uB9llcRFcku3tquWycSYqifdC85HxsLB13kSJ8jPVHSPhPMbTo1ZI Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: ac6eddd4fda3408ba93d149af033cb87 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1295359767 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac6eddd4fda3408ba93d149af033cb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac6eddd4fda3408ba93d149af033cb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ac6eddd4fda3408ba93d149af033cb87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ac6eddd4fda3408ba93d149af033cb87"}]}] Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1295359767 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: ac6eddd4fda3408ba93d149af033cb87 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1295359767 Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersAdminNegativeTestJSON-1295359767-project Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 2dc4c7979dc94e3baf61f7525df2923b Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1295359767-project Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '728dd4af-adb7-4579-8d3d-ea79b4ec5b1a'} Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:28.160142 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] Returning 404 to user: Instance 728dd4af-adb7-4579-8d3d-ea79b4ec5b1a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-460fa446-2eb5-4b2c-8c06-d2574e9b6f2c tempest-ServersAdminNegativeTestJSON-1295359767 tempest-ServersAdminNegativeTestJSON-1295359767-project] 10.222.0.50 "GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a" status: 404 len: 111 microversion: 2.1 time: 0.031499 Aug 30 18:22:28.165403 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3116/6498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:28 2022] GET /compute/v2.1/servers/728dd4af-adb7-4579-8d3d-ea79b4ec5b1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:22:34.352679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1943134299", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "5064bb88-3feb-457c-848b-b2d2ec7ce675"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:34.409510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] validate_networks() for [('5064bb88-3feb-457c-848b-b2d2ec7ce675', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:22:34.821712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:22:34.822436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:22:34.823011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:22:34.823421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:22:34.823881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:22:34.838292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:34.838852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:34.839354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:34.840211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:34.840725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:34.841197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:34.863315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Getting quotas for project 2ff3071d13f54b95ae6a5ac037a4baae. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:34.869472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Getting quotas for user fd3e47dccf0645e4b89b345f1df42cd6 and project 2ff3071d13f54b95ae6a5ac037a4baae. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:34.887387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:22:34.890006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:22:34.945006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c15cffd-d00a-468c-987c-8aff9cf73f66 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716689 Aug 30 18:22:34.945837 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3383/6499] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:22:34.956521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df6e87f2-bc6c-4998-b137-b88b968405ed tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:34.957153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df6e87f2-bc6c-4998-b137-b88b968405ed tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:34.964073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:35.018306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-df6e87f2-bc6c-4998-b137-b88b968405ed tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.026917 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df6e87f2-bc6c-4998-b137-b88b968405ed tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1215 microversion: 2.1 time: 0.074210 Aug 30 18:22:35.027509 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3117/6500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:34 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:36.047849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36bc3992-64e8-4f82-bd2c-90fea5dfb2d4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:36.048584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36bc3992-64e8-4f82-bd2c-90fea5dfb2d4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:36.109633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36bc3992-64e8-4f82-bd2c-90fea5dfb2d4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:36.118235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36bc3992-64e8-4f82-bd2c-90fea5dfb2d4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1215 microversion: 2.1 time: 0.074508 Aug 30 18:22:36.119081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3384/6501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:36 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:37.140224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b3b6790-b889-4503-8e93-ac2854a65cda tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:37.140856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7b3b6790-b889-4503-8e93-ac2854a65cda tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:37.142722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:37.198987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7b3b6790-b889-4503-8e93-ac2854a65cda tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:37.206575 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7b3b6790-b889-4503-8e93-ac2854a65cda tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1215 microversion: 2.1 time: 0.070223 Aug 30 18:22:37.211606 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3118/6502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:37 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:38.228551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9f2ad461-2878-4b44-bc02-7d006cdec0d0 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:38.229158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9f2ad461-2878-4b44-bc02-7d006cdec0d0 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:38.283318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9f2ad461-2878-4b44-bc02-7d006cdec0d0 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:38.291007 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9f2ad461-2878-4b44-bc02-7d006cdec0d0 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1215 microversion: 2.1 time: 0.066844 Aug 30 18:22:38.291618 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3385/6503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:38 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:39.312159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:39.312809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:39.315443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:39.323020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:39.323541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:39.323989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:39.324683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:39.325141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:39.325574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:39.389626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.398015 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-00118cad-72d4-4d11-9e7d-b0f9beb88e35 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1219 microversion: 2.1 time: 0.089712 Aug 30 18:22:39.398584 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3119/6504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:39 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:40.419711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:40.420352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:40.429482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.430137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.430591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.431326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.431821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.432252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.523964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:40.534091 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b7d51e4-5ee7-42b4-b91e-bf20b072bbf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1273 microversion: 2.1 time: 0.119559 Aug 30 18:22:40.534686 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3386/6505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:40 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:41.519937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:41.534229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.534735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.535563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.547727 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] Creating event network-changed:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h1-852771-11 Aug 30 18:22:41.555739 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3b4b805b-344e-4b20-946d-b1b91c808d4e req-402dd35e-b368-4011-b5aa-4037ba28e9c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039424 Aug 30 18:22:41.556512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3120/6506] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:41.558398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:41.559262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:41.566586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.567221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.568239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.568954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.569396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.569819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.715529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:41.723674 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-587ab4ae-3b3c-479d-8da3-5f272028e64d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.169741 Aug 30 18:22:41.724355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3387/6507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:41 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:42.747333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:42.748082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:42.754327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.754818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.755933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.756725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.757194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.757638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.889651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:42.897359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44f66a94-8100-4de2-9a93-26ef65ebeb58 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.155159 Aug 30 18:22:42.897942 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3121/6508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:42 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:43.917511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:43.918130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:43.921059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:43.926376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.927354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.928059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.928560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.929014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.929442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.934201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=66 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:44.057807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.065524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2dbb935-1c15-47d8-aa5f-96f11f23a084 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.152013 Aug 30 18:22:44.066095 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3388/6509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:43 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:45.088431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:45.089087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:45.091941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:45.097146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.097638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.098086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.099851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.100342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.100783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.232275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:45.241210 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6d49dfd0-cb26-4c81-b1e0-4cd59ef7edc6 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.156698 Aug 30 18:22:45.241794 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3122/6510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:45 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:46.262287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:46.262913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:46.264829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:46.271206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.271769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.272161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.272861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.273316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.273745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.408322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:46.416259 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4320781e-75c3-44c3-8487-ef72e1f43561 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.157887 Aug 30 18:22:46.416860 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3389/6511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:46 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:47.437894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:47.438546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:47.440513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:47.446475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.446958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.447405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.448205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.448662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.449088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.578458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:47.587083 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62033063-0f79-477f-99d5-42d573914346 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.153375 Aug 30 18:22:47.587696 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3123/6512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:47 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:47.808206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "name": "network-vif-plugged", "status": "completed", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:47.822258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.822767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.824559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.834591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] Creating event network-vif-plugged:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h1-852771-11 Aug 30 18:22:47.839863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a6fa3668-2e9a-4987-b5d3-f97fbb8287d3 req-19514366-ff52-441a-b78c-3c52f444e59d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Aug 30 18:22:47.840616 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3390/6513] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:48.608105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:48.608719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:48.616064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:48.616567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:48.616993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:48.617682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:48.618164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:48.618594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:48.747985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:48.755633 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07d3aafc-dbf6-4b80-ba0a-6b28dc0c6137 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1315 microversion: 2.1 time: 0.151423 Aug 30 18:22:48.756373 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3124/6514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:48 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:49.776823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:49.777513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:49.779457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:49.785764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.786243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.786675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.787980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.788429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.788843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.921424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:49.929202 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8db69125-d444-4337-a087-6295f4f4b033 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1501 microversion: 2.1 time: 0.156615 Aug 30 18:22:49.929778 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3391/6515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:49 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:49.949262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:49.951583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:49.958409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.959410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.959884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.960607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.961067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.961501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.989444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:49.995423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:22:50.001802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:22:50.002230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:22:50.002710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:22:50.003123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:22:50.003568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:22:50.067875 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8bc23834-b3bf-4c65-be67-60ab5770f20c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "POST /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af/action" status: 202 len: 0 microversion: 2.1 time: 0.122287 Aug 30 18:22:50.068492 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3125/6516] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:49 2022] POST /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:50.076922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:50.077539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:50.083745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:50.084831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:50.085688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:50.086406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:50.086893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:50.087328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:50.268707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:50.277260 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8eec899-aff7-4ce8-816f-937346a542d5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1510 microversion: 2.1 time: 0.204431 Aug 30 18:22:50.277861 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3392/6517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:50 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:51.299611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:51.300230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:51.306467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:51.306949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:51.307390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:51.308111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:51.308572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:51.309000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:51.445286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:51.453185 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c92321e0-951b-44de-abd7-7bd2712ce2ff tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1510 microversion: 2.1 time: 0.158361 Aug 30 18:22:51.454087 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3126/6518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:51 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:52.475218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:52.475960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:52.482863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.483349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.483830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.484526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.484982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.485411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.616291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:52.623964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-923c67f1-b6fc-4c95-914f-aa8df2eb025d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.153314 Aug 30 18:22:52.624536 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3393/6519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:52 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:53.645668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:53.646275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:53.653166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:53.653653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:53.654093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:53.654779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:53.655234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:53.655757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:53.784627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:53.792427 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8aedf6df-5b67-4a62-8e00-c43705d371ec tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.150678 Aug 30 18:22:53.793005 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3127/6520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:53 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:54.813929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:54.814549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:54.821503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:54.822011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:54.822441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:54.823135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:54.823622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:54.824050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:54.957340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:54.965244 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6df04e2a-b288-4a99-8fdd-01ac26f2454c tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.155257 Aug 30 18:22:54.965825 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3394/6521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:54 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:55.986176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:55.986807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:55.994842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:55.995343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:55.995826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:55.996589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:55.997190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:55.997641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:56.136876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:56.144773 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8c1f5be-3b38-432d-b609-aff8ead3d55a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.162512 Aug 30 18:22:56.145544 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3128/6522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:55 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:57.166117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:57.166715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:57.173646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.174124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.174553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.175239 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.175715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.176139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.308913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:57.316804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-77e3f7d1-b902-4192-a741-e65de818cd72 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.154766 Aug 30 18:22:57.317379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3395/6523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:57 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:58.338248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:58.338867 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:58.345848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:58.346333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:58.346771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:58.347459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:58.347943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:58.348372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:58.483343 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:58.491972 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c23dea5-52d6-403a-a77e-7a0d0b672771 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.157652 Aug 30 18:22:58.492562 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3129/6524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:58 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:59.512714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:59.513324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:59.520269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.520687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.521117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:59.521803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.522278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.522701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:59.658706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:59.667296 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-06dd7976-19f9-41d4-8f1d-efb8b2431890 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.158464 Aug 30 18:22:59.667922 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3396/6525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:59 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:00.688169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.689028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.696304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.696795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.697231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.697921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.698376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.698805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.826021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:00.833772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-078f76eb-d4f5-489c-8f73-0cfaef8db2a3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.149393 Aug 30 18:23:00.834335 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3130/6526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:01.854381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.855021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.861899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.862372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.862798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.863511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.863944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.864364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.994758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:02.002490 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b380a7a5-0fdf-44a5-a2f8-7cf21696c18d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.151997 Aug 30 18:23:02.003060 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3397/6527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:01 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:03.025066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:03.025699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:03.032616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:03.033114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:03.033565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:03.034269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:03.034737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:03.035179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:03.168747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:03.176476 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b20c7e9f-af2d-4f0a-9e02-ad13431e518a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.156122 Aug 30 18:23:03.177046 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3131/6528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:03 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:04.197474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:04.198087 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:04.205525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.206010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.206443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.207148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.207638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.208061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.341395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:04.349311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8bb23596-35dd-403e-b641-d5430760bb8d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.156319 Aug 30 18:23:04.350672 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3398/6529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:04 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:05.371667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:05.372292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:05.379177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:05.379701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:05.380147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:05.380874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:05.381367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:05.381848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:05.513146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:05.521113 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d15b64cc-9099-4568-81f6-12c44e533867 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.153659 Aug 30 18:23:05.521660 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3132/6530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:05 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:06.542829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:06.543357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:06.549926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:06.550404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:06.550839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:06.551555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:06.552012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:06.552463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:06.686291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:06.694473 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-78afc326-efb5-4282-b83d-bf530462ab93 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.155838 Aug 30 18:23:06.695045 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3399/6531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:06 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:07.715418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:07.716064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:07.722891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:07.723372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:07.723851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:07.724542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:07.725066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:07.725411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:07.858811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:07.867428 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6901e367-c62c-4b9a-b219-e7088845109d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.155867 Aug 30 18:23:07.868027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3133/6532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:07 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:08.888279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:08.888924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:08.895942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:08.896897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:08.897346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:08.898041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:08.898504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:08.898934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:09.031424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:09.039426 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-064a349f-dad8-407e-86e7-b8bba14804be tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.155105 Aug 30 18:23:09.040034 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3400/6533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:08 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:10.060110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:10.060740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:10.067401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.067922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.069067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:10.069874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.070378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.070785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:10.074939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:10.200432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:10.208131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcd29b92-286a-4270-be78-be17254cb215 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.151909 Aug 30 18:23:10.208710 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3134/6534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:10 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:11.229827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.230474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:11.237336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.237817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.238263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.238958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.239415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.239870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.376244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:11.385051 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f38bf103-40e1-4b52-8b2a-1da9e3a703d3 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.160326 Aug 30 18:23:11.385632 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3401/6535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:11 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:12.406179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:12.406801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:12.414475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.414961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.415403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.416123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.416581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.417012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.553244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:12.560977 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ddb49bd7-4230-4860-b73b-31492a2ed05f tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.158698 Aug 30 18:23:12.561551 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3135/6536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:12 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:13.581928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:13.582481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:13.589358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:13.589829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:13.590260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:13.590948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:13.591441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:13.591970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:13.723378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:13.731598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f2dbc6f0-08cf-4c6d-9122-a1cf2755551a tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.153634 Aug 30 18:23:13.732174 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3402/6537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:13 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:14.753125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:14.753754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:14.761387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.761880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.762329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.763031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.763514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.763956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.893883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:14.901805 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d94f059d-5409-4a3e-8274-9f1453771cfe tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.152534 Aug 30 18:23:14.902306 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3136/6538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:14 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:15.922953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:15.923589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:15.926258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=30 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:15.931798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:15.932281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:15.932719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:15.933437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:15.933889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:15.934315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:15.937094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=86 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:16.071200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:16.078962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-79fad253-3181-4330-8542-069a829122ee tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.159941 Aug 30 18:23:16.079576 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3403/6539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:15 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:17.101841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:17.102474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:17.104502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=34 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:17.109868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.110363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.110813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.111544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.112014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.112461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.247281 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:17.255338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-29cd4e87-55e3-4f47-a5c7-c9f8868f4d60 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.158475 Aug 30 18:23:17.257013 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3137/6540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:17 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:18.277675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:18.278293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:18.285066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.285591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.286107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.287429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.288088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.288518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.417807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:18.425647 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7a4b36f1-68a6-46cb-8774-ea0d43d49930 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1515 microversion: 2.1 time: 0.151923 Aug 30 18:23:18.426226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3404/6541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:18 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:19.314761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "name": "network-vif-unplugged", "status": "completed", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:19.326353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.326928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.327450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.340073 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Creating event network-vif-unplugged:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h2-852771-11 Aug 30 18:23:19.345540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:23:19.357374 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4ebbe549-6364-4239-bd96-cc312aa919dd req-498b6732-259c-44e9-8bba-5ce7264c1ffc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046289 Aug 30 18:23:19.358164 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3138/6542] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:19.446947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:19.447595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:19.454557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.455054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.455511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.456219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.456678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.457111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.595731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:19.603790 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9187cd02-8fa5-4986-84c2-d91ed2ebe09e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1514 microversion: 2.1 time: 0.161464 Aug 30 18:23:19.604379 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3405/6543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:19 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:20.626660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:20.627967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:20.635459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:20.636015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:20.636492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:20.637202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:20.637670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:20.638108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:20.776548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:20.784459 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-469dbf69-a67e-4d52-a2d4-05c2206a401d tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1512 microversion: 2.1 time: 0.162317 Aug 30 18:23:20.784978 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3139/6544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:20 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:21.383168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:21.394117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.394591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.395020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.406832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Creating event network-changed:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h2-852771-11 Aug 30 18:23:21.412448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:23:21.423163 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-caf6b3d4-15db-47ef-9efa-84a05a472932 req-5da57af1-781c-4566-8741-9a1cea801b8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043701 Aug 30 18:23:21.423856 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3406/6545] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:21.807491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.808124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:21.814718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.815218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.815696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.816409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.816875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.817313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:22.421306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:22.430024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-496ddd4c-60b0-4c51-925d-272fbde3b6a8 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1509 microversion: 2.1 time: 0.627275 Aug 30 18:23:22.430840 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3140/6546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:21 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1509 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:22.452069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:22.452646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:22.458857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:22.459447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:22.459912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:22.460607 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:22.461058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:22.461484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:22.488717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:23:22.540923 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.compute.api [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Found an unconfirmed migration during delete, id: 16, status: finished Aug 30 18:23:24.290519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eba13e9b-8fdf-4d3d-8222-8875f2f59b69 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 204 len: 0 microversion: 2.1 time: 1.843229 Aug 30 18:23:24.291355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3407/6547] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:22 2022] DELETE /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 0 bytes in 1845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:24.299742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:24.300361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:24.307191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.307717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.308156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.308849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.309303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.309732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.439622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:24.448780 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7850a58c-f29a-48c7-a23f-e20d3c7bf58e tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1501 microversion: 2.1 time: 0.152786 Aug 30 18:23:24.449372 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3141/6548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:24 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:25.108418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "name": "network-vif-plugged", "status": "completed", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:25.119620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:25.120103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:25.120577 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.135753 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] Creating event network-vif-plugged:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h2-852771-11 Aug 30 18:23:25.140571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6cd4c7aa-2618-4743-9431-031d2bc422a2 req-01aaf3df-3805-4bf7-a72b-f9625f76abfd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036339 Aug 30 18:23:25.141184 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3408/6549] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:25.469557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:25.470210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:25.478672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:25.479201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:25.480569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.481747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:25.482218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:25.482652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.659098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3e47dccf0645e4b89b345f1df42cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff3071d13f54b95ae6a5ac037a4baae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:25.668001 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a2876e12-5ccd-4a64-a564-5315cbf6f1c4 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 200 len: 1501 microversion: 2.1 time: 0.202683 Aug 30 18:23:25.668591 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3142/6550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:25 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:26.062099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c4a32-31ed-4d35-b100-c63325ebc6af", "name": "network-vif-deleted", "tag": "42287228-7718-4908-853e-74e6d918ea36"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:26.072934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.073578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.074922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.087303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] Creating event network-vif-deleted:42287228-7718-4908-853e-74e6d918ea36 for instance ce0c4a32-31ed-4d35-b100-c63325ebc6af on n-h2-852771-11 Aug 30 18:23:26.092197 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-96c35897-9528-4e49-b992-9e742ec82244 req-17a7c8e2-f17a-4e62-b052-a1e38b30c0b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035751 Aug 30 18:23:26.092805 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3409/6551] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:26.689583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.690225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.697251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.697739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.698178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.698866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.699324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.699778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.713425 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] HTTP exception thrown: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Request method failure captured: Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af HTTP/1.1 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlVqfNfZUES1YzQIEA_UoO7Cr4BZaPmHUaE2lVOX_PNdsKbneKVcS8fE3XmF7lD4IP9vz9k3Fyv9MAmlM2Y_oEz5Mz5pgNxIrjzGNjm3SF0-tvFpShwbTgAjEn_Op64DBZQu4ISgHAd8skykWiH17jSsHofQ8Uou4ye_vclJ_4Kos04 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ff3071d13f54b95ae6a5ac037a4baae"}]}] Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: fd3e47dccf0645e4b89b345f1df42cd6 Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ce0c4a32-31ed-4d35-b100-c63325ebc6af'} Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.715045 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Returning 404 to user: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-52b5caee-abea-435f-b7e8-cb885b9d7cf5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 404 len: 111 microversion: 2.1 time: 0.030754 Aug 30 18:23:26.718760 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3143/6552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:26 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:26.733882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.734475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.741304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.741836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.742271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.742967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.743427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.743884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.757149 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] HTTP exception thrown: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Request method failure captured: Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af HTTP/1.1 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlVqfNfZUES1YzQIEA_UoO7Cr4BZaPmHUaE2lVOX_PNdsKbneKVcS8fE3XmF7lD4IP9vz9k3Fyv9MAmlM2Y_oEz5Mz5pgNxIrjzGNjm3SF0-tvFpShwbTgAjEn_Op64DBZQu4ISgHAd8skykWiH17jSsHofQ8Uou4ye_vclJ_4Kos04 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ff3071d13f54b95ae6a5ac037a4baae"}]}] Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: fd3e47dccf0645e4b89b345f1df42cd6 Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'ce0c4a32-31ed-4d35-b100-c63325ebc6af'} Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:26.758794 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Returning 404 to user: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03c29611-ad97-4ad5-89c6-989038a85fc5 tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 404 len: 111 microversion: 2.1 time: 0.031455 Aug 30 18:23:26.762657 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3410/6553] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:26 2022] DELETE /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:26.768924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.769545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] [instance: ce0c4a32-31ed-4d35-b100-c63325ebc6af] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.775961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.776447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.776917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.777603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.778060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.778495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.792252 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] HTTP exception thrown: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Request method failure captured: Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af HTTP/1.1 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlVqfNfZUES1YzQIEA_UoO7Cr4BZaPmHUaE2lVOX_PNdsKbneKVcS8fE3XmF7lD4IP9vz9k3Fyv9MAmlM2Y_oEz5Mz5pgNxIrjzGNjm3SF0-tvFpShwbTgAjEn_Op64DBZQu4ISgHAd8skykWiH17jSsHofQ8Uou4ye_vclJ_4Kos04 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ff3071d13f54b95ae6a5ac037a4baae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ff3071d13f54b95ae6a5ac037a4baae"}]}] Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 2ff3071d13f54b95ae6a5ac037a4baae Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046302206 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: fd3e47dccf0645e4b89b345f1df42cd6 Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-DeleteServersTestJSON-2046302206-project Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ce0c4a32-31ed-4d35-b100-c63325ebc6af'} Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:26.793756 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] Returning 404 to user: Instance ce0c4a32-31ed-4d35-b100-c63325ebc6af could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8b8fe959-fd77-4963-b0c7-743688b441ae tempest-DeleteServersTestJSON-2046302206 tempest-DeleteServersTestJSON-2046302206-project] 10.222.0.50 "GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af" status: 404 len: 111 microversion: 2.1 time: 0.030056 Aug 30 18:23:26.797567 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3144/6554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:26 2022] GET /compute/v2.1/servers/ce0c4a32-31ed-4d35-b100-c63325ebc6af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:35.470305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-65462933", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "83d1e6d4-1c2a-4f6c-b80a-202574c347df"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:35.529349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] validate_networks() for [('83d1e6d4-1c2a-4f6c-b80a-202574c347df', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:23:35.941132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:23:35.941565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:23:35.942076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:23:35.943198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:23:35.943652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:23:35.953012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:35.953527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:35.953974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:35.954709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:35.955169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:35.955630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:35.975256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for project f6140ef879694a33b8ae4eab79d8486e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:35.980967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for user d978c360a9274ebfbf52dd55d78fee87 and project f6140ef879694a33b8ae4eab79d8486e. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:35.995450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:23:35.997862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:23:36.046241 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13615b40-867b-4536-8bc4-e060a4239ae5 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710402 Aug 30 18:23:36.046907 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3411/6555] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:23:36.059081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95c9bbed-2895-415c-8ce3-8550cd185095 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:36.060002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95c9bbed-2895-415c-8ce3-8550cd185095 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:36.120745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95c9bbed-2895-415c-8ce3-8550cd185095 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:36.128918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95c9bbed-2895-415c-8ce3-8550cd185095 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1216 microversion: 2.1 time: 0.073785 Aug 30 18:23:36.129599 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3145/6556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:36 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:37.150398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:37.151173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:37.160246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.161186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.162561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.163628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.164301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.164972 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.245850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:37.254560 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ae3f96d-0f6c-46e5-acde-07acf19dd8ae tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1286 microversion: 2.1 time: 0.108081 Aug 30 18:23:37.258057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3412/6557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:37 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:38.280267 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:38.285670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:38.290341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=55 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:38.297918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.298675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.299353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.300650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.301169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.301868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.507998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:38.528339 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-49b41042-0aa5-4a8f-a19e-a5f1f23e9e73 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.252993 Aug 30 18:23:38.529851 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3146/6558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:38 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:38.576074 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:38.587995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.588393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.588831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.601338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] Creating event network-changed:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h1-852771-11 Aug 30 18:23:38.606585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ac423161-06d3-4213-bc0c-081a41deab88 req-afab30aa-6486-46cd-af53-858105fc759e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Aug 30 18:23:38.607365 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3413/6559] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:39.552486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:39.553226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:39.560000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:39.560492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:39.560934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:39.561634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:39.562351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:39.562799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:39.747123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:39.754888 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb7b7f89-ad1f-47bf-885c-77c499ab5c93 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.206994 Aug 30 18:23:39.755815 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3147/6560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:39 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:40.779056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:40.779786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:40.786593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.787175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.787645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.788399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.788787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.789210 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.943357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:40.951417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a7fd9cf3-c4f1-4b41-9c47-ee8ca629e66d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.179018 Aug 30 18:23:40.952249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3414/6561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:40 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:41.973059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:41.973736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:41.980758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.981258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.981708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.982422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.982886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.983328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:42.208190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:42.215942 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b263631d-bb69-46f7-aa19-6f1ff4d504a2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.246753 Aug 30 18:23:42.216518 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3148/6562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:41 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:43.236763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:43.237388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:43.244816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:43.245297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:43.245736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:43.246778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:43.247544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:43.247988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:43.502618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:43.511136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-13c7fd76-4c6e-4a6a-a223-32920ed4d433 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.278302 Aug 30 18:23:43.511678 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3415/6563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:43 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:44.121908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "name": "network-vif-plugged", "status": "completed", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:44.133361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.134676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.135132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.147632 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] Creating event network-vif-plugged:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h1-852771-11 Aug 30 18:23:44.153028 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-017e0956-4c6a-4a7f-be49-d743b7c5cfce req-4d40c025-acd3-4c5b-9748-3c7326edbf16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Aug 30 18:23:44.153637 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3149/6564] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:44.532241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:44.532769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:44.540308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.540788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.541218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.541938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.542450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.542874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.676725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:44.684609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42060d36-3664-4bc8-923e-d5950198ea21 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1316 microversion: 2.1 time: 0.156425 Aug 30 18:23:44.685212 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3416/6565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:44 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:45.706375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:45.707087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:45.714429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:45.714923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:45.715365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:45.716096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:45.716583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:45.717014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:45.849236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:45.857085 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b154138b-ac52-41c7-b5f4-edd6def87e8e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1507 microversion: 2.1 time: 0.154960 Aug 30 18:23:45.857659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3150/6566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:45 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:45.877984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:45.878600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:45.886023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:45.886503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:45.886942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:45.887674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:45.888131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:45.888557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:45.966380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:45.988076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:46.020256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.023046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:46.030122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d522027-246f-462f-8b69-7d9a04c147c7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1507 microversion: 2.1 time: 0.155983 Aug 30 18:23:46.030698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3417/6567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:45 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.050938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:46.053572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.059652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.060160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.060613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.061322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.061784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.062220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.124660 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4fbfb96-d7ee-4b57-b2b7-762034450f77 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "PUT /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1079 microversion: 2.1 time: 0.077517 Aug 30 18:23:46.130463 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3151/6568] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 18:23:46 2022] PUT /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1079 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.142757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.143374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.146408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:46.152868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.153359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.153798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.154488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.154950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.155384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.285873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.293899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-48c93d83-960a-41e1-9cd3-b21652fe98c0 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1505 microversion: 2.1 time: 0.155006 Aug 30 18:23:46.294474 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3418/6569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:46 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.313301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.313924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.315891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:46.321690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.322175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.322612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.323302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.323781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.324212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.754164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.762066 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f380705a-18d7-4e62-848b-68839ebcf2f4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1505 microversion: 2.1 time: 0.452521 Aug 30 18:23:46.762575 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3152/6570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:46 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.781986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:46.784326 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.790932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.791413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.791880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.792568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.793023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.793450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.821132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.826806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Old instance type m1.heat2, new instance type m1.heat {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:23:46.833760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:23:46.834188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:23:46.834666 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:23:46.835077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:23:46.835502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:23:46.897964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b65b798-1e34-4620-b8ea-ea48fdf9b984 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771/action" status: 202 len: 0 microversion: 2.1 time: 0.119847 Aug 30 18:23:46.898590 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3419/6571] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:23:46 2022] POST /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:23:46.906532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.907157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.913102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.913595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.914041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.914741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.915197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.915841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:47.049474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:47.057580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0b3ecd33-59c3-4fc3-90f9-369753682585 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1516 microversion: 2.1 time: 0.154754 Aug 30 18:23:47.058148 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3153/6572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:46 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:48.079799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:48.079799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:48.086738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:48.087204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:48.087668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:48.088367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:48.088820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:48.089247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:48.220544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:48.229113 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd7465cd-3f13-4868-9580-e9e1a099a6bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1516 microversion: 2.1 time: 0.154840 Aug 30 18:23:48.229727 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3420/6573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:48 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:49.250358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:49.251003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:49.253738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:49.260581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.261142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.261529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:49.262239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.262702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.263137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:49.401393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:49.409213 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4dbb9380-4072-44ec-acbd-0a8ef9d40750 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.162707 Aug 30 18:23:49.409791 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3154/6574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:49 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:50.431156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:50.431797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:50.438775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.439203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.439671 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.440379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.440836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.441266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.575634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:50.583662 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9d621457-3157-4e91-b08b-de33c05d6be2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.157216 Aug 30 18:23:50.584318 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3421/6575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:50 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:51.605934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:51.606559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:51.614555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.615045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.615599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:51.616764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.617229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.617673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:51.751895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:51.760154 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc6eac54-8331-4d79-8262-cedbac07aa58 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.158103 Aug 30 18:23:51.760767 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3155/6576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:51 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:52.781707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:52.782355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:52.789917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.790399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.790829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.791542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.791992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.792417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.923341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:52.931164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0b709d04-b871-4e7c-b5d4-2653481b5d53 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.153372 Aug 30 18:23:52.931773 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3422/6577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:52 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:53.951539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:53.952162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:53.959182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:53.959714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:53.960283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:53.960999 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:53.961463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:53.961903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:54.093719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:54.102742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb952c2e-9b00-4ea9-b453-fd7b48e2e56d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.155034 Aug 30 18:23:54.103332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3156/6578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:53 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:55.124739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:55.125377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:55.132243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:55.132725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:55.133158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:55.133843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:55.134296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:55.134716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:55.265252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:55.273824 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8136042-2627-4b10-b226-636696f0d734 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.153039 Aug 30 18:23:55.274623 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3423/6579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:55 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:56.295375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:56.296048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:56.302037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.302527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.303580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.304435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.304883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.305314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.444807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:56.452595 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-de548bb2-86ce-4feb-9b56-ced9674e298c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.162119 Aug 30 18:23:56.453521 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3157/6580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:56 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:57.473448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:57.474056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:57.481213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.481691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.482123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.482807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.483255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.483704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.617277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:57.625001 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a05068f1-4e6f-4e0a-a26e-35a298af7884 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.155499 Aug 30 18:23:57.625576 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3424/6581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:57 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:58.646375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:58.647616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:58.654355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.654844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.655287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.656010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.656473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.656905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.786335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:58.794135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aa91b85a-b6f6-483e-8c40-65e45d3b8343 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.151782 Aug 30 18:23:58.794700 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3158/6582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:58 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:59.814721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:59.815385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:59.822255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.822730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.823160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.823874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.824325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.824746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.952098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:59.960598 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c79273e2-7e17-4c1c-b47f-d2afe4e633f1 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.149811 Aug 30 18:23:59.961182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3425/6583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:59 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:00.981809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:00.982468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:00.989613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:00.990108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:00.991494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:00.992218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:00.992682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:00.993119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.130983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:01.138886 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-15607b5e-db18-49a1-9601-d0b61ae55e2c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.161022 Aug 30 18:24:01.139441 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3159/6584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:00 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:02.160792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:02.161408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:02.168781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.169265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.169705 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:02.170396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.170853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.171280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:02.306328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:02.314110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81343e8e-6f64-4c9b-a83c-f3ce0dda8011 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.157335 Aug 30 18:24:02.314689 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3426/6585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:02 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:03.335796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:03.336419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:03.345893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.346770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.347637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.348887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.350268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.351009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.483846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:03.492465 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d6bc05c-9ca7-4d07-a62c-861ae8207996 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.160973 Aug 30 18:24:03.493044 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3160/6586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:03 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:04.513250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:04.513849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:04.520830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.522127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.522737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.523432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.523911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.524337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.654047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:04.661810 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-de12db06-0073-44c0-8ce9-23b1d5c4958d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.152458 Aug 30 18:24:04.662889 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3427/6587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:04 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:05.684048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:05.684675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:05.691506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.691998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.692441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.693131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.694295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.694725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.833473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:05.841368 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf5545b1-38d0-4a92-88ba-f9c247f247d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.161184 Aug 30 18:24:05.841940 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3161/6588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:05 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:06.862994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:06.863646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:06.870515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:06.871011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:06.871450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:06.872173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:06.872633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:06.873064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:07.002724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:07.011129 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8935e90f-61fe-467b-ac9e-da33c65fdb3f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.152330 Aug 30 18:24:07.011745 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3428/6589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:06 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:08.032588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:08.033206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:08.040934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:08.041422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:08.041864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:08.042558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:08.043012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:08.043442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:08.061509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:08.174233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:08.182231 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f69e73de-5bf1-4f35-85d1-f4361df3914f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.153589 Aug 30 18:24:08.182806 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3162/6590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:08 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:09.203610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:09.204228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:09.211565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:09.212048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:09.212484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:09.213176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:09.213627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:09.214054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:09.351703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:09.359597 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d138c121-d1da-43c7-8571-034a15fa5332 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.159856 Aug 30 18:24:09.360192 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3429/6591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:09 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:10.383624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:10.384245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:10.391072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:10.391588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:10.392034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:10.392721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:10.393179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:10.393609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:10.525851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:10.533514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6791f0dd-fc5c-43aa-9408-ed90f3be928a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.154531 Aug 30 18:24:10.534097 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3163/6592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:10 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:11.554903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:11.555422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:11.562306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:11.562784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:11.563217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:11.563931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:11.564379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:11.564801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:11.696387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:11.704057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b185dc2-e710-4546-afdb-59ed407f3ac9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.153764 Aug 30 18:24:11.704634 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3430/6593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:11 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:12.724025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:12.725766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:12.732633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.733127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.733575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:12.734273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.734736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.735172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:12.868366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:12.876116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c992b34-15d8-4653-96ba-a3508e44cbd4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.155972 Aug 30 18:24:12.876700 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3164/6594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:12 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:13.898280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:13.898901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:13.905791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:13.906278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:13.906715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:13.907415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:13.907901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:13.908332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:14.039559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:14.047271 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9af12837-481a-46d0-981b-a1664cdaee16 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.153594 Aug 30 18:24:14.047867 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3431/6595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:13 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:15.068578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:15.069213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:15.076149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:15.076644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:15.077096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:15.077798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:15.078270 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:15.078709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:15.258042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:15.266234 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-87dc7074-8541-4c2a-82bc-8b9a01a81ffa tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1521 microversion: 2.1 time: 0.201630 Aug 30 18:24:15.266836 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3165/6596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:15 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:16.004069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "name": "network-vif-unplugged", "status": "completed", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:16.014321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:16.014804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:16.015247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:16.027703 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Creating event network-vif-unplugged:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h2-852771-11 Aug 30 18:24:16.033303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:24:16.044469 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ad71d492-0510-4c62-9353-7d2910ab9e25 req-611963b0-21f9-4678-ba3d-3df184f289d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098723 Aug 30 18:24:16.045098 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3432/6597] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:16.286641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:16.287354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:16.294179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:16.294697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:16.295135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:16.295865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:16.296315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:16.296742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:16.511941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:16.519879 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d1cb0258-a647-4061-88f9-3d34b6fd9fd9 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1520 microversion: 2.1 time: 0.237098 Aug 30 18:24:16.520461 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3166/6598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:16 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:17.545093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:17.545750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:17.547719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=34 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:17.554191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:17.554679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:17.555120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:17.555878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:17.556334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:17.556767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:17.559681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:17.689083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:17.697049 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b8f9035-7da5-4814-9d05-b87dc853499f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1518 microversion: 2.1 time: 0.157309 Aug 30 18:24:17.697617 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3433/6599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:17 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:18.058909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:18.069155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.069663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.070107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.082209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Creating event network-changed:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h2-852771-11 Aug 30 18:24:18.089195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:24:18.100937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-c36368ec-e4b4-4e26-bf2d-5b177e505152 req-92e2259e-a841-4d11-a923-14cb2c0e05ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045669 Aug 30 18:24:18.101752 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3167/6600] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:18.718900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:18.719625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:18.726692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.727180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.727642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.728340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.728789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.729208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.864005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:18.873290 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f20ca09e-851d-45d6-aa04-a6857e755b30 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1515 microversion: 2.1 time: 0.158862 Aug 30 18:24:18.874098 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3434/6601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:18 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:18.894118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:18.894748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:18.901056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.901549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.901995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.902689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.903146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.903606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.964300 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0b5e3dd7-3043-456e-b267-bdd668bf2b1f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771/action" status: 204 len: 0 microversion: 2.1 time: 0.074036 Aug 30 18:24:18.964963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3168/6602] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:24:18 2022] POST /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:24:18.974620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:18.976019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:18.982573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.983160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.983649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.984360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.984883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.985595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:19.129104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:19.137882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f718c6c1-1e9c-45bf-ae5e-b0df1656cf7b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1515 microversion: 2.1 time: 0.167965 Aug 30 18:24:19.151685 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3435/6603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:18 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:20.162873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:20.164372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:20.167390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=30 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:20.174870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:20.175791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:20.176324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:20.177106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:20.177658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:20.178459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:20.319422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:20.327333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d26d07a-d4e8-47a9-b57d-09e9ce161bbc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1507 microversion: 2.1 time: 0.169739 Aug 30 18:24:20.327876 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3169/6604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:20 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:20.348043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:20.348665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:20.355646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:20.356125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:20.356557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:20.357242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:20.357689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:20.358112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:20.488195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:20.496383 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2c2af8f6-8a05-4598-b8ef-38e10423a807 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1507 microversion: 2.1 time: 0.152281 Aug 30 18:24:20.496958 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3436/6605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:20 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:20.521047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e02f64f6-f2c5-4659-bf70-17672403ac60 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'create', calling method: .version_select at 0x7f2d905208b0>, body: {"keypair": {"name": "tempest-keypair-1944673400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK05lEsXYL564SAzdehIm5Yqcdh60ZHHeLrXxdVqeMW9kO42hUUPgLhdGzWHzdC/i/IbBbwS7ocnUKj0wZFJpxCxBotmewug4gCR4FtbvgbrhS9yuO29b5y84jjbGJbPA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:20.538111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e02f64f6-f2c5-4659-bf70-17672403ac60 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for project f6140ef879694a33b8ae4eab79d8486e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:24:20.543289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-e02f64f6-f2c5-4659-bf70-17672403ac60 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for user d978c360a9274ebfbf52dd55d78fee87 and project f6140ef879694a33b8ae4eab79d8486e. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:24:20.567465 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e02f64f6-f2c5-4659-bf70-17672403ac60 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051416 Aug 30 18:24:20.568737 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3170/6606] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:24:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:21.370208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "name": "network-vif-plugged", "status": "completed", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:21.381604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:21.382089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:21.382558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:21.393595 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] Creating event network-vif-plugged:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h2-852771-11 Aug 30 18:24:21.399713 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b49a524e-cbba-4aeb-9f93-416dfc94f977 req-05f3763d-fc4e-4808-a5bd-20bc3ac00163 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108607 Aug 30 18:24:21.400327 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3437/6607] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:21.814640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:21.815347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:21.822654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:21.823144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:21.823612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:21.824316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:21.824772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:21.825207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.041813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:22.049735 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-440a3e40-1d78-43ac-9949-d57f0bf3869a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 200 len: 1507 microversion: 2.1 time: 0.239847 Aug 30 18:24:22.050407 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3171/6608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:21 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:22.072070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:22.072673 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:22.079214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.079740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.080215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.080926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.081512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.081951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.109376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:24:22.187890 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ddb5e84-704f-4d4b-8692-93ec0f1f1188 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "DELETE /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 204 len: 0 microversion: 2.1 time: 0.120738 Aug 30 18:24:22.188841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3438/6609] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:24:22 2022] DELETE /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:24:22.246470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-832041643", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "83d1e6d4-1c2a-4f6c-b80a-202574c347df"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:22.300449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] validate_networks() for [('83d1e6d4-1c2a-4f6c-b80a-202574c347df', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:24:23.046039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:24:23.046604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:24:23.046933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:24:23.047347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:24:23.047805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:24:23.056991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.057477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.057930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.058645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.059106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.059563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.076219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for project f6140ef879694a33b8ae4eab79d8486e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:24:23.081385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Getting quotas for user d978c360a9274ebfbf52dd55d78fee87 and project f6140ef879694a33b8ae4eab79d8486e. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:24:23.094548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:24:23.096939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:24:23.144453 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b317a9c-0cd7-4b8b-8a92-ac6e8e9ba552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901772 Aug 30 18:24:23.145109 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3172/6610] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:24:23.157245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2ebf17df-4859-436f-bfa4-14f5d8c7e3e7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:23.157947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2ebf17df-4859-436f-bfa4-14f5d8c7e3e7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:23.221615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2ebf17df-4859-436f-bfa4-14f5d8c7e3e7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:23.231600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2ebf17df-4859-436f-bfa4-14f5d8c7e3e7 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1217 microversion: 2.1 time: 0.078512 Aug 30 18:24:23.232603 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3439/6611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:23 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:23.914137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c624f5-11ab-4bd0-ab9e-34d507c07771", "name": "network-vif-deleted", "tag": "27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:23.924539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.925018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.925491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.936619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] Creating event network-vif-deleted:27965ad1-c78a-4ab9-87e1-21ddcc2f9e4e for instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 on n-h2-852771-11 Aug 30 18:24:23.941502 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-da416d3b-0282-49bb-94cb-dd65693fad93 req-899d88ed-3697-4b71-a900-793a0cb17955 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Aug 30 18:24:23.942097 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3173/6612] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:24.253164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:24.254498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:24.266628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.267135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.268537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.271718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.272381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.272960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.356214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:24.367717 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f59e59c4-d3ae-4e85-b759-8283fcc17635 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1287 microversion: 2.1 time: 0.118651 Aug 30 18:24:24.368973 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3440/6613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:24 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:25.390957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:25.391838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:25.398339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:25.398909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:25.399364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:25.400094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:25.400552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:25.400984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:25.601350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:25.609988 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a9bd8dc-dd00-40a5-98b0-effa3ced0496 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.224304 Aug 30 18:24:25.624761 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3174/6614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:25 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:25.978529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:25.987899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:25.988376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:25.988802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.000318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] Creating event network-changed:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h2-852771-11 Aug 30 18:24:26.005889 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-1e59f8d3-fb42-4db5-8228-08cc4fd62c37 req-cc89083d-7a8a-49a6-92fa-7005a80cb1cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031392 Aug 30 18:24:26.006644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3441/6615] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:26.632943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:26.633482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:26.640378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.640872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.641305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.641989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.642453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.642886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.778639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:26.786410 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5999d87b-1208-4023-ac04-71831f88a981 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.158069 Aug 30 18:24:26.787204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3175/6616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:26 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:27.807914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:27.808610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:27.814776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.815248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.815704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.816388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.816831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.817250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.953963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:27.962861 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a8acd33-f643-4daa-b13c-b0806084b3a6 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.160134 Aug 30 18:24:27.963466 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3442/6617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:27 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:28.984034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:28.984594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:28.992276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.992855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.993425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:28.994286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.994856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.995306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:29.143370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:29.151693 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf28aa5b-7944-4aa4-bbed-b3bc449ced9c tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.171672 Aug 30 18:24:29.152283 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3176/6618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:28 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:30.172699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:30.173354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:30.180243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.180723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.181157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:30.181845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.182296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.182719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:30.310818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:30.319457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4cfa65e1-5f4e-4363-8549-a61029b18439 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.150674 Aug 30 18:24:30.320056 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3443/6619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:30 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:31.191252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "name": "network-vif-plugged", "status": "completed", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:31.201834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.202583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.202844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.214577 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] Creating event network-vif-plugged:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h2-852771-11 Aug 30 18:24:31.219538 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-2dbcc5fa-f6ee-4989-ad70-b21f51b1bea6 req-f7ad7e37-90a4-423d-8d08-ad88d6818fe0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 Aug 30 18:24:31.220195 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3177/6620] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:31.340113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:31.340729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:31.347641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.348126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.348559 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.349893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.350343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.350766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.490369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:31.500252 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5d05c03e-3c3d-4648-87d0-6df41f17626d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1317 microversion: 2.1 time: 0.163645 Aug 30 18:24:31.501298 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3444/6621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:31 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:32.523781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:32.524425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.530568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.531056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.531520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.532217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.532680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.533114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.665168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:32.672994 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8bc742f-c9e7-4643-9258-71a647790d4a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1507 microversion: 2.1 time: 0.154542 Aug 30 18:24:32.673577 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3178/6622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:32 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:32.693085 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:32.693713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.700633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.701124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.701566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.702264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.702723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.703155 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.831197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:32.839452 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35343fbc-84ee-45b2-a8d9-482056a6e652 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1507 microversion: 2.1 time: 0.150346 Aug 30 18:24:32.840081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3445/6623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:32 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:32.860425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:32.862677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.869185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.869676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.870121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.870818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.871279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.871747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.899770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:32.905497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:24:32.912716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:24:32.913147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:24:32.913629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:24:32.914047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:24:32.914466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:24:32.976356 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-46f44aa9-da94-45c0-b8f7-eab70310b19b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9/action" status: 202 len: 0 microversion: 2.1 time: 0.119843 Aug 30 18:24:32.976970 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3179/6624] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:24:32 2022] POST /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:24:32.985126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:32.985753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.992177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.992669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.993110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.993806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.994269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.994696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:33.154716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:33.167695 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ac09b4ab-102a-4373-8f75-fa3c5836ef82 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1514 microversion: 2.1 time: 0.182092 Aug 30 18:24:33.168469 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3446/6625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:32 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:34.191279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:34.192131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:34.197254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:34.197881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:34.204970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.205470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.205923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.206646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.207124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.207595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.213489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:34.428329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:34.436259 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf4c666f-e690-4d9f-a807-6a64ad6dae44 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1514 microversion: 2.1 time: 0.245884 Aug 30 18:24:34.436846 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3180/6626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:34 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:35.457419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:35.458038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:35.460268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:35.466602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.467083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.467547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:35.468238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.468693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.469122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:35.602272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:35.610011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e09344f7-fd0a-4370-bf19-f71208387bb8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.157003 Aug 30 18:24:35.610586 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3447/6627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:35 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:36.632821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:36.633371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:36.640204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:36.640690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:36.641163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.641854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:36.642306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:36.642734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.772175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:36.779834 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6638d581-08be-4a76-b9b2-adde97186659 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.151955 Aug 30 18:24:36.780400 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3181/6628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:36 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:37.801592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:37.802241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:37.809009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:37.809488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:37.809921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:37.810612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:37.811057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:37.811498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:37.945885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:37.953918 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a16bfbfb-f746-40e5-931a-3de2fd8b07d3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.156219 Aug 30 18:24:37.954504 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3448/6629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:37 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:38.974703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:38.975340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:38.982102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:38.982615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:38.983062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:38.983810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:38.984295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:38.984725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:39.120770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:39.128618 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45b6f65c-971a-4a36-9074-31ac4669de8b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.158332 Aug 30 18:24:39.129196 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3182/6630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:38 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:40.150310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:40.150866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:40.158221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:40.158698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:40.159128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:40.159841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:40.160292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:40.160715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:40.298253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:40.306905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b44b1ba-451b-498f-b898-995917aea8dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.160584 Aug 30 18:24:40.319501 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3449/6631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:40 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:41.328810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:41.329442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:41.337265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:41.337698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:41.338147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:41.338847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:41.339313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:41.339776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:41.477023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:41.485021 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e8ecf801-9024-45bb-afeb-dbf7b9b22584 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.160167 Aug 30 18:24:41.485606 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3183/6632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:41 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:42.506536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:42.507160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:42.514479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.514914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.515355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.516078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.516540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.516974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.532350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:42.653948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:42.662579 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf32eda4-05b2-476c-b5d8-af326074a9dc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.160099 Aug 30 18:24:42.663175 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3450/6633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:42 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:43.683540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:43.684189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:43.691051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:43.691596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:43.692046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:43.692834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:43.693330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:43.693769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:44.085671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:44.093449 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0767b0a-5e47-47ca-884a-5cbb6aca1ada tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.413848 Aug 30 18:24:44.094025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3184/6634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:43 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:45.116906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:45.117639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:45.124727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:45.125159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:45.125610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:45.126300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:45.126755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:45.127182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:45.256285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:45.264099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f346ade5-e5e6-4285-a04c-ab50ed9bb782 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.153101 Aug 30 18:24:45.264684 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3451/6635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:45 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:46.284723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:46.285354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:46.292344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:46.292837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:46.293286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:46.293987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:46.294448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:46.294886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:46.424440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:46.432681 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4da6c141-2ca0-4f4e-90d2-8be06c4b389d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.151897 Aug 30 18:24:46.433242 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3185/6636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:46 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:47.454004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:47.454622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:47.462488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.462904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.463337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.464046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.464491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.464912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.594629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:47.602877 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f2b4fe31-0e32-4908-8284-b993dde77ee2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.152800 Aug 30 18:24:47.603468 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3452/6637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:47 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:48.624922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:48.625488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:48.632829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.633319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.633758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.634449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.634908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.635340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.765520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:48.774254 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03baef49-77f8-4f25-8912-92309224cc5e tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.153409 Aug 30 18:24:48.774825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3186/6638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:48 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:49.795309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:49.795957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:49.798299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:49.803921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:49.804404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:49.804838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:49.805533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:49.805989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:49.806414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:49.940064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:49.948431 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0fa5712a-093b-48cb-af37-6eca258dbc38 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.157227 Aug 30 18:24:49.949017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3453/6639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:49 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:50.969159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:50.969786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:50.972510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:50.978882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.979372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.979852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:50.980558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.981022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.981457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:51.115568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:51.123584 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be1d5db4-cdcb-4c4f-ac19-07b31611e0c4 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.158310 Aug 30 18:24:51.124156 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3187/6640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:50 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:52.144661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:52.145827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:52.152772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.153249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.153718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.154408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.154858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.155281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.285391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:52.294276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e790f82f-1adc-45f5-9d32-ccc9ef4297f3 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.153527 Aug 30 18:24:52.294873 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3454/6641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:52 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:53.318199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:53.318826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:53.325858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.326353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.326801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.327525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.327990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.328429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.459759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:53.467643 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9c8d8bd3-bcc8-44dc-a801-c0d80420e99b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.153346 Aug 30 18:24:53.468219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3188/6642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:53 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:54.488622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:54.489769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:54.497077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:54.497584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:54.498024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:54.498716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:54.499170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:54.499648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:54.637979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:54.645779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-65d71be6-d421-4a87-a6da-a97c865ffc71 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.161094 Aug 30 18:24:54.646602 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3455/6643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:54 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:55.667074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:55.667677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:55.674482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.675007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.675456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.676214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.676677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.677116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.810471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:55.818679 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8c45c2e-c933-40e6-a702-2b33bee0901f tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.155148 Aug 30 18:24:55.819352 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3189/6644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:55 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:56.840621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:56.841273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:56.848622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.849205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.850828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.851851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.852321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.852760 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.980039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:56.987745 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dad9ba60-99c4-4367-9614-b6c5a3dd43de tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.151078 Aug 30 18:24:56.988324 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3456/6645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:56 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:58.008811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:58.009434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:58.016636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:58.017127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:58.017570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:58.018266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:58.018726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:58.019164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:58.148025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:58.159799 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50abf7b5-3705-4d5a-87e1-9916cf319049 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.154931 Aug 30 18:24:58.160437 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3190/6646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:58 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:59.182412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:59.183020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:59.194899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.195385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.195846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.196553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.197006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.197434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.330077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.338133 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ff43196-99ef-42ed-91c3-8c706fa04f8a tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.160432 Aug 30 18:24:59.338711 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3457/6647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:59 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:00.359615 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:00.360285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:00.368112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.368614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.369065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.369773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.370240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.370684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.510428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:00.518266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-50f42ceb-7936-4b10-95ff-dd47fde09046 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.162525 Aug 30 18:25:00.518801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3191/6648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:00 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:01.539295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:01.539880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:01.546728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:01.547213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:01.547691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.548386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:01.548844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:01.549275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.681971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.689810 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44ddbe46-5e9e-4820-a462-1184805aabed tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1519 microversion: 2.1 time: 0.155245 Aug 30 18:25:01.690395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3458/6649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:01 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:02.347157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "name": "network-vif-unplugged", "status": "completed", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:02.360738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.361236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.361689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.373863 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Creating event network-vif-unplugged:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h1-852771-11 Aug 30 18:25:02.379623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:25:02.391578 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-55a59618-cc01-49b7-913a-803715835670 req-d5bf77a7-13be-4a8a-8c7b-a92185f9c334 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048102 Aug 30 18:25:02.392146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3192/6650] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:02.710806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:02.711458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:02.720704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.721490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.721950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.722672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.723140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.723767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.870526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:02.878622 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a59a8d65-63ea-4661-abb1-2395e8d69211 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1518 microversion: 2.1 time: 0.172079 Aug 30 18:25:02.879233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3459/6651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:02 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:03.902012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:03.902721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:03.908877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:03.909365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:03.909810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:03.910508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:03.910962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:03.911394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:04.043700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:04.051473 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bd8ec906-a362-4143-b525-2286f91412c2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1516 microversion: 2.1 time: 0.154783 Aug 30 18:25:04.052059 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3193/6652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:03 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:04.419564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:04.430199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:04.430679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:04.431112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:04.442591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Creating event network-changed:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h1-852771-11 Aug 30 18:25:04.448979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:25:04.460426 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e093f9d4-073a-4680-9c45-7a7d5aad9848 req-07c7af42-971a-4dc8-b91c-d46292cc74cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043805 Aug 30 18:25:04.461226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3460/6653] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:05.074554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.075106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.082076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.082573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.083220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.084277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.084882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.085672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.088637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=82 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:05.347070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:05.355713 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f87f0e42-fcec-4d37-a8e3-4a7b28ad247b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1513 microversion: 2.1 time: 0.285228 Aug 30 18:25:05.356288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3194/6654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:05.377620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:05.378245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.384597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.385077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.385518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.386200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.386645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.387064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.451332 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6e87c7ac-50ac-4882-a799-a3dabc42d6ad tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "POST /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9/action" status: 204 len: 0 microversion: 2.1 time: 0.077696 Aug 30 18:25:05.452164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3461/6655] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:25:05 2022] POST /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:25:05.460285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.461017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.467192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.467808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.468257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.469045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.469510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.469943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.679206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:05.687165 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06ad7886-4323-4ac9-9fcf-1af8ee8cb0d8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1513 microversion: 2.1 time: 0.230782 Aug 30 18:25:05.687790 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3195/6656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:06.709249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:06.710018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:06.717321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:06.717797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:06.718388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:06.719079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:06.719590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:06.720189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:06.869964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:06.877974 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d720c825-3ced-40b4-a6ef-6ba4f56897b2 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1505 microversion: 2.1 time: 0.173048 Aug 30 18:25:06.878593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3462/6657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:06 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:06.898234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:06.898994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:06.905996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:06.906672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:06.907123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:06.908063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:06.908528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:06.908995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.042122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:07.049826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-708588b1-f57b-47e9-8ce3-1403b45d0552 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1505 microversion: 2.1 time: 0.155794 Aug 30 18:25:07.050407 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3196/6658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:06 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:07.070544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:07.071164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:07.077199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.077711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.078149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.078838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.079295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.079777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.207464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:07.216076 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f28d906c-654f-407a-8f5e-975d7f5f85bf tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1505 microversion: 2.1 time: 0.149725 Aug 30 18:25:07.216690 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3463/6659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:07 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:07.236506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:07.237016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:07.243274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.243809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.244262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.244958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.245419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.245855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.270758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:07.348594 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df46e991-37ba-4542-8779-cb3f075d904d tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 204 len: 0 microversion: 2.1 time: 0.115517 Aug 30 18:25:07.349770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3197/6660] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:07 2022] DELETE /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:25:07.366462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:07.366968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:07.373011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.373495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.373938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.374975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.375289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.375928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.401932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:07.445839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:07.449536 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.compute.api [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Instance is already in deleting state, ignoring this request Aug 30 18:25:07.450369 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4ed08d7b-b0fe-4813-b33a-6a589cc108a8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 204 len: 0 microversion: 2.1 time: 0.088322 Aug 30 18:25:07.450948 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3464/6661] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:07 2022] DELETE /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:25:07.460114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:07.460992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:07.466815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.467303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.467783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.468477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.468934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.469369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.598376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:07.606418 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-41d16c61-2e26-4c89-8928-a39a651c403b tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1511 microversion: 2.1 time: 0.151067 Aug 30 18:25:07.606931 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3198/6662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:07 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:08.548531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "name": "network-vif-plugged", "status": "completed", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:08.561159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.561728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.562167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.574161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] Creating event network-vif-plugged:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h1-852771-11 Aug 30 18:25:08.579207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a498bf1a-de44-4c56-99f2-a3b3955d6bbc req-8cc60f87-4d24-4c48-96f9-8f4ce52a0042 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Aug 30 18:25:08.579923 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3465/6663] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:08.627675 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:08.628312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:08.635700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.636203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.636655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.637363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.637835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.638277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.875171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd978c360a9274ebfbf52dd55d78fee87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6140ef879694a33b8ae4eab79d8486e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:08.883138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9dc7d46-631e-4ef7-91be-ce82e94258e8 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 200 len: 1511 microversion: 2.1 time: 0.259416 Aug 30 18:25:08.883848 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3199/6664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:08 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:09.199385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f298ae99-5d3a-40af-9783-2c0ddf0664f9", "name": "network-vif-deleted", "tag": "58d13fe6-01f3-4243-a84e-014e08c8c6a3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:09.211198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:09.211718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:09.212357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:09.224356 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] Creating event network-vif-deleted:58d13fe6-01f3-4243-a84e-014e08c8c6a3 for instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 on n-h1-852771-11 Aug 30 18:25:09.230344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-db5227b2-f7ad-4abf-bbf7-8b05410924ce req-e12a504b-5abc-4244-afe0-a1109c412d1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Aug 30 18:25:09.231164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3466/6665] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:09.904023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:09.904661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: f298ae99-5d3a-40af-9783-2c0ddf0664f9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:09.911510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:09.912016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:09.912960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:09.913667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:09.914134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:09.914576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:09.928183 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] HTTP exception thrown: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Request method failure captured: Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 HTTP/1.1 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlWn8lQc9N2CejrV-yELi-jE7BklV2D4op9BKTGUx3f-cV7jj_udzYpFCSn-6YUyW4GTvtVCsmTMVcvP69v0d6G4MqvT1yE7WLPS0ncZ8wvVCVumqDtBH7jKGJNRI5tKSNgVbNURvvdzZkUrQq-A5WOb5v1n_Thl6GpoGUbiMdvMPuc Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6140ef879694a33b8ae4eab79d8486e"}]}] Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d978c360a9274ebfbf52dd55d78fee87 Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'f298ae99-5d3a-40af-9783-2c0ddf0664f9'} Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:09.930381 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Returning 404 to user: Instance f298ae99-5d3a-40af-9783-2c0ddf0664f9 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9e1b38a-1166-4ed6-949b-96fe872d9229 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9" status: 404 len: 111 microversion: 2.1 time: 0.031719 Aug 30 18:25:09.934431 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3200/6666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:09 2022] GET /compute/v2.1/servers/f298ae99-5d3a-40af-9783-2c0ddf0664f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:09.941815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-87da724f-ffa2-4c0c-88e3-6f3edc1605fc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '.version_select at 0x7f2d988a3670>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:09.964624 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-87da724f-ffa2-4c0c-88e3-6f3edc1605fc tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944673400" status: 202 len: 0 microversion: 2.1 time: 0.027772 Aug 30 18:25:09.965202 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3467/6667] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 18:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944673400 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:25:10.563680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:10.564206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:10.571131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.571663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.572137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.572830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.573302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.573780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.587938 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] HTTP exception thrown: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Request method failure captured: Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 HTTP/1.1 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlWn8lQc9N2CejrV-yELi-jE7BklV2D4op9BKTGUx3f-cV7jj_udzYpFCSn-6YUyW4GTvtVCsmTMVcvP69v0d6G4MqvT1yE7WLPS0ncZ8wvVCVumqDtBH7jKGJNRI5tKSNgVbNURvvdzZkUrQq-A5WOb5v1n_Thl6GpoGUbiMdvMPuc Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6140ef879694a33b8ae4eab79d8486e"}]}] Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: d978c360a9274ebfbf52dd55d78fee87 Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '39c624f5-11ab-4bd0-ab9e-34d507c07771'} Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:10.589489 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Returning 404 to user: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c50cfb78-b8d5-44c2-a20d-fa637f82c672 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "DELETE /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 404 len: 111 microversion: 2.1 time: 0.031222 Aug 30 18:25:10.593617 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3201/6668] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:10 2022] DELETE /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:10.599566 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:10.600342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] [instance: 39c624f5-11ab-4bd0-ab9e-34d507c07771] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:10.607057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.607571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.608019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.608714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.609180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.609608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.622974 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] HTTP exception thrown: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Request method failure captured: Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 HTTP/1.1 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlWn8lQc9N2CejrV-yELi-jE7BklV2D4op9BKTGUx3f-cV7jj_udzYpFCSn-6YUyW4GTvtVCsmTMVcvP69v0d6G4MqvT1yE7WLPS0ncZ8wvVCVumqDtBH7jKGJNRI5tKSNgVbNURvvdzZkUrQq-A5WOb5v1n_Thl6GpoGUbiMdvMPuc Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f6140ef879694a33b8ae4eab79d8486e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f6140ef879694a33b8ae4eab79d8486e"}]}] Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f6140ef879694a33b8ae4eab79d8486e Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-572083042 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: d978c360a9274ebfbf52dd55d78fee87 Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerDiskConfigTestJSON-572083042-project Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '39c624f5-11ab-4bd0-ab9e-34d507c07771'} Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:10.624631 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] Returning 404 to user: Instance 39c624f5-11ab-4bd0-ab9e-34d507c07771 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c468b891-c8a1-4296-87f3-c993cc3d8926 tempest-ServerDiskConfigTestJSON-572083042 tempest-ServerDiskConfigTestJSON-572083042-project] 10.222.0.50 "GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771" status: 404 len: 111 microversion: 2.1 time: 0.030518 Aug 30 18:25:10.628135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3468/6669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:10 2022] GET /compute/v2.1/servers/39c624f5-11ab-4bd0-ab9e-34d507c07771 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:19.389646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c150e775-d738-42ec-acf2-d51222fd7f4f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: .version_select at 0x7f2d904bfaf0>, body: {"keypair": {"name": "tempest-keypair-1529437540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwrlz7xoUns4tpJ4B+FIQNDSPuL1zRePMPoH0YyKldR2OlxiWohBNNqzjiKR5GCJjOqxEOQwmCAjxziTm4RT34dJB6SNO2KDQeSPuXxziGnBXjdz3xO6nTWbD39dFbZxg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:19.409256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c150e775-d738-42ec-acf2-d51222fd7f4f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:19.415365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c150e775-d738-42ec-acf2-d51222fd7f4f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:19.446258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c150e775-d738-42ec-acf2-d51222fd7f4f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198997 Aug 30 18:25:19.446730 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3202/6670] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:25:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:20.706828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2029157382", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56e15158-439e-4f1d-951b-4bc5bd2f162a"}], "security_groups": [{"name": "tempest-securitygroup--2093230343"}], "key_name": "tempest-keypair-1529437540", "user_data": "}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:20.717601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:20.718256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:20.822855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] validate_networks() for [('56e15158-439e-4f1d-951b-4bc5bd2f162a', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:25:21.586694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:25:21.587252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:25:21.587794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:25:21.588331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:25:21.588751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:25:21.600136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:21.600617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:21.601055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:21.601787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:21.602244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:21.602674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:21.625516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:21.631649 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:21.645042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:25:21.647621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:25:21.707196 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6a9f7023-499c-4791-9707-ac771d4cc6ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.005817 Aug 30 18:25:21.708910 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3469/6671] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:25:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:25:21.720006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-568599e6-d4d0-41bc-95f7-6dc8b73ed2ab tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:21.721262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-568599e6-d4d0-41bc-95f7-6dc8b73ed2ab tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:21.730073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:21.731358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:21.795205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-568599e6-d4d0-41bc-95f7-6dc8b73ed2ab tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:21.804685 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-568599e6-d4d0-41bc-95f7-6dc8b73ed2ab tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1239 microversion: 2.1 time: 0.088770 Aug 30 18:25:21.805320 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3203/6672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:21 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:22.826750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:22.828163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:22.835116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.835821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.836426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.837275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.837874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.838444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.916132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.924084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88d18463-a450-492a-b8a6-4448227bcd5b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1309 microversion: 2.1 time: 0.102784 Aug 30 18:25:22.924677 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3470/6673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:22 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:23.946863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:23.947578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:23.954854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.955206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.955707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.956425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.956888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.957333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:24.155910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.164471 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3285b0d-4883-47a5-a454-5e04d006cc6f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1365 microversion: 2.1 time: 0.222307 Aug 30 18:25:24.165260 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3204/6674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:23 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:24.183635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:24.195236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:24.195752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:24.196195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:24.207697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] Creating event network-changed:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h1-852771-11 Aug 30 18:25:24.225230 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f9cf2226-ab59-49c2-bb25-92962b39c007 req-c7ccf09f-3578-4454-b693-ec410b24c63c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Aug 30 18:25:24.225885 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3471/6675] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:25:25.187790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:25.188431 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:25.195809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.196311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.196760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.197474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.197943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.198380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.330300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:25.339205 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0773d6ef-3ac8-4530-9d7e-8f6f5f0718e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1365 microversion: 2.1 time: 0.157452 Aug 30 18:25:25.339827 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3205/6676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:25 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:26.363104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:26.363841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:26.371119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.371656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.372083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:26.372778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.373237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.373668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:26.504167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:26.512164 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5883a19d-e1f7-462c-ba2d-938d8c4868ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1365 microversion: 2.1 time: 0.155403 Aug 30 18:25:26.512763 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3472/6677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:26 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:27.532516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:27.533141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:27.540206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:27.540694 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:27.541140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:27.541832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:27.542292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:27.542727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:27.671290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:27.679837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92a82beb-8e14-4069-b03b-3507d0f4a9af tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1365 microversion: 2.1 time: 0.151161 Aug 30 18:25:27.680436 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3206/6678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:27 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:28.584594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "name": "network-vif-plugged", "status": "completed", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:28.595345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.595853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.596515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.607821 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] Creating event network-vif-plugged:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h1-852771-11 Aug 30 18:25:28.612868 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b38c9fcd-da80-4338-9328-f709a4c83c94 req-af569246-e122-475b-a6d6-4c7e847c32f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Aug 30 18:25:28.613467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3473/6679] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:28.700596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:28.701230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:28.708226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.708748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.709735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.710447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.710922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.711362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.853548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:28.861417 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ae7ac05e-2e91-402d-be7d-f97e57e345f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1365 microversion: 2.1 time: 0.164804 Aug 30 18:25:28.861993 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3207/6680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:28 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:29.884448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:29.885152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:29.891318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.891838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.892291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.892987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.893438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.893863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.027467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:30.036517 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bce00369-83de-4611-b4b2-bd2eef30ae26 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1553 microversion: 2.1 time: 0.157339 Aug 30 18:25:30.041403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3474/6681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:29 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:30.057840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:30.058350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:30.065471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.065967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.066445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.067142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.067633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.068095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.151729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eee12f4a-a559-4a20-a300-591e806e8353 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098714 Aug 30 18:25:30.152333 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3208/6682] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 18:25:30 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:31.186104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:31.198419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:31.199182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:31.199910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:31.211571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] Creating event network-changed:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h1-852771-11 Aug 30 18:25:31.216587 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6adc49e6-b995-4b7d-8839-acf48f38362a req-02859768-0c66-4686-8edf-96196344cfd6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090493 Aug 30 18:25:31.217216 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3475/6683] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:07.367508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.369114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=13 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.369806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=28 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.374488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:07.375126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.385740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.386242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.386699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.387418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.387921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.388371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.522043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.530718 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bfaab95f-e52a-489c-ae45-a52a49abba18 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.165323 Aug 30 18:26:07.531336 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3209/6684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:07 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:07.548391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.549185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.551109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.551825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=26 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:07.557313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:07.558011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.568459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.568938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.569376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.570060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.570507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.570929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.702401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.710137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34803406-26a1-49da-8c6a-81191f09800b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.162735 Aug 30 18:26:07.710720 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3476/6685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:07 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:07.731392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:07.732080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.738035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.738530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.738981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.739714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.740178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.740617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.869690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.877949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-246ebc2a-d409-4ddc-bfa4-d1d496717145 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.151228 Aug 30 18:26:07.878523 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3210/6686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:07 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:07.898060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:07.900936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.906920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.907404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.907872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.908563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.909017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.909444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.940491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.946628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:26:07.953136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:26:07.953561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:26:07.954038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:26:07.954479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:26:07.954889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:26:08.017885 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8e760777-3fc6-4d7a-a067-f765585956f2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/action" status: 202 len: 0 microversion: 2.1 time: 0.123758 Aug 30 18:26:08.018518 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3477/6687] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:26:07 2022] POST /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:26:08.027663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:08.028302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:08.034208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:08.034750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:08.035271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.036032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:08.036503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:08.036945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.181642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:08.189618 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-67a229e8-8dea-4dc2-890e-d60bf2a387bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1681 microversion: 2.1 time: 0.166831 Aug 30 18:26:08.190219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3211/6688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:08 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:09.213397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:09.214054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:09.220119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:09.220600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:09.221035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:09.221718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:09.222168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:09.222589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:09.361970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:09.370542 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dad0a5e5-1db9-4e60-a095-9dc89a84b0e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1681 microversion: 2.1 time: 0.162679 Aug 30 18:26:09.371161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3478/6689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:09 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:10.391981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.392671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:10.399517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.399998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.400441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.401131 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.401593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.402028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.531456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:10.539236 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f8a2c4c-1575-4226-88bf-301c243ff8d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.151184 Aug 30 18:26:10.540347 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3212/6690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:10 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:11.561764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:11.562381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:11.569211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.569698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.570138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:11.570832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.571970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.572412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:11.704183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:11.712152 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-921c854e-cccc-4e0b-9296-fe252d04891a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.154344 Aug 30 18:26:11.712744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3479/6691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:11 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:12.733863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:12.734518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:12.741269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:12.742008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:12.742455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:12.743174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:12.743667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:12.744106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:12.877657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:12.885682 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be482014-ad9d-4d79-a9ca-2ba86294e71d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.155803 Aug 30 18:26:12.886248 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3213/6692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:12 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:13.906793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:13.907411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:13.914229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:13.915219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:13.915694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:13.916397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:13.916858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:13.917289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:14.053489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:14.062022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec1dcca3-5267-4b7e-8c53-92400548a630 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.159230 Aug 30 18:26:14.062604 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3480/6693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:13 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:15.083054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:15.083705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:15.090387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.090878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.091319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.092045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.092510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.092941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.224371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:15.233016 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-015fc5ae-305d-4f79-a780-a42ac6e444df tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.153875 Aug 30 18:26:15.233595 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3214/6694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:15 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:16.254204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:16.254844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:16.262448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.262943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.263395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:16.264379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.264878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.265312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:16.399695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:16.407555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8504f99-a8a1-4ee1-9f1b-92809ec26177 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.157256 Aug 30 18:26:16.408144 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3481/6695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:16 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:17.429275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:17.429944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:17.436408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:17.436909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:17.437364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:17.438074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:17.438546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:17.438992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:17.570673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:17.578911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66c73723-6155-48bf-b6ed-688e4e0afd48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.153564 Aug 30 18:26:17.579499 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3215/6696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:17 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:18.600860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:18.601406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:18.608733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.609218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.609659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.610351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.610805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.611234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.747581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:18.755264 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-313be03f-2f0c-4584-9436-e7aac1566230 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.158583 Aug 30 18:26:18.755872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3482/6697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:18 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:19.780893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:19.781879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:19.789072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.790195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.790638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.791339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.791834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.792274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.922632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.931026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9ede4c3e-4f85-4542-aab2-f3b81fbc674f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.157350 Aug 30 18:26:19.931804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3216/6698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:19 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:20.953102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:20.953722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:20.960548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.961038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.961478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.962207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.962658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.963086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:21.096227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:21.103964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1d9d956-b935-4c0b-aa72-f79f82c7527b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1686 microversion: 2.1 time: 0.154802 Aug 30 18:26:21.104538 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3483/6699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:20 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:22.124797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:22.125698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:22.129936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "name": "network-vif-unplugged", "status": "completed", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:22.133879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.134387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.135055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.136054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.136521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.136963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.140630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.140995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.141433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.155340 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Creating event network-vif-unplugged:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h2-852771-11 Aug 30 18:26:22.161160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:26:22.174217 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-af9a1f33-234f-43d0-ab9b-db9eec8c7fa9 req-97af32ec-e652-443e-82e3-05c535b2966d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048867 Aug 30 18:26:22.174935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3484/6700] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:22.407039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:22.415157 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afde4c69-230d-4efa-a0a3-7f93a0728a05 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1685 microversion: 2.1 time: 0.294595 Aug 30 18:26:22.415874 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3217/6701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:22 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1685 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:23.439008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:23.439645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:23.446011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:23.446626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:23.447172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:23.447902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:23.448355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:23.448776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:23.586779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:23.594957 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1bfebf04-71d6-416a-ae58-2941c23ec356 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1683 microversion: 2.1 time: 0.161202 Aug 30 18:26:23.595574 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3485/6702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:23 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:24.190318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:24.201375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.201860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.202301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.217329 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Creating event network-changed:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h2-852771-11 Aug 30 18:26:24.222599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:26:24.233845 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8a6de14d-fd68-4768-a451-4a5df1840680 req-13e08547-e43f-4b90-a4ed-e75cd0b74fb9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047152 Aug 30 18:26:24.234411 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3218/6703] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:24.617126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:24.618329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:24.625259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.625750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.626198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.626913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.627371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.627836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.766982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:24.775600 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88519878-29b1-46e4-b6d2-f73220e6c3f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1683 microversion: 2.1 time: 0.162625 Aug 30 18:26:24.776690 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3486/6704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:24 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:25.804743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:25.806115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:25.814069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.814585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.815044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.815802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.816279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.816719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.953444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:25.961214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3946433a-135b-44d3-84fa-c9f5a9b7fc03 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1680 microversion: 2.1 time: 0.160802 Aug 30 18:26:25.961818 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3219/6705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:25 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:25.981533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:25.982129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:25.988884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.989370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.989806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.990500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.990954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.991797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.050856 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fc4f3e20-8e84-4dd4-807f-f3e5f90717ed tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/action" status: 204 len: 0 microversion: 2.1 time: 0.073122 Aug 30 18:26:26.051467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3487/6706] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:26:25 2022] POST /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:26:26.060105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:26.061121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:26.075402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.076030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.076480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.077199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.077658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.078094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.307653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:26.315437 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b96ab87a-4198-4b84-8f77-2acd690c938c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1680 microversion: 2.1 time: 0.259249 Aug 30 18:26:26.316050 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3220/6707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:26 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:27.338563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.339395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.345593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.346091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.346534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.347238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.347724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.348156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.485882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.494615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-106e1a9f-6bb2-4efc-a879-02291acb7473 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.161897 Aug 30 18:26:27.495194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3488/6708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:27 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:27.514754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.515376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.522284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.522774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.523387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.524149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.524611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.525046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.655286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.663889 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31e48aab-9395-41e0-9d47-081efd2303f7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.153050 Aug 30 18:26:27.665079 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3221/6709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:27 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:27.685023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.685650 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.691918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.692407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.693035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.693743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.694200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.694632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.781040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "name": "network-vif-plugged", "status": "completed", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:27.793102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.793681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.794223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.809742 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] Creating event network-vif-plugged:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h2-852771-11 Aug 30 18:26:27.815408 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-98ee0333-8906-4e0b-a08b-f50a3b31e87e req-e0b4a0ac-777d-4c81-a401-d010994d076b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038528 Aug 30 18:26:27.816583 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3222/6710] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:27.837257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.844965 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3fbca688-4353-4db0-ac29-e168e9cc4dfc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1672 microversion: 2.1 time: 0.163893 Aug 30 18:26:27.845548 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3489/6711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:27 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:27.866055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.866953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.873284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.873796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.874370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.875123 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.875609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.876046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.901489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:26:27.975988 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c389d7d7-6033-4137-99f3-689476a44828 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 204 len: 0 microversion: 2.1 time: 0.113719 Aug 30 18:26:27.976488 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3223/6712] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:26:27 2022] DELETE /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:26:27.985396 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.986032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.992136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.992646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.993078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.993763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.994216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.994639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:28.009987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:28.126875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:28.135439 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fb95aa0-09d0-4812-b6b2-18dbd1af7b2e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1678 microversion: 2.1 time: 0.153921 Aug 30 18:26:28.136045 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3490/6713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:27 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:29.157066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:29.157706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:29.165082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:29.165574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:29.166017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:29.166712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:29.167171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:29.167625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:29.366908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:29.371047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:29.376725 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dff701b3-6bf3-4ed4-abca-9bbe229d700d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 200 len: 1678 microversion: 2.1 time: 0.223976 Aug 30 18:26:29.377321 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3224/6714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:29 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:30.122112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46567c13-7be5-4ac9-b050-3fc04d0b42d9", "name": "network-vif-deleted", "tag": "d134c42d-c6ac-4ff0-9e2c-0821e9beb081"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:30.132869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.133966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.134543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.146574 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] Creating event network-vif-deleted:d134c42d-c6ac-4ff0-9e2c-0821e9beb081 for instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 on n-h2-852771-11 Aug 30 18:26:30.152018 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4ce36dbe-22aa-4d43-a8f3-619e16e15859 req-e759f07e-56ed-4dcc-bf22-f673c5e022cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034114 Aug 30 18:26:30.152830 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3491/6715] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:30.399571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:30.400321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:30.407923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.408490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.409005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.409776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.410306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.410808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.425810 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 HTTP/1.1 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '46567c13-7be5-4ac9-b050-3fc04d0b42d9'} Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:30.427614 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86f8aeb2-f221-4df5-b886-46207f537196 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 404 len: 111 microversion: 2.1 time: 0.035145 Aug 30 18:26:30.435152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3225/6716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:30 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:30.444611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:30.445251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:30.451542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.452025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.452458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.453148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.453600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.454030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.467393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 HTTP/1.1 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '46567c13-7be5-4ac9-b050-3fc04d0b42d9'} Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:30.469115 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d1a9c199-399b-470f-b0d2-4edfc47d2471 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 30 18:26:30.472571 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3492/6717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:30 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:30.521581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-453389350", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "56e15158-439e-4f1d-951b-4bc5bd2f162a"}], "security_groups": [{"name": "tempest-securitygroup--2093230343"}], "key_name": "tempest-keypair-1529437540", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:30.631750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] validate_networks() for [('56e15158-439e-4f1d-951b-4bc5bd2f162a', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:26:31.027009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:26:31.027843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:26:31.028334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:26:31.029660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:26:31.029660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:26:31.040730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.041233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.049112 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.049943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.051737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.052210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.075242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:26:31.080770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:26:31.098185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:26:31.100953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:26:31.150691 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11889d49-72c9-4903-9a97-1bb87deeada1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.633001 Aug 30 18:26:31.151646 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3226/6718] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:26:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:26:31.163981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fcf6645f-b20a-4100-ad67-65907fc397c0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:31.165786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fcf6645f-b20a-4100-ad67-65907fc397c0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:31.228332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fcf6645f-b20a-4100-ad67-65907fc397c0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:31.236898 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fcf6645f-b20a-4100-ad67-65907fc397c0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1238 microversion: 2.1 time: 0.076968 Aug 30 18:26:31.237566 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3493/6719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:31 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:32.260748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:32.261463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:32.269616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:32.270202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:32.270741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:32.271560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:32.272546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:32.273080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:32.356483 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:32.364348 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3123990a-e8a0-4faa-bb6b-e60dc633d456 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1308 microversion: 2.1 time: 0.109640 Aug 30 18:26:32.364932 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3227/6720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:32 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:33.387329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:33.387986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:33.395034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:33.395552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:33.395998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:33.396701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:33.397161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:33.397590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:33.488319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:33.502558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:33.503989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:33.504585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:33.518861 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] Creating event network-changed:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h1-852771-11 Aug 30 18:26:33.525348 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-262186a3-80a3-4df8-9f94-29e932b2fc77 req-3a952256-b2a0-44b0-be5a-5041f9fc9d12 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040651 Aug 30 18:26:33.526580 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3228/6721] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:33.553736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:33.560964 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5e43973b-505e-4ccc-a8b5-9b4a8f83a699 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.178069 Aug 30 18:26:33.561425 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3494/6722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:33 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:34.584094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:34.584804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:34.591032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:34.591560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:34.592010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:34.592702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:34.593196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:34.593626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:34.726583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:34.734478 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-526e5503-1341-47dc-a984-6fff581adcb1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.155557 Aug 30 18:26:34.735059 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3229/6723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:34 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:35.756459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:35.756998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:35.764094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.764580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.765023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:35.765712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.766173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.766600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:35.893228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:35.901780 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b19f934-effd-49b3-b6f3-f0d7d8bf2300 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.149516 Aug 30 18:26:35.902355 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3495/6724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:35 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:36.923448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:36.924132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:36.931113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:36.931653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:36.932100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:36.932804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:36.933263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:36.933693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:37.066133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:37.074559 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5cdfe0d2-35b5-4bb1-89de-3b642d737726 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.156077 Aug 30 18:26:37.075154 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3230/6725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:36 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:38.096759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:38.097368 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:38.100280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=47 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:38.106294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:38.106777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:38.107214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:38.107939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:38.108395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:38.108820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:38.247506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:38.255239 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d03cfe4-3c15-4daf-ace8-5ff8de13e583 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.162434 Aug 30 18:26:38.255847 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3496/6726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:38 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:38.896339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "name": "network-vif-plugged", "status": "completed", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:38.903631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:38.910365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:38.910888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:38.911352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:38.924856 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] Creating event network-vif-plugged:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h1-852771-11 Aug 30 18:26:38.930561 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3adb97ec-9fd0-4f42-ae38-7eab4b4adff0 req-1cb4b28a-88d6-4d5e-8e2c-16579adf9ed3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037270 Aug 30 18:26:38.931179 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3231/6727] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:39.276882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.277503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.284344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.284825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.285258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.285945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.286392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.286812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.417319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:39.425022 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f94d9f5c-909c-4b15-b7ca-3053896f4490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1364 microversion: 2.1 time: 0.152218 Aug 30 18:26:39.425598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3497/6728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:39 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:40.447851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:40.448600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:40.456232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.456732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.457189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.457905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.458369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.458803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.599146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:40.607258 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a0fe7e9-e453-4d71-85de-c357f9edb8a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1551 microversion: 2.1 time: 0.164611 Aug 30 18:26:40.607890 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3232/6729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:40 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:40.629316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:40.629883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:40.640312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.640892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.641408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.642188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.642720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.643159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.728222 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-198c4939-c5a2-4efa-9f19-834b0795369d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102482 Aug 30 18:26:40.728982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3498/6730] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 18:26:40 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:41.687594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:41.692505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:41.693658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:41.701888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:41.702488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:41.702944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:41.715037 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] Creating event network-changed:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h1-852771-11 Aug 30 18:26:41.720135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-bcd501da-bb0b-473b-9ed4-aac90c9a90ae req-d93f238d-438f-4b9c-931a-9b7e8bb2e4fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036321 Aug 30 18:26:41.720925 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3233/6731] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:14.620815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:14.622758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:14.623391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=35 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:14.627615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:14.634892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:14.635451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:14.635932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:14.658088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Going to try to stop instance {{(pid=122124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:27:14.700043 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-511eba80-c349-4430-9a7f-d618595dd84e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action" status: 202 len: 0 microversion: 2.1 time: 0.080448 Aug 30 18:27:14.700655 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3499/6732] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:14 2022] POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:14.709587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:14.710301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:14.714189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:14.715172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=34 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:14.719815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:14.720571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:14.721034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:14.721751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:14.722225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:14.722663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:14.861989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:14.870095 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e69a123-ae7d-46cd-8934-71880c9dbe11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.164891 Aug 30 18:27:14.870677 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3234/6733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:14 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:15.893194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:15.893809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:15.899960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:15.900436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:15.900871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:15.901546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:15.901986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:15.902405 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:16.035901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:16.044396 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-accf8436-a428-47da-83d4-f6fd4a128c71 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.156388 Aug 30 18:27:16.044971 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3500/6734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:15 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:17.066569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:17.067188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:17.073290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:17.073789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:17.074231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:17.074926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:17.075419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:17.075880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:17.204248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:17.212209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-31e32fa8-5625-4674-9ec8-57a1e5953ad6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.150096 Aug 30 18:27:17.213008 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3235/6735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:17 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:18.236644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:18.237263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:18.240318 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:27:18.240470 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 (ip 10.222.0.50) !!! Aug 30 18:27:18.247776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:18.248262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:18.248701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:18.249403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:18.249860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:18.250284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:18.381420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:18.390444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca7a4a7f-1c60-407b-acc2-bd90094a4371 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.157927 Aug 30 18:27:18.391018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3501/6736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:18 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:19.412494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:19.413126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:19.421156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:19.421654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:19.422106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:19.422816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:19.423284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:19.423754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:19.564058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:19.571900 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3a4fc5bd-42ad-44ab-9e1f-43cef563c49d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.163310 Aug 30 18:27:19.572480 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3236/6737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:19 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:20.594667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:20.595284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:20.602106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:20.602590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:20.603030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:20.603754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:20.604221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:20.604769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:20.738007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:20.746796 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3f1e4037-63df-4a9a-9e2b-a3355779054a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.156099 Aug 30 18:27:20.747384 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3502/6738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:20 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:21.767919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:21.768543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:21.775295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:21.775813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:21.776258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:21.777038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:21.777438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:21.777874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:21.905257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:21.913018 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afdf3363-3c84-48d3-a912-ce2322c8056b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.149001 Aug 30 18:27:21.913594 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3237/6739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:21 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:22.935281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:22.935921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:22.942709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:22.943189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:22.943658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:22.944344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:22.944794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:22.945216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:23.073813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:23.081839 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c5dec57d-2e30-43ab-83bc-fbd125762695 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.151014 Aug 30 18:27:23.082414 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3503/6740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:22 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:24.102324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:24.102981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:24.110183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:24.110679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:24.111137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:24.111865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:24.112331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:24.112775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:24.246166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:24.255166 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fdb916cb-22da-4581-8f9f-405c2815d77c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.156740 Aug 30 18:27:24.255800 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3238/6741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:24 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:25.277629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:25.278295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:25.285415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.285901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.286349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.287028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.287506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.287917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.430786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:25.438656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83c45f07-2a0d-4d16-8944-4426f5ac32a9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1657 microversion: 2.1 time: 0.165203 Aug 30 18:27:25.439258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3504/6742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:25 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1657 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:25.459995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:25.462338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:25.470520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.471022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.471501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.472215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.472680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.473124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.505017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:25.511365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:27:25.517972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:27:25.518348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:27:25.518835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:27:25.519261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:27:25.519710 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:27:25.589685 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-92997ef5-d544-4c77-9c71-1d70e6026acf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action" status: 202 len: 0 microversion: 2.1 time: 0.134135 Aug 30 18:27:25.590474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3239/6743] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:25 2022] POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:27:25.598588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:25.599306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:25.606134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.606625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.607063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.607807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:25.608266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:25.608692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:25.767010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:25.775572 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-069ce41c-5107-424b-963f-1acfd94abf11 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.180993 Aug 30 18:27:25.776353 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3505/6744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:25 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:26.797426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:26.798062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:26.804926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:26.805517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:26.805976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:26.806700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:26.807173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:26.808397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:27.047054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:27.054923 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b66e4495-4525-40b2-b807-bd6326aa710f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1680 microversion: 2.1 time: 0.261450 Aug 30 18:27:27.055450 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3240/6745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:26 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:28.076503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:28.077114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:28.084026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:28.084503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:28.084931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:28.085616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:28.086065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:28.086487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:28.218670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:28.226386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-04cd660b-f3c9-4dcb-94c6-8bfe9ef3ea62 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1685 microversion: 2.1 time: 0.153911 Aug 30 18:27:28.226959 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3506/6746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:28 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:29.249151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:29.249955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:29.257132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:29.258080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:29.258715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:29.259445 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:29.260061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:29.260504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:29.595177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:29.603050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b3a9b5b-43bc-4f8a-8ee3-9cbb112bb0d9 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1685 microversion: 2.1 time: 0.358990 Aug 30 18:27:29.603850 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3241/6747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:29 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1685 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:30.296957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "name": "network-vif-unplugged", "status": "completed", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:30.308720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:30.309306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:30.309795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:30.322504 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Creating event network-vif-unplugged:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h2-852771-11 Aug 30 18:27:30.328319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] Instance bdf855da-f8bb-4661-92b0-f904089048b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:30.341403 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-fe44df86-c804-4dfd-b72a-85ef27ca8c3e req-98b3d489-4616-491d-a336-c72f7535de0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047907 Aug 30 18:27:30.342529 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3507/6748] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:30.625148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:30.625773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:30.632729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:30.633388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:30.633845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:30.634571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:30.635036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:30.635500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:30.894816 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:30.903376 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d28fa402-1f35-49f6-855f-70b50b648422 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1684 microversion: 2.1 time: 0.282141 Aug 30 18:27:30.904132 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3242/6749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:30 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1684 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:31.926879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:31.927611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:31.934196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:31.934686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:31.935121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:31.935850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:31.936303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:31.936721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:32.069458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:32.078216 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b48d278-7642-471c-9293-a45e42d28f81 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1682 microversion: 2.1 time: 0.156653 Aug 30 18:27:32.078807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3508/6750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:31 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:32.380964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:32.393326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:32.393820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:32.394266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:32.407713 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Creating event network-changed:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h2-852771-11 Aug 30 18:27:32.413179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] Instance bdf855da-f8bb-4661-92b0-f904089048b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:32.423900 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-15bcf17c-f2a2-430c-b7be-8b92679d2f6d req-7478fc2d-ec61-4c0b-81c2-1f72fe53ec63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046610 Aug 30 18:27:32.424516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3243/6751] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:33.100532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:33.101142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:33.108770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.109260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.109821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.110555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.111006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.111430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.252700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:33.260910 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36615405-37e7-49db-8ac3-3f4d077608ec tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1678 microversion: 2.1 time: 0.164241 Aug 30 18:27:33.262096 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3509/6752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:33 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:33.283927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:33.284572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:33.290798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.291298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.292593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.293447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.293921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.294364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.353312 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6cf90573-cf78-4265-899a-8d1e7f6dde65 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action" status: 204 len: 0 microversion: 2.1 time: 0.073382 Aug 30 18:27:33.353903 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3244/6753] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:33 2022] POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:27:33.363461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:33.364158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:33.370503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.371298 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.371857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.372913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.373371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.373933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.511846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:33.519769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b86480f8-eb0d-413e-a377-c6e5663244f5 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1678 microversion: 2.1 time: 0.160331 Aug 30 18:27:33.520347 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3510/6754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:33 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:34.542646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:34.543519 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:34.550644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.551141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.551798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.552514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.552988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.553564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.690757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:34.699195 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2312b03c-6b19-4b88-9715-d07e0f1ad2de tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1657 microversion: 2.1 time: 0.161480 Aug 30 18:27:34.699801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3245/6755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:34 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:34.720418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:34.721036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:34.727989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.728464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.728898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.729770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.730179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.730604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.861179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:34.869344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a63bb280-f741-4846-9716-e52a19702c53 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1657 microversion: 2.1 time: 0.152897 Aug 30 18:27:34.870429 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3511/6756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:34 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:34.890723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:34.896769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.897249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.897692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.923036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:27:34.965758 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-632957f8-25dc-420e-a975-ee1e694317f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action" status: 202 len: 0 microversion: 2.1 time: 0.078762 Aug 30 18:27:34.966387 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3246/6757] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:34 2022] POST /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:34.974546 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:34.975164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:34.981647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.982196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.982672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.983444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.983974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.984945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:35.128237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:35.136362 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2528f085-43d2-4de8-8e95-23c32758b14a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1666 microversion: 2.1 time: 0.165714 Aug 30 18:27:35.136952 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3512/6758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:34 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:35.955333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "name": "network-vif-plugged", "status": "completed", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:35.967335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:35.968037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:35.968665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.002919 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] Creating event network-vif-plugged:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h2-852771-11 Aug 30 18:27:36.008208 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-40787d13-7379-4128-bb00-5df4561dcf69 req-f39749d1-a05f-453a-93f5-e6f1059d1655 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057760 Aug 30 18:27:36.009100 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3247/6759] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:27:36.158227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:36.158858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:36.165508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.165985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.166419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.167106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.167591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.168015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.310830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:36.318823 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b98d4cfe-59c4-46db-8f3f-c063d3bcb30b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1670 microversion: 2.1 time: 0.164707 Aug 30 18:27:36.319411 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3513/6760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:36 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:36.340214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:36.340822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:36.347085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.347629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.348088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.348800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.349272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.349715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.353817 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:36.377636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:27:36.454300 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df7d07d0-c5d7-4e98-b490-a2038fc8d821 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 204 len: 0 microversion: 2.1 time: 0.117992 Aug 30 18:27:36.455265 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3248/6761] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:27:36 2022] DELETE /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:27:36.463177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:36.463897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:36.469860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.470342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.470780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.471463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:36.471940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:36.472366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:36.607736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:36.611371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:36.617037 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d09d865e-6735-475e-a473-0197bcc6b645 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1676 microversion: 2.1 time: 0.157477 Aug 30 18:27:36.617628 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3514/6762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:36 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:37.640824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:37.641449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:37.648274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:37.648768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:37.649210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:37.649942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:37.650400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:37.650836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:37.854766 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:37.862590 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ab77ca86-cdc0-4a3d-b539-39f7ca002970 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 200 len: 1676 microversion: 2.1 time: 0.226854 Aug 30 18:27:37.863170 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3249/6763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:37 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:38.595174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf855da-f8bb-4661-92b0-f904089048b7", "name": "network-vif-deleted", "tag": "f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:38.611172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.611690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.612510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.627854 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] Creating event network-vif-deleted:f28d7bb2-cb8f-45d8-b6a3-8ff8409d6aa0 for instance bdf855da-f8bb-4661-92b0-f904089048b7 on n-h2-852771-11 Aug 30 18:27:38.633636 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5915efcb-4e54-4bb0-aead-e67bebaee8ed req-25d68c37-0fab-4843-9bef-a8d0827b0ead service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044210 Aug 30 18:27:38.634448 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3515/6764] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:38.884902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:38.885847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:38.893349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.893850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.894306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.895015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.895503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.895948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.910988 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 HTTP/1.1 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bdf855da-f8bb-4661-92b0-f904089048b7'} Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:38.912811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:27:38.917290 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-edc92f58-497e-4846-a739-c9e3bc0de7fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 404 len: 111 microversion: 2.1 time: 0.033371 Aug 30 18:27:38.925449 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3250/6765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:38 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:27:38.931187 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:38.931942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:38.938545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.939104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.939503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.940197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.940664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.941092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.955243 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 HTTP/1.1 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bdf855da-f8bb-4661-92b0-f904089048b7'} Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:38.956966 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c8d2d77e-d7a2-47e0-b16a-ed67348ae22e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 30 18:27:38.961161 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3516/6766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:38 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:27:39.008884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1772312217", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "56e15158-439e-4f1d-951b-4bc5bd2f162a"}], "security_groups": [{"name": "tempest-securitygroup--2093230343"}], "key_name": "tempest-keypair-1529437540", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:39.117428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] validate_networks() for [('56e15158-439e-4f1d-951b-4bc5bd2f162a', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:27:39.807326 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:27:39.807808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:27:39.808296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:27:39.808721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:27:39.810315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:27:39.819188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:39.819732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:39.820172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:39.820917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:39.821394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:39.821834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:39.838941 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:39.844302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:39.857272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:27:39.859606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:27:39.911826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ef65a896-9b47-44e8-b5b1-1060dbe4cff7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.907175 Aug 30 18:27:39.912805 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3251/6767] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:27:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:27:39.924120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-342fa8c4-4c8a-44d7-bfa8-1019d6714b99 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:39.931158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-342fa8c4-4c8a-44d7-bfa8-1019d6714b99 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:39.989923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-342fa8c4-4c8a-44d7-bfa8-1019d6714b99 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:39.999777 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-342fa8c4-4c8a-44d7-bfa8-1019d6714b99 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1239 microversion: 2.1 time: 0.079488 Aug 30 18:27:40.000360 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3517/6768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:39 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:41.021498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:41.022139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:41.030857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.031354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.032067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.032783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.033248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.033681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.110929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:41.124543 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76828589-671a-479e-bb3c-c164c7ba6a1a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1299 microversion: 2.1 time: 0.107132 Aug 30 18:27:41.140279 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3252/6769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:41 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:42.149836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:42.150474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:42.158121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:42.158605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:42.159051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:42.159791 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:42.160254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:42.160688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:42.297638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:42.305916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c49e611d-79cc-4e60-828c-92eb51d22fca tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.161077 Aug 30 18:27:42.306507 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3518/6770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:42 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:42.381186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:42.393135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:42.393639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:42.394356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:42.410459 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] Creating event network-changed:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:27:42.415621 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-81b46a6a-0e3d-4484-9028-f01d01a0d50e req-30b82918-173e-4ff4-9b0b-86522fcadaf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038237 Aug 30 18:27:42.416243 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3253/6771] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:43.328670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:43.329410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:43.336557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.337049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.337488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.338186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.338642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.339072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.475371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:43.483388 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b8fbf339-213c-41c0-9065-fccc55ef3ffa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.159334 Aug 30 18:27:43.484002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3519/6772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:43 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:44.506202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:44.506911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:44.513150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:44.513636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:44.514079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:44.514836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:44.515240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:44.515707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:44.649215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:44.657571 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-013d6fae-9fa7-4d73-b0cc-e9be5f5ab78b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.156477 Aug 30 18:27:44.658152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3254/6773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:44 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:45.679773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:45.680868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:45.683576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=45 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:45.689687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:45.690178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:45.690616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:45.691320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:45.691806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:45.692235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:45.835472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:45.843645 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82f2306f-c65a-4364-ba14-98bfcdcc6d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.167845 Aug 30 18:27:45.844220 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3520/6774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:45 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:46.866775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:46.867426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:46.869533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:46.875848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:46.876340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:46.876787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:46.877489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:46.877951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:46.878384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:47.007887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:47.015861 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5502fc4d-4fc5-4505-acaf-407c01a879ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.153561 Aug 30 18:27:47.016439 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3255/6775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:46 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:47.306012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "name": "network-vif-plugged", "status": "completed", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:47.316662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:47.317146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:47.317572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:47.329467 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] Creating event network-vif-plugged:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:27:47.334482 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8f373a88-4178-4caf-be2b-c0a91202aa10 req-60c8179d-b721-4889-ab3f-d4d461e7d8ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Aug 30 18:27:47.335102 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3521/6776] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:48.037052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:48.037652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:48.045331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:48.045858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:48.046310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:48.047014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:48.047532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:48.047974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:48.176997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:48.185710 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ef2e7a5e-2bd8-42cb-ae7c-181f61491c74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1365 microversion: 2.1 time: 0.152746 Aug 30 18:27:48.186300 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3256/6777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:48 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:49.208557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:49.209254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:49.215430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.216535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.217015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:49.217699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.218147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.218568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:49.352506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:49.360612 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-078fe940-4a62-42c6-ba40-8e72f4a50942 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1552 microversion: 2.1 time: 0.157160 Aug 30 18:27:49.361218 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3522/6778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:49 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:49.382029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:49.382545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:49.390701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.391201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.391691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:49.392401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.392869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.393312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:49.474198 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-43fc6a7c-4841-4a31-986a-5d02860846f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096175 Aug 30 18:27:49.474810 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3257/6779] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 18:27:49 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:50.425889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:50.430824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:50.437619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:50.438099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:50.438532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:50.449541 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] Creating event network-changed:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:27:50.454799 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d619a472-7e94-4471-9088-f22333da8a77 req-fb6b8ff5-056f-4b9d-a40d-bc30f88ae5a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Aug 30 18:27:50.455437 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3523/6780] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:23.311829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.312622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.315990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.316983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.322003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:23.324408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:23.333866 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.334479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.335124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.335863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.336335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.336778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.367154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:23.373681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:28:23.380167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:28:23.380603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:28:23.381122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:28:23.381542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:28:23.381979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:28:23.447787 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-16b20248-8e24-4942-9313-331d4b9738d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/action" status: 202 len: 0 microversion: 2.1 time: 0.136471 Aug 30 18:28:23.448476 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3258/6781] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:28:23 2022] POST /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:28:23.455926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.456837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:23.461088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:23.461807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:23.469056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.469576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.469994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.470732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.471222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.471697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.627728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:23.635806 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dadce97f-4c16-4a93-ab2c-57fba09863e4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1680 microversion: 2.1 time: 0.182044 Aug 30 18:28:23.636419 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3524/6782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:23 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:24.658698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:24.659322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:24.665477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.665870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.666311 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.667003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.667459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.667911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:25.183020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:25.191672 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a753187a-075d-415e-bbef-43214edeb24c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1680 microversion: 2.1 time: 0.538383 Aug 30 18:28:25.192257 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3259/6783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:24 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1680 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:26.213424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:26.214047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:26.221675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.222169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.222608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:26.223304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.223790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.224223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:26.359818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:26.367891 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a56f8d7-4dea-4959-9d8d-df4e4592983c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.158505 Aug 30 18:28:26.368464 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3525/6784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:26 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:27.389602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:27.390247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:27.397100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:27.397591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:27.398036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:27.398740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:27.399199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:27.399667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:27.540590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:27.548853 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4d912156-8da1-40bd-bc11-2671b35bc448 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.163297 Aug 30 18:28:27.549548 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3260/6785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:27 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:28.570981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:28.571555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:28.578491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.578978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.579418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.580137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.580594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.581024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.717365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:28.725169 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-653f90cf-47f1-4e24-8185-39cce25e211a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.158283 Aug 30 18:28:28.725777 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3526/6786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:28 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:29.746771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:29.748033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:29.754832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:29.755327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:29.755810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:29.756517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:29.756984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:29.757424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:29.885234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:29.893083 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2d181a35-dad8-44d0-af81-3a58e8a97526 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.150231 Aug 30 18:28:29.893671 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3261/6787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:29 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:30.914262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.914880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:30.921959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.922475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.922918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.923669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.924128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.924553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:31.055276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:31.063641 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16bc83b2-e185-4cc4-9563-48dd5ee9c129 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.153296 Aug 30 18:28:31.064240 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3527/6788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:32.084954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:32.085578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:32.093438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:32.094066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:32.094499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:32.095212 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:32.095716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:32.096142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:32.226945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:32.234785 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aab199de-39c2-477d-b516-48cd50b061b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.153881 Aug 30 18:28:32.235358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3262/6789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:32 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:33.256124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:33.256741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:33.264403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:33.264759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:33.265606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:33.266316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:33.266769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:33.267194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:33.402137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:33.410434 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e9a98f44-79b6-4305-9a48-50f1bcaa4d6b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.158187 Aug 30 18:28:33.411017 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3528/6790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:33 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:34.432247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:34.432796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:34.440470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:34.440962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:34.441405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:34.442101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:34.442559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:34.442993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:34.587135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:34.595959 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9cd0aae4-57fe-4c1e-b7cf-1ea4bc11a659 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.167689 Aug 30 18:28:34.596547 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3263/6791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:34 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:35.618461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:35.618998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:35.626352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:35.626841 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:35.627285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:35.628018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:35.628477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:35.628910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:35.757589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:35.765543 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8aaad584-4bb8-4556-b246-c8ef4cc69023 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.151426 Aug 30 18:28:35.766135 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3529/6792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:35 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:36.786770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:36.787399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:36.794309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:36.794860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:36.795504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:36.796207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:36.796667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:36.797101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:36.925820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:36.933699 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-006b2c35-e4b6-4a64-8c72-7c520c8ed829 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.150879 Aug 30 18:28:36.934282 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3264/6793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:36 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:37.956211 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:37.956827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:37.963691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:37.964170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:37.964602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:37.965285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:37.965742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:37.966156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:38.099722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:38.108031 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ad7c9df4-5126-40ef-851f-098bf6c64eeb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.155737 Aug 30 18:28:38.108613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3530/6794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:37 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:39.129413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:39.130041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:39.136873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:39.137391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:39.137842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:39.138827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:39.139296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:39.139759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:39.271575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:39.280161 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b6809110-fa6b-4a0b-a94f-7ffb6ceff8ea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.154502 Aug 30 18:28:39.280763 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3265/6795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:39 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:40.302167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:40.303497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:40.310993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:40.311580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:40.312020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:40.312708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:40.313189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:40.313616 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:40.447818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:40.456291 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-37f43300-80d4-427a-94e8-bd835e2603d1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.158191 Aug 30 18:28:40.456910 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3531/6796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:40 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:41.477703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:41.478335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:41.486142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:41.486636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:41.487084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:41.487824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:41.488292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:41.488755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:41.689715 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:41.697890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-510dae74-f883-44c2-a2f9-11316bdcb5e0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1685 microversion: 2.1 time: 0.224057 Aug 30 18:28:41.698550 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3266/6797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:41 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1685 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:42.720568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:42.721285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:42.728305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:42.728793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:42.729230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:42.729926 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:42.730385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:42.730815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:42.922854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:42.931719 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a1934ba2-f500-41ca-9179-9fa01998d8c3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1684 microversion: 2.1 time: 0.215740 Aug 30 18:28:42.932294 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3532/6798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:42 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1684 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:42.934479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "name": "network-vif-unplugged", "status": "completed", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:42.946046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:42.946543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:42.947049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:42.959930 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Creating event network-vif-unplugged:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h2-852771-11 Aug 30 18:28:42.965676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:28:42.977379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3cdc79c0-2420-44d9-86f1-252ab0e3307c req-63cd2326-9eaf-4865-8eca-3b479bf3161b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046724 Aug 30 18:28:42.978180 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3267/6799] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:43.954285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:43.954936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:43.961792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:43.962284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:43.962727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:43.963427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:43.963918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:43.964358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:44.092558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:44.100382 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-50695fd4-b2da-4e0f-895c-8eef8dc52200 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1682 microversion: 2.1 time: 0.150821 Aug 30 18:28:44.100973 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3533/6800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:43 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:44.995852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:45.005736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:45.006218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:45.006657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:45.018684 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Creating event network-changed:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h2-852771-11 Aug 30 18:28:45.023935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:28:45.035386 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-084c01fc-8fcc-4d26-b589-8a2ae02c99c9 req-58dd2585-8be2-4781-bf9a-3889fbbaaafb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045651 Aug 30 18:28:45.037049 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3268/6801] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:45.123205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:45.123867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:45.130862 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:45.131347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:45.131830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:45.132541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:45.133001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:45.133433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:45.274899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:45.286524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0a20a2fd-9413-4def-a959-0ddf4d91a06a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1682 microversion: 2.1 time: 0.167827 Aug 30 18:28:45.287368 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3534/6802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:45 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:46.307525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:46.308250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:46.315795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.316298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.317043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.317943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.318610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.319105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.463859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:46.472440 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32747b24-d236-4ce3-a94f-df9a18bea5ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1679 microversion: 2.1 time: 0.169222 Aug 30 18:28:46.473017 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3269/6803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:46 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:46.500590 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:46.501165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:46.514172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.514659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.515094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.515822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.516277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.516701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.561272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.562147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.562904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.564229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.565053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.565774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.600354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:46.606333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:46.720152 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9914233c-ed18-4c07-a7b6-8acb8ed83c3e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/action" status: 202 len: 0 microversion: 2.1 time: 0.223040 Aug 30 18:28:46.720781 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3535/6804] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:28:46 2022] POST /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:28:46.730688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:46.731321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:46.737961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.738534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.739029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.739807 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:46.740493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:46.741026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:46.985949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:46.994288 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b597f7da-7fc1-426b-b6b1-59956ec70775 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1678 microversion: 2.1 time: 0.269153 Aug 30 18:28:46.994963 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3270/6805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:46 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1678 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:48.018815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:48.019556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:48.025757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:48.026244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:48.026688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.027382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:48.027874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:48.028306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.164113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:48.172852 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a73868ac-0208-4ed2-b7cd-f57f504b7e93 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1678 microversion: 2.1 time: 0.159830 Aug 30 18:28:48.173445 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3536/6806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:48 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:48.305872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "name": "network-vif-plugged", "status": "completed", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:48.321285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:48.321781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:48.322224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.335241 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Creating event network-vif-plugged:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h2-852771-11 Aug 30 18:28:48.340682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:28:48.352075 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e7d98eb3-6068-44e4-9690-abde3cdb4cbd req-069d7ebb-d2ce-4008-a7d5-9a10199b44be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050345 Aug 30 18:28:48.352769 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3271/6807] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:49.194804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:49.195423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:49.203441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.203951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.204388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.205086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.205544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.206037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.227680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:49.346763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:49.355179 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a78be66-e92e-46cd-a110-9dec00103490 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1678 microversion: 2.1 time: 0.164496 Aug 30 18:28:49.355784 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3537/6808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:49 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:49.838525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "name": "network-vif-unplugged", "status": "completed", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:49.849510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.850006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.850448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.863466 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Creating event network-vif-unplugged:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:28:49.869210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:28:49.881151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-95b34c53-067a-4702-896a-21f0c3b66a43 req-d22c9948-0f0f-49b3-a51e-fef5b7f967a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047732 Aug 30 18:28:49.881772 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3272/6809] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:50.377024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:50.377640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:50.384553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:50.385040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:50.385483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:50.386178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:50.386633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:50.387060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:50.531500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:50.539444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb86b8e3-6c94-4859-8efa-4e32f11acc48 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1678 microversion: 2.1 time: 0.166891 Aug 30 18:28:50.540261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3538/6810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:50 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:51.562967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:51.563645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:51.570674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:51.571168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:51.571655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:51.572368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:51.572831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:51.573271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:51.711757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:51.720510 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-47312a8d-0557-44ac-ae26-69a3a5c8164a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1678 microversion: 2.1 time: 0.162451 Aug 30 18:28:51.721104 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3273/6811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:51 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:51.913120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:51.923354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:51.923864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:51.924291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:51.936476 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Creating event network-changed:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:28:51.941762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:28:51.953316 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-48dd3b3d-796d-45b1-b6f8-d39f30238d35 req-a68d49d6-3b20-4dbe-88b4-3731b13ef77b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043934 Aug 30 18:28:51.953988 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3539/6812] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:52.742232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:52.742973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:52.749802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.750291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.750740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.751447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.751932 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.752366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.773486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:53.031073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:53.038830 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-968c5f82-62b6-47e5-8675-1e849371cbc7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1671 microversion: 2.1 time: 0.300713 Aug 30 18:28:53.039424 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3274/6813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:52 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:53.061064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:53.061830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:53.067898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.068377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.068809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.069495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.069944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.070363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.203670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:53.211633 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-567c1cc2-d0d3-4706-9ed9-cb83803222d0 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1671 microversion: 2.1 time: 0.155999 Aug 30 18:28:53.212226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3540/6814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:53 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:53.232515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:53.233155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:53.239903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.240407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.240868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.241862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.242333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.242774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.370648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:53.379104 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3653d722-5cd5-4d20-b893-73832c83a995 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1671 microversion: 2.1 time: 0.150523 Aug 30 18:28:53.379715 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3275/6815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:53 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:53.400824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:53.401332 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:53.407662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.408164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.408610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.409307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.409768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.410198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.435529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:53.496243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:53.520576 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e56ca6f-dc1a-4693-bc72-b7833111e9f1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 204 len: 0 microversion: 2.1 time: 0.123466 Aug 30 18:28:53.521210 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3541/6816] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:53 2022] DELETE /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:53.529419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:53.530047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:53.531907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=41 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:53.537204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.537688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.538132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.539194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:53.539688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:53.540160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:53.672328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:53.680336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eae08233-c063-43aa-aa62-96fcd799fc04 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1677 microversion: 2.1 time: 0.154744 Aug 30 18:28:53.681121 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3276/6817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:53 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:54.703353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:54.704089 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:54.710941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:54.711428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:54.711898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:54.712586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:54.713104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:54.713537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:54.845742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:54.854320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7f4f38a-d27f-4fe4-aee1-e14ebd4a9c7c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1677 microversion: 2.1 time: 0.156085 Aug 30 18:28:54.855011 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3542/6818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:54 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:55.648837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6931c58-bf8c-47fa-a13c-8db5ab95cf03", "name": "network-vif-deleted", "tag": "d5a73591-5caf-4998-8983-14f57d803b5a"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:55.660468 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:55.661284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:55.661822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:55.674338 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] Creating event network-vif-deleted:d5a73591-5caf-4998-8983-14f57d803b5a for instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 on n-h1-852771-11 Aug 30 18:28:55.679337 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-49ba29a5-0af4-4ea1-bbae-57dc91f70bf9 req-49548fd4-2f4e-499b-aad3-66fd77c16543 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036899 Aug 30 18:28:55.680093 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3277/6819] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:55.876962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:55.877583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:55.884414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:55.884899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:55.885344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:55.886042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:55.886497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:55.886925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:55.920777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:55.921271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:55.921713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:55.922164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lazy-loading 'fault' on Instance uuid c6931c58-bf8c-47fa-a13c-8db5ab95cf03 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:28:55.965896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:55.975000 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b5d7984a-9bc3-48a0-a79d-23bf5a57087c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 200 len: 1329 microversion: 2.1 time: 0.102404 Aug 30 18:28:55.975534 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3543/6820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:55 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:56.997599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:56.998313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:57.004537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.005025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.005469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.006163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.006618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.007049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.020827 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 HTTP/1.1 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c6931c58-bf8c-47fa-a13c-8db5ab95cf03'} Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:57.022430 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d3718fae-975f-4b77-afa9-48a3973c69cf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 404 len: 111 microversion: 2.1 time: 0.031521 Aug 30 18:28:57.026763 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3278/6821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:56 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:57.040871 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:57.041493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:57.043439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:57.049770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.050258 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.050699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.051392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.051877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.052307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.065763 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 HTTP/1.1 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c6931c58-bf8c-47fa-a13c-8db5ab95cf03'} Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:57.067418 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-36cf541f-a476-47e8-8028-21efcb1ab6c1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 404 len: 111 microversion: 2.1 time: 0.031943 Aug 30 18:28:57.071905 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3544/6822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:57 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:57.118896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1010225774", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "56e15158-439e-4f1d-951b-4bc5bd2f162a"}], "security_groups": [{"name": "tempest-securitygroup--2093230343"}], "key_name": "tempest-keypair-1529437540", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:57.223397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] validate_networks() for [('56e15158-439e-4f1d-951b-4bc5bd2f162a', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:28:57.625398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:28:57.625840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:28:57.626334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:28:57.626765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:28:57.627184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:28:57.636346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.636847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.637299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.638136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.638607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.639053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.660333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:57.665756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:57.679043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:28:57.681409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:28:57.728383 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b07c395f-7676-4249-a22b-450e5c13cfd4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.613528 Aug 30 18:28:57.728962 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3279/6823] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:28:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:28:57.740547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-12716986-b00d-4bb6-8445-99926dd5131c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:57.741164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-12716986-b00d-4bb6-8445-99926dd5131c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:57.795403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-12716986-b00d-4bb6-8445-99926dd5131c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:57.802610 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-12716986-b00d-4bb6-8445-99926dd5131c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1239 microversion: 2.1 time: 0.065910 Aug 30 18:28:57.803183 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3545/6824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:57 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:58.826041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:58.826716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:58.833566 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:58.834060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:58.834502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:58.835200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:58.835692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:58.836252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:58.929286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:58.939917 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f9d0c2e-83c7-4d84-9edb-5066e7bdb33b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1297 microversion: 2.1 time: 0.119044 Aug 30 18:28:58.954870 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3280/6825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:58 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:59.962412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:59.963033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:59.974764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:59.975245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:59.975712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:59.976409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:59.976887 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:59.977311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:00.020954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:00.033510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:00.034455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:00.035092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:00.049057 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] Creating event network-changed:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:29:00.054470 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-75e0a778-3781-4fa8-a8ad-1e842fdea248 req-5d08d85b-3948-49f9-99ea-f43969cbf5ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037822 Aug 30 18:29:00.058087 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3281/6826] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:00.122782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:00.130955 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ff9973e0-4bdf-4083-a9c0-b60519252979 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1365 microversion: 2.1 time: 0.172595 Aug 30 18:29:00.131592 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3546/6827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:59 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:01.153582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:01.154580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:01.160820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:01.161571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:01.162023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:01.162718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:01.163178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:01.163647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:01.392986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:01.401627 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b305f20d-05d4-42d7-a3da-ea5c87d96ce6 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1365 microversion: 2.1 time: 0.253154 Aug 30 18:29:01.402217 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3282/6828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:01 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:02.423093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:02.423908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:02.432618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:02.433112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:02.433552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:02.434262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:02.435031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:02.435784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:02.570996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:02.579573 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-254cfc24-19f7-406b-b135-fbd5f689b658 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1365 microversion: 2.1 time: 0.160866 Aug 30 18:29:02.580155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3547/6829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:02 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:03.601310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:03.601852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:03.608831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.609321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.609764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.610457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.610917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.611349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.745550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:03.753320 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-191d10c8-1710-4227-bcb5-651c412b657b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1365 microversion: 2.1 time: 0.156011 Aug 30 18:29:03.753904 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3283/6830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:03 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:04.360160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "name": "network-vif-plugged", "status": "completed", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:04.371114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:04.371732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:04.372173 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:04.385093 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] Creating event network-vif-plugged:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:29:04.390726 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6d97fc50-a36f-49b5-9aa3-41de14e23cfe req-e22dc2d2-939a-42e8-9702-f5f4b2283aae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Aug 30 18:29:04.391825 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3548/6831] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:04.774855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:04.775393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:04.783289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:04.783821 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:04.784272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:04.784977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:04.785442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:04.785879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:04.914333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:04.923080 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ce45872-9cb2-449e-a4dd-7c55854cb036 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1365 microversion: 2.1 time: 0.152268 Aug 30 18:29:04.923687 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3284/6832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:04 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:05.944537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:05.945261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:05.952220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:05.952700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:05.953134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:05.953821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:05.954273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:05.954725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.085726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:06.094110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-90529166-8c16-4df8-8136-fbb16cba6c66 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1552 microversion: 2.1 time: 0.153790 Aug 30 18:29:06.094706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3549/6833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:05 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:06.115950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:06.116459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:06.124144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.124642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.125106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.125791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.126249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.126683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.206949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22c55c69-eb89-440b-9b64-e06f64119a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094959 Aug 30 18:29:06.207587 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3285/6834] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 18:29:06 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:07.143199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:07.153643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:07.154348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:07.154574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:07.166276 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] Creating event network-changed:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:29:07.172440 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9212c104-c2b3-4d9a-9811-f6f4ad0f224c req-4478a4a2-664e-4478-a7ae-f5245aa24e16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Aug 30 18:29:07.173058 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3550/6835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:41.457488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.458265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.458991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.459740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=50 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.464124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:41.464742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:41.472930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.473416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.473864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.474578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.475037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.475469 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.608516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:41.616315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-52a29a91-66b5-4e60-ae8c-00f3a329b58c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1671 microversion: 2.1 time: 0.160821 Aug 30 18:29:41.617134 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3286/6836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:41 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:41.638417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "839fa3cb-9eb2-458b-a784-f34e533d52ed"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:41.641267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:41.643549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.644341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.645329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.652464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.652945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.653433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.654148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.654602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.655024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.889690 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-848075ca-3f36-47ca-acbb-5be2ceed92a7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256096 Aug 30 18:29:41.890311 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3551/6837] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:29:41 2022] POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:52.595248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:52.597606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:52.599707 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:29:52.599858 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/action (ip 10.222.0.50) !!! Aug 30 18:29:52.601367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:52.602043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:52.610205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.610704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.611155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:52.611890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.612357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.612797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:52.642286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:52.648122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Old instance type m1.heat2, new instance type m1.heat {{(pid=122123) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:29:52.655645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:52.656089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:52.656583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:52.657009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:52.657435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:52.720151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7cd6098f-6bf1-4164-baaa-532bf1cd2ae3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/action" status: 202 len: 0 microversion: 2.1 time: 0.129683 Aug 30 18:29:52.721076 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3287/6838] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:29:52 2022] POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:52.727400 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:29:52.727903 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf (ip 10.222.0.50) !!! Aug 30 18:29:52.729028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:52.729788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:52.734989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:52.735721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:52.746049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.746563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.747199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:52.748022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.748476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.748901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:52.902232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:52.911769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb81362a-9690-4687-afa0-965c296064db tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1726 microversion: 2.1 time: 0.186415 Aug 30 18:29:52.912349 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3552/6839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:52 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:53.934012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:53.935250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:53.941457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:53.941960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:53.942410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:53.943126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:53.943695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:53.944144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:54.150268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:54.159439 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fceaeab7-64e5-43b3-9120-9703780ce105 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1726 microversion: 2.1 time: 0.230252 Aug 30 18:29:54.162745 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3288/6840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:53 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:55.181670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:55.182289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:55.190302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:55.190783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:55.191220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:55.191954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:55.192412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:55.192840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:55.325819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:55.334216 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09a8c296-2c6e-4e71-89c9-fbb268889b47 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.156564 Aug 30 18:29:55.334814 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3553/6841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:55 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:56.355819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:56.356496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:56.363283 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:56.363800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:56.364249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:56.364964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:56.365410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:56.365840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:56.500141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:56.509515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c8fdcee3-d347-4698-a1c2-77079ddf65c7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.157602 Aug 30 18:29:56.510100 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3289/6842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:56 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:57.532437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:57.533084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:57.540023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:57.540512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:57.540963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:57.541665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:57.542121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:57.542623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:57.677467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:57.685981 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a42799b-e03a-424c-9e59-0287de14d901 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.158497 Aug 30 18:29:57.686849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3554/6843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:57 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:58.707330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:58.707998 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:58.714834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:58.715333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:58.715883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:58.716587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:58.717051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:58.717490 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:58.844716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:58.852974 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9494b365-4895-4145-bb7d-36e626d709b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.149541 Aug 30 18:29:58.853553 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3290/6844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:58 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:59.873835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:59.874458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:59.881306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:59.881790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:59.882230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:59.882919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:59.883376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:59.883832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:00.013363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:00.021648 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ba14dae3-b517-4e9a-84ff-efc367df8312 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.151791 Aug 30 18:30:00.022230 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3555/6845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:59 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:01.044096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:01.045030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:01.052031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.052526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.052980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:01.053674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.054138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.054600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:01.188887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:01.197135 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66546db8-fecc-42f3-a999-62f77ca0036a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.157721 Aug 30 18:30:01.197718 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3291/6846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:01 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:02.218911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:02.219578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:02.226375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.226855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.227283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.227990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.228445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.228865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.363133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:02.371795 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d69ee893-950b-4acc-b098-e6cadbcbbfea tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.156863 Aug 30 18:30:02.372991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3556/6847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:02 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:03.393454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:03.394084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:03.402047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:03.402569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:03.403750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:03.404457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:03.404919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:03.405356 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:03.537808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:03.546536 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f48b711c-9c99-4aa9-bf73-407d30f5196a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.156989 Aug 30 18:30:03.547112 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3292/6848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:03 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:04.567553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:04.569777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:04.577307 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.577938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.578415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:04.579157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.579651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.580078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:04.713143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:04.722016 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e3305b9b-0cf7-4b64-a7ed-1620bf3c748f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.158574 Aug 30 18:30:04.722594 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3557/6849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:04 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:05.743872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:05.744497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:05.752078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:05.752567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:05.753010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:05.753701 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:05.754159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:05.754592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:05.888417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:05.896731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b533dce6-2d1a-499a-9494-1c1bcdf7aede tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.157065 Aug 30 18:30:05.897309 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3293/6850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:05 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:06.917134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:06.917753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:06.925060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:06.925550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:06.925991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:06.926687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:06.927143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:06.927596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:07.065032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:07.073386 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88316bf1-24a0-46cb-88d1-8d13098254fa tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.160206 Aug 30 18:30:07.073967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3558/6851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:06 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:08.095788 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:08.096442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:08.103320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:08.103876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:08.104335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:08.105044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:08.105511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:08.106412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:08.235492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:08.244083 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6a45c87d-8431-4fcf-9450-76ac0482add2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.152949 Aug 30 18:30:08.244668 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3294/6852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:08 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:09.265327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:09.265943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:09.273041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.273528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.274051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.274788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.275252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.275720 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.412460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:09.421052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8db0a65c-8d89-4554-ace4-e3c0541da121 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.159856 Aug 30 18:30:09.421645 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3559/6853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:09 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:10.442048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:10.442677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:10.449789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:10.450347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:10.450825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:10.451528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:10.452000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:10.452443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:10.582746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:10.591721 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55b3d404-0b41-4374-bbbd-d980cb81f89a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.152974 Aug 30 18:30:10.592422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3295/6854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:10 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:11.612408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:11.613022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:11.620252 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.620754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.621185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:11.621866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.622865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.623287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:11.753959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:11.762220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2916aa94-aaf4-4ac5-a27a-13b5d5666f4c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.153745 Aug 30 18:30:11.762800 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3560/6855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:11 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:12.784546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:12.785174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:12.792016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:12.792509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:12.792957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:12.793665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:12.794385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:12.794929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:12.929371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:12.938020 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1488e265-c8ff-4f7d-ae0f-ea0fe705d75f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1731 microversion: 2.1 time: 0.157418 Aug 30 18:30:12.938600 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3296/6856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:12 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:13.891167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "name": "network-vif-unplugged", "status": "completed", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:13.901178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:13.901660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:13.902103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:13.914641 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Creating event network-vif-unplugged:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h1-852771-11 Aug 30 18:30:13.921195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:30:13.932120 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5ca3101c-de63-4bf7-a2e2-530a32422da1 req-154f11d1-5a7e-41cc-b3cd-351fdd7b89e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104595 Aug 30 18:30:13.932740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3561/6857] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:13.959931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:13.960559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:13.967506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:13.968027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:13.968472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:13.969171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:13.969628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:13.970063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:14.183523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:14.193198 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2fc7b62e-b20f-4925-a498-567a626ef5dc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1730 microversion: 2.1 time: 0.237080 Aug 30 18:30:14.193708 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3297/6858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:13 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:15.220218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:15.220930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:15.227282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:15.227874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:15.228320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:15.229026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:15.229491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:15.229922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:15.366231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:15.375516 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8c4a23dd-53ef-486b-8740-b6baa3459aa8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.160824 Aug 30 18:30:15.376104 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3562/6859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:15 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:15.958231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:15.969159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:15.969644 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:15.970085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:15.982209 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Creating event network-changed:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h1-852771-11 Aug 30 18:30:15.987542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:30:15.998580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-78173411-31e0-4793-a13c-89b7667697de req-cd2e98cb-9b73-436e-8b1a-d8bd00792b37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044073 Aug 30 18:30:15.999370 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3298/6860] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:16.397603 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:16.398844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:16.407341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:16.408137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:16.408811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:16.409528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:16.409986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:16.410420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:16.550870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:16.562026 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5be5f04f-605d-4c15-ad78-888541689174 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.167961 Aug 30 18:30:16.562819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3563/6861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:16 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:17.587927 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:17.588642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:17.595033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:17.595528 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:17.595982 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:17.596682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:17.597142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:17.597574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:17.735110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:17.743918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04cf1e1f-5a60-4815-9b96-b7feed1cded3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.161239 Aug 30 18:30:17.744504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3299/6862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:17 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:18.766465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:18.767095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:18.773772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:18.774262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:18.774704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:18.775404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:18.775894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:18.776330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:18.907789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:18.916238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df16d38c-4659-484f-b75b-23d273dc5e4e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.153895 Aug 30 18:30:18.916824 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3564/6863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:18 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:19.938134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:19.938774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:19.945702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.946199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.946684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:19.947388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.947880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.948321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.095385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:20.104093 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e89a8e8f-2c9b-4dd5-8944-ce3c17b5aef4 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.170038 Aug 30 18:30:20.104668 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3300/6864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:19 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:21.126109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:21.126732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:21.133641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:21.134133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:21.134572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:21.135273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:21.135752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:21.136185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:21.272183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:21.281003 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8286573b-2c4c-4463-8b9e-a19abbfce95f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.159429 Aug 30 18:30:21.281607 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3565/6865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:21 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:22.302096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:22.302719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:22.310134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:22.310790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:22.311233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:22.311951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:22.312415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:22.312848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:22.442901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:22.451199 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-66307dff-c1f0-4172-afd9-1f32aafe43a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.153383 Aug 30 18:30:22.451806 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3301/6866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:22 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:23.472906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:23.473520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:23.476357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=29 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:23.482346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:23.482832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:23.483271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:23.484000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:23.484455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:23.484881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:23.489077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=83 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:23.616715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:23.625555 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f743250f-0636-41ae-bd4f-a4f4b16b2841 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.156600 Aug 30 18:30:23.626136 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3566/6867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:23 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:24.647327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:24.648019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:24.650959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=35 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:24.657192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:24.657689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:24.658169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:24.658874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:24.659338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:24.659834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:24.662685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:24.798639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:24.807062 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a1eb2ed-991f-48b7-a558-0b5fffa04218 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.163642 Aug 30 18:30:24.807773 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3302/6868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:24 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:25.829011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:25.829654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:25.836708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.837197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.837640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.838338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.838796 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.839233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:26.259561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:26.268455 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97d89c10-ce87-42c9-87a1-e65d6151b4bf tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1728 microversion: 2.1 time: 0.443166 Aug 30 18:30:26.268774 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3567/6869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:25 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1728 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:27.290224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:27.290853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:27.298674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.299226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.299709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.300414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.300881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.301317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.433303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:27.441772 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f66efae-835f-4179-a66d-5c35b914b4ae tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1725 microversion: 2.1 time: 0.155534 Aug 30 18:30:27.442352 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3303/6870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:27 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:27.462978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:27.463548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:27.471036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.471558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.472000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.472689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.473145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.473571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.512135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.513245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.513957 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.514763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.515176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.515654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.536718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:30:27.542025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Getting quotas for user 4bbd12eef4764726ba5ec944397a9603 and project 9d18578d71b34a5c98e67bb15d523ef5. Resources: {'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:30:27.643951 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ac14b4d-dc0d-4970-9ff5-3867d4848fe8 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/action" status: 202 len: 0 microversion: 2.1 time: 0.184637 Aug 30 18:30:27.644689 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3568/6871] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:27 2022] POST /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:30:27.653979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:27.654818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:27.660882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.661384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.661922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.662838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.663409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.664035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.864045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:27.873187 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-efd0b3c0-1c71-4430-bcef-700c4c4e2079 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.224008 Aug 30 18:30:27.873776 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3304/6872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:27 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:28.895880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:28.896576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:28.903101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:28.903610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:28.904045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:28.904731 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:28.905181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:28.905605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:29.034836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:29.043062 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d7c16175-972e-43bc-ad17-ef5b17583b5c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.152352 Aug 30 18:30:29.044163 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3569/6873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:28 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:30.064898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:30.066484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:30.075505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.076052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.076577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.077308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.077773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.078202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.237759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:30.249299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2af6c438-a94f-4e43-b168-fbeb505e00cd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.188522 Aug 30 18:30:30.265006 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3305/6874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:30 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:30.313385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "name": "network-vif-plugged", "status": "completed", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:30.322992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.323466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.324115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.336875 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Creating event network-vif-plugged:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h1-852771-11 Aug 30 18:30:30.343986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:30:30.354769 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-49ccc9ac-7dc5-4432-ac66-e30cb4efb6b6 req-a749a46c-5e9b-4d82-bec6-3bd8398a9483 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142068 Aug 30 18:30:30.355380 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3570/6875] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:31.272198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:31.272828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:31.280355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:31.280857 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:31.281306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:31.282026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:31.282476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:31.282912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:31.417496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:31.426585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2a8e316c-cb95-4eb6-8498-7cceadfe3d9d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.158476 Aug 30 18:30:31.427186 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3306/6876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:31 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:32.450403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:32.451119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:32.458492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.458989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.459587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.460551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.461073 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.461510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.614334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:32.623744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f529963f-7dbf-45d9-892b-32244a29c97b tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.178406 Aug 30 18:30:32.624352 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3571/6877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:32 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:33.006705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "name": "network-vif-unplugged", "status": "completed", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:33.017960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.018449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.018891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.031426 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Creating event network-vif-unplugged:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:30:33.037021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:30:33.048818 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ddbcdc06-37d4-4af6-9223-5a322295620a req-ea14e02c-ec81-4fe2-9958-3f93503746b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046022 Aug 30 18:30:33.049640 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3307/6878] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:33.645807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:33.646426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:33.653915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.654594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.655035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.655766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.657317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.657764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.793287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:33.801949 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d579fc4c-7789-4086-852a-fcbb301ac4b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.160031 Aug 30 18:30:33.802541 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3572/6879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:33 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:34.825868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:34.826589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:34.833019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.833440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.833896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:34.834608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.835077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.835559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:34.966354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:34.975169 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64cbdcea-44f6-4b7c-b4ac-25f770542d74 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.155301 Aug 30 18:30:34.975798 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3308/6880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:34 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:35.089304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:35.100253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.100733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.101166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.113945 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Creating event network-changed:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:30:35.119868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:30:35.131455 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a3f71c08-7809-456d-b58f-4c82feea7558 req-013d4192-56a4-41f3-8403-9d124ea6dd5f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045950 Aug 30 18:30:35.132337 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3573/6881] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:35.997556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:35.998364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:36.005884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.006531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.007081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.007929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.008506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.009162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.405144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:36.414755 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3aae8639-9e11-48b0-976b-6963ea80997d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.421132 Aug 30 18:30:36.418372 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3309/6882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:35 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:37.437643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:37.438448 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:37.444781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:37.445351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:37.445849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:37.446545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:37.446996 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:37.447416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:37.525429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:37.579508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:37.587923 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d26ccb6a-e366-4cc0-9a25-837cc95715b7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.156264 Aug 30 18:30:37.588511 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3574/6883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:37 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:38.609907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:38.610529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:38.617653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.618141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.618594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.619293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.619783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.620220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.758852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:38.767562 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-974bc8c8-f3d9-4a00-b593-ea9ee01e14f3 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.161748 Aug 30 18:30:38.768080 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3310/6884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:38 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:39.792299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:39.792913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:39.800195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.800685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.801123 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.801814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.802269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.802699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.938102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:39.946556 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0cbb1576-dfd1-487b-8563-5c941ff0f7ff tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.158200 Aug 30 18:30:39.947141 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3575/6885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:39 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:40.970028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:40.970650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:40.977460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.977947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.978392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.979081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.979563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.979995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.112818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:41.121553 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90a605c5-8375-4573-b528-b98d0abc5411 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.155298 Aug 30 18:30:41.122143 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3311/6886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:40 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:42.142361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:42.142982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:42.150045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.150530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.150970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.151700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.152156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.153130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.286447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:42.295592 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0645768d-86df-4157-91b7-3e521dbcaa6d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.157174 Aug 30 18:30:42.296176 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3576/6887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:42 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:43.317039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:43.317750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:43.325225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:43.325719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:43.326175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:43.326877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:43.327345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:43.327812 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:43.462742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:43.472372 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-113e2131-63e4-4a80-929a-79dfe1e30edd tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.159326 Aug 30 18:30:43.472951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3312/6888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:43 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:44.493389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:44.494003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:44.501046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.501522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.501959 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.502644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.503091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.503543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.638403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:44.646806 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c43b65c4-c98f-4b51-968c-29ce45c2cf0d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1724 microversion: 2.1 time: 0.157606 Aug 30 18:30:44.647398 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3577/6889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:44 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:45.669425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:45.669993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:45.676955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.677450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.677902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.678603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.679068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.679530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.809684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:45.818130 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-61915178-592c-4078-b7bc-8040ea418482 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1717 microversion: 2.1 time: 0.153263 Aug 30 18:30:45.818729 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3313/6890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:45 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:45.838525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:45.839146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:45.846680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.847174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.847727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.848425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.848886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.849320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.979763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:45.989021 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9cc9cf65-5c3b-48ac-b627-54abcefc00e7 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1717 microversion: 2.1 time: 0.154354 Aug 30 18:30:45.989617 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3578/6891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:45 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:46.009380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:46.010005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:46.015967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.016451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.016898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.017591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.018048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.018478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.146873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:46.155918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32df33e0-8900-4fc4-8b9c-5405a4c2b14f tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1717 microversion: 2.1 time: 0.150420 Aug 30 18:30:46.156497 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3314/6892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:46 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:46.175646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:46.176142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:46.182110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.182523 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.182954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.183681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.184134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.184550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.209711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:46.234100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:46.289602 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86fb8083-d297-467e-8391-6c43e21d531e tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 204 len: 0 microversion: 2.1 time: 0.117342 Aug 30 18:30:46.290697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3579/6893] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:46 2022] DELETE /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:30:46.298970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:46.299631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:46.305806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.306329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.306780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.307502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.307971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.308422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.447012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:46.455896 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-04822b85-ab41-42de-8491-2fe7bc4e81a1 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1723 microversion: 2.1 time: 0.160793 Aug 30 18:30:46.456474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3315/6894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:46 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:47.478151 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:47.478850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:47.486526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:47.487007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:47.487444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:47.488172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:47.488623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:47.489045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:47.639042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:47.647942 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-345a3f51-b2b2-4e9d-8244-51a41f7391eb tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1723 microversion: 2.1 time: 0.174032 Aug 30 18:30:47.648531 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3580/6895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:47 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:48.670642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:48.671583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:48.678151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.678774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.679315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.680171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.681081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.681236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.871992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:48.880639 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1be78fa-561a-4f00-a8c4-93574d05c328 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1723 microversion: 2.1 time: 0.214084 Aug 30 18:30:48.881596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3316/6896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:48 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:49.182919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c95e6ac-7958-4f2e-9b0c-7b3173d41acf", "name": "network-vif-deleted", "tag": "1a177b91-88d1-442e-ba8e-5d7daa517b85"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:49.194704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:49.195183 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:49.195662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:49.209144 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] Creating event network-vif-deleted:1a177b91-88d1-442e-ba8e-5d7daa517b85 for instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf on n-h2-852771-11 Aug 30 18:30:49.213906 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f3aa07da-2556-4987-80a7-03954c8589a8 req-1dd834d9-d996-4601-a20f-258839763b16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Aug 30 18:30:49.214519 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3581/6897] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:49.903988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:49.904759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:49.912435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:49.913027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:49.913567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:49.914384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:49.914926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:49.915427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:49.983140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:49.992417 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9d242a69-c9d3-474b-85b6-4313fe344122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1370 microversion: 2.1 time: 0.093344 Aug 30 18:30:49.993374 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3317/6898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:49 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:51.015267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:51.016355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:51.022534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:51.023023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:51.023459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:51.024176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:51.024651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:51.025059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:51.093808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:51.102348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-69c5ce5d-eae1-42f8-8874-23568459bd35 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1370 microversion: 2.1 time: 0.092389 Aug 30 18:30:51.102874 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3582/6899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:51 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:52.124667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:52.125466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:52.132554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.133050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.133503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.134204 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.134669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.135106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.200533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:52.208985 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c872ac0-a5e7-425f-b037-225226ab9967 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1370 microversion: 2.1 time: 0.089447 Aug 30 18:30:52.209794 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3318/6900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:52 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:53.230618 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:53.231339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:53.238432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.239097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.239636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.240430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.241118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.241861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.318443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbd12eef4764726ba5ec944397a9603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d18578d71b34a5c98e67bb15d523ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:53.327835 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-86c861ac-96c1-45ad-b1cb-0173df15c731 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 200 len: 1370 microversion: 2.1 time: 0.101576 Aug 30 18:30:53.328588 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3583/6901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:53 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:54.348630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:54.349271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:54.356422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.356918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.357368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.358100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.358570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.359013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.361749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=100 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:54.374535 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf HTTP/1.1 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5c95e6ac-7958-4f2e-9b0c-7b3173d41acf'} Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:54.376206 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8d52351e-242a-4212-95f2-2d6e1ffb97a2 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 404 len: 111 microversion: 2.1 time: 0.032947 Aug 30 18:30:54.380645 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3319/6902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:54 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:30:54.439445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:54.441713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:54.444490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:54.451048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.451572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.452016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.452708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.453162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.453589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.466970 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-volume_attachments HTTP/1.1 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '5c95e6ac-7958-4f2e-9b0c-7b3173d41acf'} Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:54.468667 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-370ed4a5-68fa-41b2-887e-ae27e0fe8a67 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034786 Aug 30 18:30:54.472733 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3584/6903] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:54 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:57.785138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.785774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.788692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:57.795021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.795551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.796135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.796845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.797305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.797741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.811729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf HTTP/1.1 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5c95e6ac-7958-4f2e-9b0c-7b3173d41acf'} Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:57.813317 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b6d0afb8-2595-48ec-abc1-d8876708e122 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 404 len: 111 microversion: 2.1 time: 0.033605 Aug 30 18:30:57.817371 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3320/6904] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:57 2022] DELETE /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:57.823436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.824104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.831913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.832395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.832861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.833551 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.834004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.834429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.852352 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf HTTP/1.1 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '5c95e6ac-7958-4f2e-9b0c-7b3173d41acf'} Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.853883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 5c95e6ac-7958-4f2e-9b0c-7b3173d41acf could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-34d79b16-0c9c-49cc-a9cd-45ae17d4fd2a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf" status: 404 len: 111 microversion: 2.1 time: 0.035751 Aug 30 18:30:57.858707 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3585/6905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:57 2022] GET /compute/v2.1/servers/5c95e6ac-7958-4f2e-9b0c-7b3173d41acf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:57.864985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.865492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.871662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.872152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.872593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.873286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.873743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.874175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.889198 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 HTTP/1.1 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'c6931c58-bf8c-47fa-a13c-8db5ab95cf03'} Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:57.891097 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d2ec544e-47e7-4d8a-805e-cc52e37716fc tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 404 len: 111 microversion: 2.1 time: 0.032019 Aug 30 18:30:57.895298 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3321/6906] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:57 2022] DELETE /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:30:57.902401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.903370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: c6931c58-bf8c-47fa-a13c-8db5ab95cf03] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.911233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.912203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.912850 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.913770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.914428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.915194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.934431 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 HTTP/1.1 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'c6931c58-bf8c-47fa-a13c-8db5ab95cf03'} Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.936047 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance c6931c58-bf8c-47fa-a13c-8db5ab95cf03 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3110b095-af6b-41c0-b23c-cf8d1290d724 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03" status: 404 len: 111 microversion: 2.1 time: 0.039558 Aug 30 18:30:57.939644 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3586/6907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:57 2022] GET /compute/v2.1/servers/c6931c58-bf8c-47fa-a13c-8db5ab95cf03 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:57.947032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.948094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.955063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.955605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.956183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.956901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.957362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.957796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.974141 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 HTTP/1.1 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'bdf855da-f8bb-4661-92b0-f904089048b7'} Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:57.976051 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:57.980811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:57.981640 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b443c8ec-7490-4cd3-8ccc-524bbc37951c tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 404 len: 111 microversion: 2.1 time: 0.039248 Aug 30 18:30:57.983055 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3322/6908] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:57 2022] DELETE /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:30:57.990483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.991092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: bdf855da-f8bb-4661-92b0-f904089048b7] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.999227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.999752 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.000338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.001058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.001524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.001955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.017417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 HTTP/1.1 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'bdf855da-f8bb-4661-92b0-f904089048b7'} Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.019199 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. Aug 30 18:30:58.023580 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.024924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance bdf855da-f8bb-4661-92b0-f904089048b7 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:58.025950 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ce6c307-deea-4a95-b0d3-cbbed389e944 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7" status: 404 len: 111 microversion: 2.1 time: 0.039296 Aug 30 18:30:58.026506 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3587/6909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:57 2022] GET /compute/v2.1/servers/bdf855da-f8bb-4661-92b0-f904089048b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:58.035767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:58.036273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:58.042562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.043719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.044171 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.044879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.045338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.045772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.061349 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 HTTP/1.1 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '46567c13-7be5-4ac9-b050-3fc04d0b42d9'} Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:58.062929 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0548e73-8ffe-471c-8bc3-c5b1653e0994 tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 404 len: 111 microversion: 2.1 time: 0.032978 Aug 30 18:30:58.066731 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3323/6910] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:58 2022] DELETE /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:30:58.073283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:58.074659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] [instance: 46567c13-7be5-4ac9-b050-3fc04d0b42d9] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:58.081385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.081971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.082490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.083272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.083889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.084344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.099905 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] HTTP exception thrown: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Request method failure captured: Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 HTTP/1.1 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlYPzAtxi8KA5sMUkuTBpLoMIbYpIBJWICjoIJFRQ7Dc_kH6qRJQSHlX93Sk4ohYp3rPpdt6OAqSwDVltZa_jTeuWdDlgbiirhsbEW3HxxHKEDlCD2X_vGOyg9NGtbVXNbzFGEE3rcuvweIW0ZUoH8Va2V86v9SYoPzWBFcaDKlwuDs Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d18578d71b34a5c98e67bb15d523ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d18578d71b34a5c98e67bb15d523ef5"}]}] Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9d18578d71b34a5c98e67bb15d523ef5 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServerActionsTestJSON-1427860082 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 4bbd12eef4764726ba5ec944397a9603 Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServerActionsTestJSON-1427860082-project Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '46567c13-7be5-4ac9-b050-3fc04d0b42d9'} Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:58.101859 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. Aug 30 18:30:58.105848 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:30:58.107377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Returning 404 to user: Instance 46567c13-7be5-4ac9-b050-3fc04d0b42d9 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:58.108434 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b3ba6228-d7db-4549-a362-bf490780c29d tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9" status: 404 len: 111 microversion: 2.1 time: 0.039260 Aug 30 18:30:58.109759 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3588/6911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:58 2022] GET /compute/v2.1/servers/46567c13-7be5-4ac9-b050-3fc04d0b42d9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:58.118184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-70d495ad-0411-4da2-9030-6858731c666a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] Calling method '.version_select at 0x7f2d984f4ca0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:58.150604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-70d495ad-0411-4da2-9030-6858731c666a tempest-ServerActionsTestJSON-1427860082 tempest-ServerActionsTestJSON-1427860082-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529437540" status: 202 len: 0 microversion: 2.1 time: 0.036915 Aug 30 18:30:58.151718 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3324/6912] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 18:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529437540 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:31:07.298410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-849943148", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "01386d60-4bc2-478b-b4a1-e34a3107400f"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:07.359356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] validate_networks() for [('01386d60-4bc2-478b-b4a1-e34a3107400f', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:31:08.090034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:08.108153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:31:08.108579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:31:08.109055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:31:08.109465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:31:08.109874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:31:08.119005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:08.119498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:08.119953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:08.121246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:08.121695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:08.122121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:08.140014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Getting quotas for project 9348363f77e14187933c47b8e86d0e39. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:08.145394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Getting quotas for user e36669a9bee94c40a3f58de23add3372 and project 9348363f77e14187933c47b8e86d0e39. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:08.157757 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:31:08.160046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:31:08.211673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-647d2fb7-a1ff-4258-b8be-2dd9611dce15 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051604 Aug 30 18:31:08.212339 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3589/6913] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:31:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:31:08.223499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a50de6fb-613c-4a0d-b47f-eb4952190568 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:08.224139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a50de6fb-613c-4a0d-b47f-eb4952190568 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:08.228719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=9 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:08.231734 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:08.295990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a50de6fb-613c-4a0d-b47f-eb4952190568 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:08.303615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a50de6fb-613c-4a0d-b47f-eb4952190568 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1216 microversion: 2.1 time: 0.084172 Aug 30 18:31:08.304378 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3325/6914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:08 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:09.325737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:09.327506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:09.335804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:09.336568 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:09.337375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:09.338644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:09.340007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:09.340635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:09.409233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:09.419779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfcaca90-4574-4bcd-8326-d9d1aff6a343 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1274 microversion: 2.1 time: 0.098184 Aug 30 18:31:09.432977 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3590/6915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:09 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:10.440777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:10.442242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:10.450320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:10.450731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:10.451177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:10.451919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:10.452380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:10.452813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:10.661850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:10.663859 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95415973-c9c2-4111-bc72-cdbc8f848035", "tag": "716fa10d-bc2c-41ae-9755-f9db6c7526af"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:10.672069 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6c7c7a3c-0d04-466c-af67-284ed31638b0 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1316 microversion: 2.1 time: 0.234915 Aug 30 18:31:10.683826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3326/6916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:10 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:10.689670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:10.690160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:10.690630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:10.702406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] Creating event network-changed:716fa10d-bc2c-41ae-9755-f9db6c7526af for instance 95415973-c9c2-4111-bc72-cdbc8f848035 on n-h2-852771-11 Aug 30 18:31:10.708851 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-635ed081-2412-49dd-b8ca-56408c57e70f req-516e7661-fcbf-4639-910a-aa1918846455 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052844 Aug 30 18:31:10.709514 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3591/6917] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:11.693317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:11.693945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:11.701465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:11.701963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:11.702411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:11.703110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:11.703606 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:11.704047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:11.832342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:11.840226 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d35bf69-6bcb-4b9a-8665-63151f2ae71b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1316 microversion: 2.1 time: 0.150903 Aug 30 18:31:11.840800 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3327/6918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:11 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:12.861497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:12.862201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:12.868680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:12.869164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:12.869596 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:12.870773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:12.871229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:12.871748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.004336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:13.012937 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-27e45041-8eb6-47d3-9c5d-a17f6bd81e6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1316 microversion: 2.1 time: 0.156359 Aug 30 18:31:13.013451 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3592/6919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:12 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:14.033824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:14.034457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:14.041425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:14.042321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:14.042922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:14.043660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:14.044138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:14.044582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:14.178190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:14.185955 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a3eeb55-2978-40b6-a888-4ed12366dad7 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1316 microversion: 2.1 time: 0.156110 Aug 30 18:31:14.186535 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3328/6920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:14 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:14.951550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95415973-c9c2-4111-bc72-cdbc8f848035", "name": "network-vif-plugged", "status": "completed", "tag": "716fa10d-bc2c-41ae-9755-f9db6c7526af"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:14.962185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:14.962669 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:14.963100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:14.975008 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] Creating event network-vif-plugged:716fa10d-bc2c-41ae-9755-f9db6c7526af for instance 95415973-c9c2-4111-bc72-cdbc8f848035 on n-h2-852771-11 Aug 30 18:31:14.980867 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-22fdc27e-3a65-4447-bf87-c62a1cfdf505 req-408b7498-feb6-4c82-be9c-2d8d5ddc5a63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Aug 30 18:31:14.981481 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3593/6921] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:15.207489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:15.208143 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:15.215653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.216152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.216598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:15.217290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.217748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.218179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:15.355872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:15.363896 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5ea64018-ee2b-4690-a190-53cb479b11f1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1316 microversion: 2.1 time: 0.160295 Aug 30 18:31:15.364478 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3329/6922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:15 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:16.386923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:16.387594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:16.393847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:16.394331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:16.394767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:16.395463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:16.395939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:16.396370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:16.533066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:16.541072 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-df0ea83e-3b69-4995-9c40-4dca26a7fdc5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.159468 Aug 30 18:31:16.541668 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3594/6923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:16 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:16.602104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-989458405", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "01386d60-4bc2-478b-b4a1-e34a3107400f"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:16.658479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] validate_networks() for [('01386d60-4bc2-478b-b4a1-e34a3107400f', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:31:17.369538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:31:17.369980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:31:17.370467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:31:17.370891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:31:17.371316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:31:17.380493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:17.380987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:17.381436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:17.382208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:17.382671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:17.383109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:17.400234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Getting quotas for project 9348363f77e14187933c47b8e86d0e39. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:17.406479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Getting quotas for user e36669a9bee94c40a3f58de23add3372 and project 9348363f77e14187933c47b8e86d0e39. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:17.419779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:31:17.422082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:31:17.466837 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7d35230c-7014-416d-83f0-113ec9cb8cfb tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868608 Aug 30 18:31:17.467809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3330/6924] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:31:17.478495 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9335295-5939-4e3c-9138-b48dfac859df tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:17.479116 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9335295-5939-4e3c-9138-b48dfac859df tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:17.536139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9335295-5939-4e3c-9138-b48dfac859df tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:17.543988 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9335295-5939-4e3c-9138-b48dfac859df tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1216 microversion: 2.1 time: 0.069377 Aug 30 18:31:17.544569 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3595/6925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:17 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:18.565551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:18.566234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:18.580064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.580609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.581058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.581776 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.582243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.582679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.693629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:18.702074 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f66eb65f-1331-4957-8f70-df5fa2366a19 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1286 microversion: 2.1 time: 0.141452 Aug 30 18:31:18.702655 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3331/6926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:18 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:19.723431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:19.724110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:19.726180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:19.733385 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:19.733874 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:19.734310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:19.735010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:19.735460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:19.735902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:19.824795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e481516-2b26-4049-b10b-dbe86fe60e3c", "tag": "a0f72dd8-a431-49ca-bbf1-682aa76d3b5e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:19.841671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:19.842419 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:19.843105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:19.855998 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] Creating event network-changed:a0f72dd8-a431-49ca-bbf1-682aa76d3b5e for instance 9e481516-2b26-4049-b10b-dbe86fe60e3c on n-h1-852771-11 Aug 30 18:31:19.862215 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f6b583c8-4ad8-48c3-94ca-4951846173c4 req-d710ceb3-31f3-4750-a4e5-629bfad1162a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049086 Aug 30 18:31:19.863415 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3332/6927] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:19.888915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:19.897168 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c5ec685-fd00-4a57-a70a-28385bfb56d2 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.177641 Aug 30 18:31:19.906281 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3596/6928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:19 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:20.920424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:20.921169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:20.927467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.927976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.928430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.929127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.929591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.930031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:21.104993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:21.113011 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1189337e-d3d3-4a63-8736-93eeaf304a43 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.197891 Aug 30 18:31:21.113641 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3333/6929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:20 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:22.134484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:22.135112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:22.142884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.143365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.143827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.144545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.144994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.145416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.276794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:22.284725 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43bb9c72-6685-450d-bdfa-f2a5a8f128cc tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.154193 Aug 30 18:31:22.285311 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3597/6930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:22 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:23.306553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:23.307163 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:23.314481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.314974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.315418 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:23.316136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.316627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.317060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:23.450968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:23.458696 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1965c2e0-7582-4c69-979b-9e2e6d4e786b tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.156152 Aug 30 18:31:23.459275 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3334/6931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:23 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:24.479860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:24.480487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:24.483422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:24.488832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:24.489435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:24.489940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:24.490736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:24.491268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:24.492066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:24.555213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e481516-2b26-4049-b10b-dbe86fe60e3c", "name": "network-vif-plugged", "status": "completed", "tag": "a0f72dd8-a431-49ca-bbf1-682aa76d3b5e"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:24.567439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:24.568035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:24.568478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:24.581292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] Creating event network-vif-plugged:a0f72dd8-a431-49ca-bbf1-682aa76d3b5e for instance 9e481516-2b26-4049-b10b-dbe86fe60e3c on n-h1-852771-11 Aug 30 18:31:24.586650 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ade31580-fc64-43fe-acaa-63c5383f2f67 req-b0717d9e-65ea-4ae6-b49f-b89c1a4c9024 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035713 Aug 30 18:31:24.587799 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3335/6932] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:24.630330 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:24.647940 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9195c18e-4c52-4c59-9ac1-81150a7b7a4f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.172068 Aug 30 18:31:24.648546 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3598/6933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:24 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:25.670981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:25.671754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:25.678202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:25.678691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:25.679141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:25.679868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:25.680331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:25.680762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:25.817187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:25.825266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5de08bed-8351-41c8-8901-7ddee825b34e tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1316 microversion: 2.1 time: 0.160089 Aug 30 18:31:25.826036 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3336/6934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:25 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:26.846413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:26.847079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:26.854567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.855066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.855531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:26.856241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.856698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.857124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:26.992321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:27.001226 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a0e728d2-2adc-4e38-bf7f-7667dcefce5a tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1505 microversion: 2.1 time: 0.158814 Aug 30 18:31:27.001831 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3599/6935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:26 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:27.021076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:27.021645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:27.029250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.029744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.030191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.030894 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.031354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.031814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.059781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:31:27.138797 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9a00cba8-d16d-4892-96ba-db063c90ffbd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 204 len: 0 microversion: 2.1 time: 0.121305 Aug 30 18:31:27.139410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3337/6936] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:31:27 2022] DELETE /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:31:27.147759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:27.148388 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:27.154921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.155407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.155886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.156623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.157080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.157508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.290263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:27.299228 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3d7f4e97-4590-4f96-b532-e5172af59fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1511 microversion: 2.1 time: 0.155620 Aug 30 18:31:27.299967 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3600/6937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:27 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:28.320804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:28.321512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:28.323619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:28.324303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:28.331987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:28.332474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:28.332922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:28.333616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:28.334072 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:28.334503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:28.529801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:28.537885 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d812b34e-5926-478f-b988-0848b1e31ac4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 200 len: 1511 microversion: 2.1 time: 0.221306 Aug 30 18:31:28.538681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3338/6938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:28 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:28.900594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e481516-2b26-4049-b10b-dbe86fe60e3c", "name": "network-vif-deleted", "tag": "a0f72dd8-a431-49ca-bbf1-682aa76d3b5e"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:28.907443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:28.913403 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:28.913892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:28.914324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:28.940630 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] Creating event network-vif-deleted:a0f72dd8-a431-49ca-bbf1-682aa76d3b5e for instance 9e481516-2b26-4049-b10b-dbe86fe60e3c on n-h1-852771-11 Aug 30 18:31:28.945862 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-131167d2-4289-4a1b-9ace-d2b9f0331ff3 req-429cd89c-9e45-40a3-adeb-4f564de40433 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048936 Aug 30 18:31:28.947084 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3601/6939] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:29.561005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:29.561698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.568697 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.569188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.569638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.570335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.570797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.571233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.589751 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c HTTP/1.1 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9e481516-2b26-4049-b10b-dbe86fe60e3c'} Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:29.591435 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 404 to user: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6f376d1c-b1a6-4b90-b340-48802eadff8c tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 404 len: 111 microversion: 2.1 time: 0.036758 Aug 30 18:31:29.595706 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3339/6940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:29 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:31:29.602768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:29.603498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.610124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.610606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.611044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.611758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.612215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.612644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.746125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:29.753804 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8ff73dba-cddf-4d16-8c36-b3b74db51a49 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.155396 Aug 30 18:31:29.754384 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3602/6941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:29 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:29.773907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:29.776211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 661aa209-34b4-4852-a8ef-dc8fff79bf19] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.781689 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/661aa209-34b4-4852-a8ef-dc8fff79bf19/action HTTP/1.1 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 32 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: {"resize": {"flavorRef": "452"}} Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '661aa209-34b4-4852-a8ef-dc8fff79bf19', 'body': {'resize': {'flavorRef': '452'}}} Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:29.783255 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 404 to user: Instance 661aa209-34b4-4852-a8ef-dc8fff79bf19 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e4441d4f-b293-419b-aa33-7def466262cd tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "POST /compute/v2.1/servers/661aa209-34b4-4852-a8ef-dc8fff79bf19/action" status: 404 len: 111 microversion: 2.1 time: 0.014751 Aug 30 18:31:29.787666 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3340/6942] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:31:29 2022] POST /compute/v2.1/servers/661aa209-34b4-4852-a8ef-dc8fff79bf19/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:31:29.794310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:29.794924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.800875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.801354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.801786 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.802471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.802919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.803341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.934745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:29.942463 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1fddd0ae-c82a-4efe-9197-96534871126f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.152596 Aug 30 18:31:29.943036 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3603/6943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:29 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:29.962991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:29.963848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.970822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.971318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.971834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.972536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.973002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.973442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.102928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.110768 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6099187-8204-42ca-b48f-5fbaf2dae342 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.151652 Aug 30 18:31:30.111726 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3341/6944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:29 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:30.132507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "57ca4f08-96aa-4732-b0c7-13577588b7d3"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:30.134837 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.141460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.141943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.142380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.143071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.143558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.143973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.172421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.177519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: request: POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action HTTP/1.1 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 65 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: {"resize": {"flavorRef": "57ca4f08-96aa-4732-b0c7-13577588b7d3"}} Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: exception: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '95415973-c9c2-4111-bc72-cdbc8f848035', 'body': {'resize': {'flavorRef': '57ca4f08-96aa-4732-b0c7-13577588b7d3'}}} Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:30.179471 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 400 to user: Flavor 57ca4f08-96aa-4732-b0c7-13577588b7d3 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2b9b9c23-5926-44ff-8d35-86c8a9430d6f tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action" status: 400 len: 107 microversion: 2.1 time: 0.052426 Aug 30 18:31:30.183744 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3604/6945] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:31:30 2022] POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:31:30.190668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.191297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.197309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.198565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.199369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.200539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.200991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.201434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.335101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.343757 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5a1bca32-f1e4-46ff-9e35-6fdc6507bfa5 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.156775 Aug 30 18:31:30.344341 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3342/6946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:30.364984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.365598 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.372466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.372943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.373376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.374060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.374511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.374930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.510022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.517983 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f8f9bd9e-5888-4edc-8069-9b05392d6e70 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.156828 Aug 30 18:31:30.518566 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3605/6947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:30.538218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fcd55a4-9d51-4c5a-8008-f07525406972 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fcd55a4-9d51-4c5a-8008-f07525406972 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: request: POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action HTTP/1.1 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 29 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: {"resize": {"flavorRef": ""}} Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '95415973-c9c2-4111-bc72-cdbc8f848035', 'body': {'resize': {'flavorRef': ''}}} Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi '' Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.542780 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6fcd55a4-9d51-4c5a-8008-f07525406972 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6fcd55a4-9d51-4c5a-8008-f07525406972 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action" status: 400 len: 113 microversion: 2.1 time: 0.009999 Aug 30 18:31:30.547532 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3343/6948] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:31:30 2022] POST /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:31:30.552436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.553053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.560002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.560491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.560931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.561624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.562077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.562508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.696108 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.706551 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e24c6304-6fc7-46a9-b1f8-9070453a2c01 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1505 microversion: 2.1 time: 0.157781 Aug 30 18:31:30.707152 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3606/6949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:30.731141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.731637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.738703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.739193 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.739679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.740381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.740846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.741529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.755200 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c HTTP/1.1 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '9e481516-2b26-4049-b10b-dbe86fe60e3c'} Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:30.756789 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 404 to user: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6fe71fd-275a-42dd-9b8a-438831d4076d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 404 len: 111 microversion: 2.1 time: 0.032338 Aug 30 18:31:30.761241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3344/6950] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:31:30 2022] DELETE /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:31:30.766971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.767622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 9e481516-2b26-4049-b10b-dbe86fe60e3c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.773763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.774245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.774684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.775378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.776373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.776805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.790489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c HTTP/1.1 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '9e481516-2b26-4049-b10b-dbe86fe60e3c'} Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:30.792774 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 404 to user: Instance 9e481516-2b26-4049-b10b-dbe86fe60e3c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c473168d-aa4b-4c70-a1c9-4da8a75a0ce1 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c" status: 404 len: 111 microversion: 2.1 time: 0.031148 Aug 30 18:31:30.797100 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3607/6951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/9e481516-2b26-4049-b10b-dbe86fe60e3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:31:30.802810 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.803318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.809284 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.809764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.810211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.810903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.811362 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.811832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.836693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:31:30.850820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:30.913454 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-febe4ca2-7e05-4f58-9ede-c5bf144a7fba tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 204 len: 0 microversion: 2.1 time: 0.114093 Aug 30 18:31:30.914083 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3345/6952] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:31:30 2022] DELETE /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:31:30.923093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.923751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.930535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.931024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.931469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.932229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.932684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.933107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.061434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:31.069223 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ff6b6d31-cd13-43d2-9ef3-7cf500e6b8a4 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1511 microversion: 2.1 time: 0.150064 Aug 30 18:31:31.069801 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3608/6953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:32.091242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:32.091988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:32.098855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:32.099351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:32.099834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:32.100536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:32.101001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:32.101475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:32.305006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36669a9bee94c40a3f58de23add3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9348363f77e14187933c47b8e86d0e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:32.315254 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e784809-7f98-44a5-9056-a515b4855b13 tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 200 len: 1511 microversion: 2.1 time: 0.228645 Aug 30 18:31:32.315824 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3346/6954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:32 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:32.677331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95415973-c9c2-4111-bc72-cdbc8f848035", "name": "network-vif-deleted", "tag": "716fa10d-bc2c-41ae-9755-f9db6c7526af"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:32.694260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:32.694735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:32.695353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:32.711390 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] Creating event network-vif-deleted:716fa10d-bc2c-41ae-9755-f9db6c7526af for instance 95415973-c9c2-4111-bc72-cdbc8f848035 on n-h2-852771-11 Aug 30 18:31:32.718468 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5b13322e-c748-4c76-9b55-67056bf344b7 req-61ec4658-dedb-4b30-af99-e2377f66c686 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045442 Aug 30 18:31:32.719082 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3609/6955] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:33.337144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:33.337673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] [instance: 95415973-c9c2-4111-bc72-cdbc8f848035] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:33.345169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:33.345657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:33.346109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:33.346800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:33.347256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:33.347720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:33.361935 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] HTTP exception thrown: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Request method failure captured: Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 HTTP/1.1 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDldri-DrmKmA56jTorgnTOPuySPyw95JX86YHL_HByUoiM29rb1VHd0cRjAl_ScXUWtMtvJnWT3QxWlf83a5F2CvnIL3sOV9uP1JrKV0wT1eXyucgtdKpqcujeUX5Dsdyr6igJmJ0DoR2PfYUUPnttLjhXrsmD7bn1WhvubbGqhW0Z0 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9348363f77e14187933c47b8e86d0e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9348363f77e14187933c47b8e86d0e39"}]}] Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 9348363f77e14187933c47b8e86d0e39 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1435147588 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: e36669a9bee94c40a3f58de23add3372 Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-ServersNegativeTestJSON-1435147588-project Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '95415973-c9c2-4111-bc72-cdbc8f848035'} Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:33.363609 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] Returning 404 to user: Instance 95415973-c9c2-4111-bc72-cdbc8f848035 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f94493af-8cb9-4e4c-97ae-44db2c13797d tempest-ServersNegativeTestJSON-1435147588 tempest-ServersNegativeTestJSON-1435147588-project] 10.222.0.50 "GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035" status: 404 len: 111 microversion: 2.1 time: 0.031963 Aug 30 18:31:33.368214 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3347/6956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:33 2022] GET /compute/v2.1/servers/95415973-c9c2-4111-bc72-cdbc8f848035 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:32:05.488955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=25 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:05.489788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=94 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:05.695677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: .version_select at 0x7f2d988a3d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1072318427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFH0RqK4Vg0KDxAQMGoh5nvujauaqmxdSb6rtcNKm55fefre6wHrneiOAJPum4HdXG6hHGRY+mmRAZvbc0VAiD9EEUdW7KHmm/Pe5DjYw+X3RRVlVc0qfqdFAeyU+rvBg=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:05.714025 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:05.720032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:05.735442 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:32:06.743612 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35652. Aug 30 18:32:06.764465 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7dc4bb06-44dd-49c8-ad27-5348ead3a036 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.281480 Aug 30 18:32:06.765284 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3610/6957] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:32:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:06.816147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-263280848", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1072318427", "networks": [{"uuid": "ba5bc2bc-096d-40de-8aa0-4924d2bdf91d"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:06.825304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:06.825972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:06.873876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] validate_networks() for [('ba5bc2bc-096d-40de-8aa0-4924d2bdf91d', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:07.275775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:07.276396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:07.277000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:07.277533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:07.278085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:07.287952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:07.288541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:07.289063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:07.289882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:07.290440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:07.290946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:07.313680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:07.319015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:07.332105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:07.334465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:07.383380 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-82882209-16d8-48e4-b080-3dab080789a9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571511 Aug 30 18:32:07.384062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3348/6958] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:32:07.395977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c78778ec-7271-4727-b9fb-5849a994299d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:07.396997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c78778ec-7271-4727-b9fb-5849a994299d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:07.460697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c78778ec-7271-4727-b9fb-5849a994299d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:07.468055 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c78778ec-7271-4727-b9fb-5849a994299d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1262 microversion: 2.1 time: 0.077035 Aug 30 18:32:07.480873 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3611/6959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:07 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:08.492850 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:08.494272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:08.500638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:08.501428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:08.502213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:08.503135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:08.503852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:08.504380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:08.597282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:08.606310 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e88bf36f-29a6-435a-90dd-249857fe51e3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1332 microversion: 2.1 time: 0.120233 Aug 30 18:32:08.607035 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3349/6960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:08 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:09.629223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:09.629922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:09.641234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.642020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.642746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.644503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.645158 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.645780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.773287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e923e96-5245-434f-a08b-d3e9afb4208f", "tag": "fa972bbf-70d8-40ec-8316-eb2766d72132"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:09.796260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.796392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:09.796756 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.797197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.804815 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44771512-2d37-410b-a2e4-9bba15f18453 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.180168 Aug 30 18:32:09.805726 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3612/6961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:09 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:09.811212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] Creating event network-changed:fa972bbf-70d8-40ec-8316-eb2766d72132 for instance 6e923e96-5245-434f-a08b-d3e9afb4208f on n-h2-852771-11 Aug 30 18:32:09.821890 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-7e17d351-b996-4064-b404-1494121acddc req-be1a56b2-ea48-4a4e-b62d-471046f97e13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054291 Aug 30 18:32:09.822516 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3350/6962] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:10.826990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:10.827629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:10.834518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:10.834994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:10.835428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:10.836133 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:10.836586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:10.837003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:10.973601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:10.982616 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-51e35a8a-7edd-420d-8ce6-ee5b81c02346 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.160169 Aug 30 18:32:10.983313 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3613/6963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:10 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:12.006076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:12.006789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:12.013331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.013825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.014274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.014977 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.015440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.015910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.148345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:12.156615 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b68d075-4e27-434a-af65-3d58551bb848 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.155696 Aug 30 18:32:12.157197 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3351/6964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:11 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:13.177640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:13.178290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:13.185971 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.186467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.186921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:13.187665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.188128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.188562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:13.326685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:13.334533 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c34b661-ef20-4ac5-8bd6-a69e07eb7259 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.160829 Aug 30 18:32:13.335120 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3614/6965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:13 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:14.355187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:14.356526 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:14.363698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:14.364187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:14.364636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:14.365327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:14.365782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:14.366465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:14.499128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:14.507240 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b1e794b-536a-4b86-8cd7-cdf057d3d548 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.156014 Aug 30 18:32:14.507839 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3352/6966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:14 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:15.182990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e923e96-5245-434f-a08b-d3e9afb4208f", "name": "network-vif-plugged", "status": "completed", "tag": "fa972bbf-70d8-40ec-8316-eb2766d72132"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:15.194141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.194778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.195218 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.207166 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] Creating event network-vif-plugged:fa972bbf-70d8-40ec-8316-eb2766d72132 for instance 6e923e96-5245-434f-a08b-d3e9afb4208f on n-h2-852771-11 Aug 30 18:32:15.212348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-70a042f2-ccdd-4449-bc40-1193ef149304 req-d3b04e61-1dd0-4427-bf6a-63831573d151 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033084 Aug 30 18:32:15.212955 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3615/6967] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:15.527937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:15.528561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:15.535353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.535877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.536323 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.537043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.537509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.537939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.671811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:15.679563 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bcced1aa-b9f8-49fd-bcf9-02a37be76af9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1362 microversion: 2.1 time: 0.155496 Aug 30 18:32:15.680141 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3353/6968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:15 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:16.702406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:16.703111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:16.709406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.709909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.710344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:16.711023 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.711471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.711913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:16.843915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:16.851797 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2a6b23bf-1780-4c17-824f-89cf85d5625d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1554 microversion: 2.1 time: 0.154666 Aug 30 18:32:16.852382 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3616/6969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:16 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:16.874474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:16.875108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:16.881417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.881916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.882379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:16.883084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.883585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.884032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:17.011020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:17.019581 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-33baca74-6d69-4cab-b8d3-c1fde84b239d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1554 microversion: 2.1 time: 0.148977 Aug 30 18:32:17.020172 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3354/6970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:16 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:18.609911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:18.612282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:18.614423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:18.620433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:18.620935 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:18.621459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:18.622146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:18.622592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:18.623013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:18.860591 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-982fb61f-c0fd-471e-a05c-f0e45b1ec0f5 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254226 Aug 30 18:32:18.861117 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3617/6971] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:32:18 2022] POST /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:29.543754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:29.544287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:29.546291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.546975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.549235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.549883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=34 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.558576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.559078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.559558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.560301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.560765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.561201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.643790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lazy-loading 'services' on Instance uuid 6e923e96-5245-434f-a08b-d3e9afb4208f {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:32:29.716792 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5e7af38-a301-4ea2-b6c9-e43fde9062fa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments/19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633" status: 202 len: 0 microversion: 2.1 time: 0.177582 Aug 30 18:32:29.717405 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3355/6972] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:32:29 2022] DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments/19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:32:29.726486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:29.728922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:29.734411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.735177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:29.740104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.740664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.741112 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.742077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.742532 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.742962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.780961 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ca93ebf6-925f-4d6d-a299-3ad855b8158e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058774 Aug 30 18:32:29.781566 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3618/6973] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:29 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:30.795505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:30.797973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:30.804297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.804792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.805239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.805939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.806398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.806839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.836996 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9e43cc65-bfad-46b6-8072-4cddf40de150 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Aug 30 18:32:30.837787 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3356/6974] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:30 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:31.850078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:31.852285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:31.859170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.859689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.860118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.860807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.861253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.861672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.894474 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4915eb85-069a-4cb0-a45b-4022488a50af tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048484 Aug 30 18:32:31.895061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3619/6975] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:31 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:32.907299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:32.909504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:32.916367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.916854 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.917308 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:32.918200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.918664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.919099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:32.949449 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c03090f6-d7d0-4515-8cb4-a9736b5e4a31 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Aug 30 18:32:32.950025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3357/6976] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:32 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:33.961956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:33.964741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:33.971633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:33.972114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:33.972545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:33.973240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:33.973685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:33.974142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:34.009739 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9317d9c-0c6b-4028-a63f-0d212f387707 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051004 Aug 30 18:32:34.009739 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3620/6977] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:33 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:35.021455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:35.023672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:35.030604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:35.031099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:35.031594 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:35.032301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:35.032763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:35.033199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:35.064590 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ddb0b920-32e0-421a-a586-07b7673149c0 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047052 Aug 30 18:32:35.065300 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3358/6978] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:35 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:32:35.076301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:35.076806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:35.083674 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:35.084159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:35.084601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:35.085296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:35.085754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:35.086185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:35.163986 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f is not attached to volume 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments/19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 HTTP/1.1 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f is not attached to volume 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': '6e923e96-5245-434f-a08b-d3e9afb4208f', 'id': '19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633'} Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633. Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f is not attached to volume 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:35.176533 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f is not attached to volume 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f is not attached to volume 19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bc910bd-db88-4aaa-a6db-7d737ac66e47 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments/19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633" status: 404 len: 154 microversion: 2.1 time: 0.105880 Aug 30 18:32:35.181088 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3621/6979] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:32:35 2022] DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f/os-volume_attachments/19f5f1c0-9cef-4a3f-bf0e-4ea3ffd1a633 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:32:38.519279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:38.519828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:38.527401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.528019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.528905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.529639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.530098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.530532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.560872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:32:38.638627 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0e68870f-d43d-42e1-b2a4-92ebe0303b3a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 204 len: 0 microversion: 2.1 time: 0.122988 Aug 30 18:32:38.639262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3359/6980] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:32:38 2022] DELETE /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:32:38.647437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:38.648070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:38.656729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.657219 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.657658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.658356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.658808 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.659244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.791384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:38.805371 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ab92cf9-4e44-4e5b-bc7a-29dc88a0d499 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1560 microversion: 2.1 time: 0.161797 Aug 30 18:32:38.805930 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3622/6981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:38 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:39.830525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:39.831257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:39.838184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.838673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.839507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.839837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.840294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.840727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.980104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:39.988242 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9b084038-53da-4a14-9ad9-f1100ea39e58 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1560 microversion: 2.1 time: 0.161984 Aug 30 18:32:39.988826 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3360/6982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:39 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:40.985995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e923e96-5245-434f-a08b-d3e9afb4208f", "name": "network-vif-deleted", "tag": "fa972bbf-70d8-40ec-8316-eb2766d72132"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:40.999301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.999863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.000301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.012519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] Creating event network-vif-deleted:fa972bbf-70d8-40ec-8316-eb2766d72132 for instance 6e923e96-5245-434f-a08b-d3e9afb4208f on n-h2-852771-11 Aug 30 18:32:41.018476 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4d53fa43-1b2c-494d-93c5-7ca81c95306e req-0c1efe8e-e155-44e4-ae48-7a91522f6c72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036082 Aug 30 18:32:41.020196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.020842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:41.022678 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3623/6983] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:41.036290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.039349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.041012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.041774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.043156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.043875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.128463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:41.138883 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8e9c7c32-50a7-425a-9e71-0fa4e6d55760 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 200 len: 1347 microversion: 2.1 time: 0.128985 Aug 30 18:32:41.139596 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3361/6984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:41 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 1347 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:42.161104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:42.161803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: 6e923e96-5245-434f-a08b-d3e9afb4208f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:42.167993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.168471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.168904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.169584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.170030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.170450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.184219 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f HTTP/1.1 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '6e923e96-5245-434f-a08b-d3e9afb4208f'} Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:42.185816 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance 6e923e96-5245-434f-a08b-d3e9afb4208f could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1e6a3f12-8394-4c6c-864b-9da63d31b86a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f" status: 404 len: 111 microversion: 2.1 time: 0.031252 Aug 30 18:32:42.190553 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3624/6985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:42 2022] GET /compute/v2.1/servers/6e923e96-5245-434f-a08b-d3e9afb4208f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:32:42.195923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e9db3e6a-8e13-4b7f-b325-ea011fb49e11 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '.version_select at 0x7f2d98f12e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:42.216449 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e9db3e6a-8e13-4b7f-b325-ea011fb49e11 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1072318427" status: 202 len: 0 microversion: 2.1 time: 0.024227 Aug 30 18:32:42.217050 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3362/6986] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 18:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1072318427 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:32:42.234269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-611e78e2-68ad-46d8-8d45-9a05f67b2fee tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: .version_select at 0x7f2d98dcd3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1290587863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDNv6wlKekXCe2pIVmNF89wZcOVLZKlNoIiqQPRIDmzAx1NUpYenXPHiTF8uT8CNEQtTPLeKOXwzz0DBE1FDVztBy9AshKVM6XVM42WV+hrCC87PyPv6Ycq9X+ibyrPQQ=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:42.250462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-611e78e2-68ad-46d8-8d45-9a05f67b2fee tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:42.256662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-611e78e2-68ad-46d8-8d45-9a05f67b2fee tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:42.280643 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-611e78e2-68ad-46d8-8d45-9a05f67b2fee tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050242 Aug 30 18:32:42.281265 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3625/6987] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:32:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:42.331837 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-54264351", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1290587863", "networks": [{"uuid": "ba5bc2bc-096d-40de-8aa0-4924d2bdf91d"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:42.394062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] validate_networks() for [('ba5bc2bc-096d-40de-8aa0-4924d2bdf91d', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:42.758224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:42.758665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:42.759151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:42.759608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:42.760037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:42.768939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.769432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.769882 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.770624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.771090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.771557 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.788965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:42.794725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:42.806945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:42.809312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:42.856226 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-203c847e-51d9-4c76-9711-970d6c4d599b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528341 Aug 30 18:32:42.856890 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3363/6988] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:32:42.867976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-09198ae3-584a-40ae-b307-793bb78416f6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:42.868602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-09198ae3-584a-40ae-b307-793bb78416f6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:42.922831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-09198ae3-584a-40ae-b307-793bb78416f6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:42.930489 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-09198ae3-584a-40ae-b307-793bb78416f6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1261 microversion: 2.1 time: 0.066741 Aug 30 18:32:42.931110 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3626/6989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:42 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:43.953373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:43.954168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:43.961455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.962164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.962612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.963322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.963814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.964249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.044671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:44.052916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cf86c852-2999-46cd-8ba3-802d787943e7 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1331 microversion: 2.1 time: 0.104751 Aug 30 18:32:44.053535 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3364/6990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:43 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:45.074950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:45.075695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:45.082295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.082729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.083180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.083901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.084358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.084858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.174543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4ff0a9-a724-4fce-8a16-5ad39e241ea4", "tag": "6f37cd01-f29d-4dbb-b901-751ae173e528"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:45.192564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.194441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.195145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.208737 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] Creating event network-changed:6f37cd01-f29d-4dbb-b901-751ae173e528 for instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 on n-h2-852771-11 Aug 30 18:32:45.217221 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a275c080-59d9-4464-a9e5-45130df97f39 req-c78c4303-b5e4-46d9-81e1-2f90e6cfdf22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051958 Aug 30 18:32:45.218042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3365/6991] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:45.249099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:45.257248 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-49a07676-f7ef-4174-b061-875591885477 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1361 microversion: 2.1 time: 0.186222 Aug 30 18:32:45.263061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3627/6992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:45 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:46.284176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:46.284896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:46.292034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:46.292545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:46.292979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:46.294407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:46.295037 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:46.295500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:46.482320 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:46.490522 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-828c11bf-6aba-4425-8688-fd0fed7cf591 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1361 microversion: 2.1 time: 0.210628 Aug 30 18:32:46.491358 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3366/6993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:46 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:47.511795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:47.513180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:47.520172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.520663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.521103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.522224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.523054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.523802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.658888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:47.666626 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1a5ce031-6041-42f8-87bd-a4355090bda3 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1361 microversion: 2.1 time: 0.158859 Aug 30 18:32:47.667422 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3628/6994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:47 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:48.687895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:48.688516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:48.694878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.695366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.695852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.696552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.697008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.697444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.834909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:48.842712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6176d340-6ebd-4761-9dc7-f6b3ada343c4 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1361 microversion: 2.1 time: 0.159086 Aug 30 18:32:48.843288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3367/6995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:48 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:49.361437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4ff0a9-a724-4fce-8a16-5ad39e241ea4", "name": "network-vif-plugged", "status": "completed", "tag": "6f37cd01-f29d-4dbb-b901-751ae173e528"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:49.371807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.372282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.372800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.386155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] Creating event network-vif-plugged:6f37cd01-f29d-4dbb-b901-751ae173e528 for instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 on n-h2-852771-11 Aug 30 18:32:49.393444 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-d806d585-120d-4d5c-be5c-6361717a7ccd req-fa8d4199-3815-494d-a3db-b84cb3c9281e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036372 Aug 30 18:32:49.394136 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3629/6996] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:49.863380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:49.864026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:49.871803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.872360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.873455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.874170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.874632 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.875067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.026364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:50.034483 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6285b30d-1bc3-4782-8781-ac3c50a37cef tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1361 microversion: 2.1 time: 0.175033 Aug 30 18:32:50.035070 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3368/6997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:49 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:51.058498 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.059203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.066164 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.066652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.067092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.067821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.068281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.068708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.200629 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:51.209048 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f409e787-232b-476b-9ed0-f2aecad3ec8b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1553 microversion: 2.1 time: 0.155818 Aug 30 18:32:51.209639 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3630/6998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:51 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:51.237189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.237838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.246301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.246957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.247322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.248903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.249685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.250197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.385454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:51.393391 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-199f6a83-e327-48a8-9985-355f12f53f18 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1553 microversion: 2.1 time: 0.160449 Aug 30 18:32:51.393985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3369/6999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:51 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:52.875617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d65d53-89f2-4725-9e71-3c2635745f73"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:52.878004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:52.884904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.885391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.885832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.886528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.886986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.887418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.927695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:53.122558 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-956cc948-63f6-48ba-8294-bd04bc42ad87 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251057 Aug 30 18:32:53.123348 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3631/7000] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:32:52 2022] POST /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:03.818700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:03.819216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.822764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.823467 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.824300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.824964 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.831963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.832454 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.832900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.833599 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.834056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.834488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.916673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lazy-loading 'services' on Instance uuid dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:03.986017 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9926d529-e3d7-4fd2-a384-385b7989681f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments/c6d65d53-89f2-4725-9e71-3c2635745f73" status: 202 len: 0 microversion: 2.1 time: 0.171414 Aug 30 18:33:03.986618 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3370/7001] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:33:03 2022] DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments/c6d65d53-89f2-4725-9e71-3c2635745f73 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:03.993261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.994090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:03.999625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:04.002052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:04.010511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.011000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.011439 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.012163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.012621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.013049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.053211 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-591b20ea-5580-4abc-98ef-4858d3fb543c tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061998 Aug 30 18:33:04.053820 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3632/7002] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:03 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:05.067235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:05.069638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:05.075942 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.076433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.077422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.078224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.078689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.079124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.111283 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a25af9db-82ea-4466-9c55-8d5ffd59912f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Aug 30 18:33:05.111888 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3371/7003] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:05 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:06.123805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:06.125990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:06.132981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:06.133473 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:06.133915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:06.134620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:06.135076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:06.135597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:06.166428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aaf47861-928b-4564-9e8d-8fd32109a343 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Aug 30 18:33:06.167010 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3633/7004] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:06 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:07.179967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:07.182274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:07.190223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:07.190718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:07.191168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:07.191911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:07.192377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:07.192813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:07.224087 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-62f425b5-349d-465e-9da2-446a2d22cbdc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048147 Aug 30 18:33:07.224659 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3372/7005] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:07 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:08.236819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:08.239084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:08.246205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.246692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.247134 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.247942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.248397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.249362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.285375 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7b18cf84-a515-4eca-9290-fd0a9abfba9d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052874 Aug 30 18:33:08.285996 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3634/7006] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:08 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:09.298385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:09.300600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:09.307433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:09.307953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:09.308398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:09.309095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:09.309553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:09.309986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:09.339145 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a120dab5-a829-44cc-8d45-7566d115a78e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045304 Aug 30 18:33:09.339657 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3373/7007] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:09 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:09.351227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:09.351769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:09.358828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:09.359320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:09.359785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:09.360514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:09.360970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:09.361404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:09.440053 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 is not attached to volume c6d65d53-89f2-4725-9e71-3c2635745f73 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments/c6d65d53-89f2-4725-9e71-3c2635745f73 HTTP/1.1 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 is not attached to volume c6d65d53-89f2-4725-9e71-3c2635745f73 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': 'dd4ff0a9-a724-4fce-8a16-5ad39e241ea4', 'id': 'c6d65d53-89f2-4725-9e71-3c2635745f73'} Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c6d65d53-89f2-4725-9e71-3c2635745f73. Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 is not attached to volume c6d65d53-89f2-4725-9e71-3c2635745f73 Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:09.441670 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 is not attached to volume c6d65d53-89f2-4725-9e71-3c2635745f73 Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 is not attached to volume c6d65d53-89f2-4725-9e71-3c2635745f73 {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-30b04504-502f-48e0-a33d-28f39594859a tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments/c6d65d53-89f2-4725-9e71-3c2635745f73" status: 404 len: 154 microversion: 2.1 time: 0.095963 Aug 30 18:33:09.445492 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3635/7008] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:33:09 2022] DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4/os-volume_attachments/c6d65d53-89f2-4725-9e71-3c2635745f73 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:12.780938 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:12.781502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:12.788781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.789295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.789757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.790492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.790967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.791414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.819772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:12.905000 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-745adcd4-cde8-4401-a431-14f18ef46f0f tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 204 len: 0 microversion: 2.1 time: 0.127436 Aug 30 18:33:12.905666 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3374/7009] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:12 2022] DELETE /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:12.914202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:12.914745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:12.922580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.923061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.923506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.924209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.924656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.925077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:13.057098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:13.066011 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6b88cdc9-ad6e-4117-a7a3-03df3b40f28b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1559 microversion: 2.1 time: 0.155836 Aug 30 18:33:13.066593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3636/7010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:12 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:14.088296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:14.089015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:14.096877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.097372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.097822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.098527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.098993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.099439 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.234986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:14.243195 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f9715cb1-c13c-443f-8bc2-d6cb0fd796ce tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1559 microversion: 2.1 time: 0.159266 Aug 30 18:33:14.243807 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3375/7011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:14 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:14.883745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4ff0a9-a724-4fce-8a16-5ad39e241ea4", "name": "network-vif-deleted", "tag": "6f37cd01-f29d-4dbb-b901-751ae173e528"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:14.899150 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.899661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.900508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.918331 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] Creating event network-vif-deleted:6f37cd01-f29d-4dbb-b901-751ae173e528 for instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 on n-h2-852771-11 Aug 30 18:33:14.924609 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-ac5ffd97-8d65-4a00-9784-590d4b3ab580 req-efc8358f-3214-4cde-b7a4-0536a9763714 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045189 Aug 30 18:33:14.925426 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3637/7012] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:15.265547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:15.266187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:15.273216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:15.273738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:15.274187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:15.274883 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:15.275350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:15.275811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:15.310757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:15.311257 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:15.311733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:15.312190 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lazy-loading 'fault' on Instance uuid dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:15.356299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:15.364916 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c5b11947-2851-4de9-98bb-c2ad1ba40093 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 200 len: 1351 microversion: 2.1 time: 0.103352 Aug 30 18:33:15.365504 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3376/7013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:15 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:16.387854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:16.388560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: dd4ff0a9-a724-4fce-8a16-5ad39e241ea4] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:16.395740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.396224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.396661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.397351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.397801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.398227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.412411 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 HTTP/1.1 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'dd4ff0a9-a724-4fce-8a16-5ad39e241ea4'} Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:16.414341 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3d04c7a-ee28-448b-a9d1-b3f8985e0d68 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4" status: 404 len: 111 microversion: 2.1 time: 0.032293 Aug 30 18:33:16.419404 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3638/7014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:16 2022] GET /compute/v2.1/servers/dd4ff0a9-a724-4fce-8a16-5ad39e241ea4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:16.425421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8180a4f1-915f-40d7-afff-32e896b31fae tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '.version_select at 0x7f2d9cc92820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:16.445151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8180a4f1-915f-40d7-afff-32e896b31fae tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1290587863" status: 202 len: 0 microversion: 2.1 time: 0.024426 Aug 30 18:33:16.445730 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3377/7015] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 18:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1290587863 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:33:16.462798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94e64211-3b44-42e0-8a59-a214d0adf107 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: .version_select at 0x7f2d98b7fa60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1899410411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAX7YvU6oC7nEHq/ZGVD8FFSE6AAhS/MMPXmPZtxO8O5e4NVaIwikwMzUUj8hFWzH/IWRVZ7dM+Ml5qNf8Y8GbTqBmwXImSD5wR3jvwLX8fVSGva9n+JICiTsygcjrgMA=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:16.478703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-94e64211-3b44-42e0-8a59-a214d0adf107 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:16.485176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-94e64211-3b44-42e0-8a59-a214d0adf107 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:16.509070 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94e64211-3b44-42e0-8a59-a214d0adf107 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050181 Aug 30 18:33:16.509670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3639/7016] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:33:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:16.559233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1607430100", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1899410411", "networks": [{"uuid": "ba5bc2bc-096d-40de-8aa0-4924d2bdf91d"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:16.613970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] validate_networks() for [('ba5bc2bc-096d-40de-8aa0-4924d2bdf91d', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:16.982986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:16.983588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:16.984077 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:16.984495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:16.984915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:16.993936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.994422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.994865 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.995630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.996091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.996524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:17.013057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:17.018700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Getting quotas for user 217e3a6753e947a99ec98a83bf544497 and project 5c107105ac0841e08b514cb250cc371b. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:17.031405 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:17.033706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:17.080382 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-addcb6f9-81f1-4062-aa0b-be2f24e4481d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524801 Aug 30 18:33:17.080952 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3378/7017] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:33:17.091621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-38ae75ea-af07-473e-b3d2-2de1abe538ad tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:17.092333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-38ae75ea-af07-473e-b3d2-2de1abe538ad tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:17.146822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-38ae75ea-af07-473e-b3d2-2de1abe538ad tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:17.154303 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-38ae75ea-af07-473e-b3d2-2de1abe538ad tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1263 microversion: 2.1 time: 0.066637 Aug 30 18:33:17.155807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3640/7018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:17 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:18.177318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:18.178046 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:18.184542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:18.185238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:18.185793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.186763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:18.187555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:18.188104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.262488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:18.268422 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dab8506a-db83-48fd-b914-81c67f64b890 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1333 microversion: 2.1 time: 0.096272 Aug 30 18:33:18.269029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3379/7019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:18 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:19.290950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:19.291685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:19.299672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.300174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.300619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.301380 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.302417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.303050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.385754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a692d92e-08e4-4801-8338-2ad5fb14ff7b", "tag": "5294a20c-ce08-49cb-bb44-ad3337e5ca43"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:19.400597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.401426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.402091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.416027 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] Creating event network-changed:5294a20c-ce08-49cb-bb44-ad3337e5ca43 for instance a692d92e-08e4-4801-8338-2ad5fb14ff7b on n-h2-852771-11 Aug 30 18:33:19.421815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4b6056f6-55ee-414d-abbc-67237fcd5e0a req-4e6db374-ece3-4584-80c7-9b4d7ebb8dfa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041496 Aug 30 18:33:19.422444 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3380/7020] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:19.453299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:19.461484 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7ccdff3b-0b65-4202-b1b0-4589dd5f63b6 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1363 microversion: 2.1 time: 0.174918 Aug 30 18:33:19.462079 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3641/7021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:19 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:20.485164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:20.485813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:20.492266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:20.492762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:20.493213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:20.493912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:20.494380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:20.494815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:20.664028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:20.672490 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4dda62e-3df6-4a98-80a2-a347fca76201 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1363 microversion: 2.1 time: 0.193686 Aug 30 18:33:20.673083 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3381/7022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:20 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:21.693106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:21.693723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:21.700574 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.701054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.701493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.702190 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.702694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.703144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.839611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:21.848090 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a242d38f-ee98-42b0-883b-38b667315195 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1363 microversion: 2.1 time: 0.158969 Aug 30 18:33:21.848669 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3642/7023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:21 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:22.869318 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:22.869939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:22.877494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:22.877981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:22.878428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:22.879121 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:22.879608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:22.880041 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.011173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:23.019106 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4fb272ac-581c-455a-b3b7-394a3e767c9b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1363 microversion: 2.1 time: 0.153902 Aug 30 18:33:23.019732 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3382/7024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:22 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:23.446967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a692d92e-08e4-4801-8338-2ad5fb14ff7b", "name": "network-vif-plugged", "status": "completed", "tag": "5294a20c-ce08-49cb-bb44-ad3337e5ca43"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:23.459576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:23.460057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:23.460579 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.472553 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] Creating event network-vif-plugged:5294a20c-ce08-49cb-bb44-ad3337e5ca43 for instance a692d92e-08e4-4801-8338-2ad5fb14ff7b on n-h2-852771-11 Aug 30 18:33:23.477679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-8c425df7-568c-416a-8012-e64f9e47309a req-304d8bd6-b9d1-4be6-9299-9328a351175e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Aug 30 18:33:23.478631 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3643/7025] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:24.039841 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:24.040473 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:24.047309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:24.047836 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:24.048292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:24.048996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:24.049459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:24.049898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:24.186808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:24.194530 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-73013a52-7178-46c5-bd7e-4b8664225eda tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1363 microversion: 2.1 time: 0.158659 Aug 30 18:33:24.195114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3383/7026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:24 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:25.215747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:25.216441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:25.224597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.225080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.225515 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.226199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.226645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.227063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.659843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:25.667608 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd2d8dc5-53e5-4e6b-9821-6c88b053c07e tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1555 microversion: 2.1 time: 0.456111 Aug 30 18:33:25.668185 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3644/7027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:25 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1555 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:25.688165 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:25.688830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:25.695905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.696408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.696858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.697568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.698035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.698481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.842025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:25.854571 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7b922cc9-2850-48f7-9a82-73d24c58377d tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1555 microversion: 2.1 time: 0.170991 Aug 30 18:33:25.855178 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3384/7028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:25 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:27.526536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6519afe2-4543-4483-a39d-818da7cdf3fd"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:27.529070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:27.532267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:27.537636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.538102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.538557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.539237 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.539893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.540322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.775391 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d74a33d5-ea53-44f4-94cb-d96fa088a9ac tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "POST /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252913 Aug 30 18:33:27.776057 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3645/7029] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:33:27 2022] POST /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:38.480025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:38.480530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:38.484009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.484677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.485884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.486719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.494874 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.495361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.495830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.496531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.496989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.497451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.580973 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lazy-loading 'services' on Instance uuid a692d92e-08e4-4801-8338-2ad5fb14ff7b {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:38.650475 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b0cfe376-4873-4812-876b-6eecf9ca57d2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments/6519afe2-4543-4483-a39d-818da7cdf3fd" status: 202 len: 0 microversion: 2.1 time: 0.174229 Aug 30 18:33:38.651078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3385/7030] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:33:38 2022] DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments/6519afe2-4543-4483-a39d-818da7cdf3fd => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:38.658541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.660093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.664703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:38.667149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:38.675443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.675978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.676444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.677153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.677610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.678041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.711458 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-618ef541-2d06-45ba-a118-447681ceadaa tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054889 Aug 30 18:33:38.712405 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3646/7031] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:38 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:39.725702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:39.728133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:39.735560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.736066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.736521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.737230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.737703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.738141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.769441 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45639943-4a36-46b2-9e22-75bed27577a1 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Aug 30 18:33:39.770029 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3386/7032] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:39 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:40.782117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.784575 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.791578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.792070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.792510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.793213 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.793690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.794244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.826106 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-049ed318-0d0c-461a-8f49-07f4955696b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Aug 30 18:33:40.826875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3647/7033] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:41.838243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:41.840493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:41.848306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.848803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.849252 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.849960 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.850426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.850863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.881503 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-567898dd-e9b8-4993-891e-fd0ab3b33881 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Aug 30 18:33:41.882071 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3387/7034] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:41 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:42.894547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:42.896873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:42.903840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.904491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.904930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.905631 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.906081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.906510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.937117 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bef27a8e-656e-4431-b333-33ab6bdfbce9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Aug 30 18:33:42.937696 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3648/7035] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:42 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:43.949297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:43.951559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:43.958379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.958877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.959330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.960056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.960525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.960965 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.993110 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-17072044-9204-49d6-9ef9-54d9b27bf3cc tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047845 Aug 30 18:33:43.993680 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3388/7036] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:43 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:44.004866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:44.005431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:44.012316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.012803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.013247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.014327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.014789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.015224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.187577 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b is not attached to volume 6519afe2-4543-4483-a39d-818da7cdf3fd Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments/6519afe2-4543-4483-a39d-818da7cdf3fd HTTP/1.1 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b is not attached to volume 6519afe2-4543-4483-a39d-818da7cdf3fd Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': 'a692d92e-08e4-4801-8338-2ad5fb14ff7b', 'id': '6519afe2-4543-4483-a39d-818da7cdf3fd'} Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6519afe2-4543-4483-a39d-818da7cdf3fd. Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b is not attached to volume 6519afe2-4543-4483-a39d-818da7cdf3fd Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:44.189189 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b is not attached to volume 6519afe2-4543-4483-a39d-818da7cdf3fd Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b is not attached to volume 6519afe2-4543-4483-a39d-818da7cdf3fd {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16800267-09a1-4ee1-8adc-cc35630e88e2 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments/6519afe2-4543-4483-a39d-818da7cdf3fd" status: 404 len: 154 microversion: 2.1 time: 0.189838 Aug 30 18:33:44.193677 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3649/7037] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:33:43 2022] DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b/os-volume_attachments/6519afe2-4543-4483-a39d-818da7cdf3fd => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:47.538346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:47.538945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:47.546653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.547387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.548027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.549091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.549570 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.550300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.578084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:47.660264 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-be21f4f0-248d-4ba9-843d-68e707260dab tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 204 len: 0 microversion: 2.1 time: 0.126031 Aug 30 18:33:47.663512 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3389/7038] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:47 2022] DELETE /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:47.669654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:47.671138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:47.678247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.678827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.679333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.680277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.680797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.681294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.814166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:47.822186 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-546f2e04-de2e-4d00-adbe-9cbe84d678b9 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1561 microversion: 2.1 time: 0.156693 Aug 30 18:33:47.822769 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3650/7039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:47 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:48.846797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:48.847647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:48.854624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.855124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.855605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.856313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.856782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.857271 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.085093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:49.093175 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6241c78-bf2d-4631-8b4d-8a2ff4a71c0b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1561 microversion: 2.1 time: 0.252235 Aug 30 18:33:49.093766 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3390/7040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:48 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1561 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:49.596467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a692d92e-08e4-4801-8338-2ad5fb14ff7b", "name": "network-vif-deleted", "tag": "5294a20c-ce08-49cb-bb44-ad3337e5ca43"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:49.609835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.610695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.611274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.625601 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] Creating event network-vif-deleted:5294a20c-ce08-49cb-bb44-ad3337e5ca43 for instance a692d92e-08e4-4801-8338-2ad5fb14ff7b on n-h2-852771-11 Aug 30 18:33:49.631400 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c0069b79-3db2-4603-a2b3-a7440ab69095 req-6b36c7d2-ae50-4349-aa85-df49cabc280e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 Aug 30 18:33:49.632031 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3651/7041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:50.114455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:50.114994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:50.122105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.123236 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.123765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.124472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.124939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.125379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.156902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.157394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.157845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.158296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lazy-loading 'fault' on Instance uuid a692d92e-08e4-4801-8338-2ad5fb14ff7b {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:50.201249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217e3a6753e947a99ec98a83bf544497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c107105ac0841e08b514cb250cc371b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:50.209891 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-233589c7-406b-4bd5-bd9b-f6408de95b92 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 200 len: 1353 microversion: 2.1 time: 0.099116 Aug 30 18:33:50.221121 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3391/7042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:50 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:51.234518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:51.235217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] [instance: a692d92e-08e4-4801-8338-2ad5fb14ff7b] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:51.242593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.243071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.243525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.244216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.244662 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.245082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.259760 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] HTTP exception thrown: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Request method failure captured: Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b HTTP/1.1 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlegTYdHX7r19EF_JxlQoj3ua388r2XOG171-jhJ3Z7a9MJT-0LLyReUc2JZsBtvQRgqad4dgFYbs1pRzN9kp86dXMdIsRS7e2qfWnskFZraJ9Ohj-rb5nJovs_tuQOGqQxBZQ0EWNnrMscuhOcu3lR796pPv3WzXWHRrCDPJI6ltFk Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c107105ac0841e08b514cb250cc371b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c107105ac0841e08b514cb250cc371b"}]}] Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 5c107105ac0841e08b514cb250cc371b Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-577763511 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 217e3a6753e947a99ec98a83bf544497 Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestEncryptedCinderVolumes-577763511-project Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a692d92e-08e4-4801-8338-2ad5fb14ff7b'} Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:51.261485 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Returning 404 to user: Instance a692d92e-08e4-4801-8338-2ad5fb14ff7b could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-350c785f-dd15-447d-b831-3c645bd15d85 tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b" status: 404 len: 111 microversion: 2.1 time: 0.033364 Aug 30 18:33:51.266311 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3652/7043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:51 2022] GET /compute/v2.1/servers/a692d92e-08e4-4801-8338-2ad5fb14ff7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:51.272649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bdb1abe1-4fa4-4cd8-8221-4c179980ab4b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] Calling method '.version_select at 0x7f2d9845d820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:51.293623 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bdb1abe1-4fa4-4cd8-8221-4c179980ab4b tempest-TestEncryptedCinderVolumes-577763511 tempest-TestEncryptedCinderVolumes-577763511-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1899410411" status: 202 len: 0 microversion: 2.1 time: 0.024725 Aug 30 18:33:51.294473 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3392/7044] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 30 18:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1899410411 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:17.787287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f9a4e600-6251-4d61-a4e0-93052d33433a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: .version_select at 0x7f2d9cc579d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2125838186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL8cYIIL7YLEUD/CMjIppb+5uN3IMWAII9tVRX0zGcepGl5MT8f3oFH7XXBkQ7zT4kU2WR15okw7Upr04Sg1xisRUK2NchMA/kpyztoYVI8cew8g3fA+/4tTp9UO0j1OA=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:17.793656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=14 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:17.794288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=34 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:17.806851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f9a4e600-6251-4d61-a4e0-93052d33433a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:34:17.813060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-f9a4e600-6251-4d61-a4e0-93052d33433a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for user 79d69cb7ed0547898977333d748cc49a and project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:34:17.837063 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f9a4e600-6251-4d61-a4e0-93052d33433a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053889 Aug 30 18:34:17.837662 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3653/7045] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:34:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:17.895714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:17.896480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:17.901021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1602167418", "imageRef": "f72852fe-98f6-43f7-a509-329796bc1ec1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2125838186", "networks": [{"uuid": "84141dca-8a95-4204-8955-69a72878b669"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:17.954975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] validate_networks() for [('84141dca-8a95-4204-8955-69a72878b669', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:34:18.332399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:34:18.332844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:34:18.333329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:34:18.333750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:34:18.334173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:34:18.343969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:18.344460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:18.344912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:18.345669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:18.346134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:18.346575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:18.364178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:34:18.369668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for user 79d69cb7ed0547898977333d748cc49a and project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:34:18.382350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:34:18.384607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f72852fe-98f6-43f7-a509-329796bc1ec1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:34:18.431881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f24a627d-4c96-4681-bd38-fc4f10053212 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538427 Aug 30 18:34:18.432541 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3393/7046] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:34:18.443178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef5b1bfb-09bb-4590-a993-b1dfeca54603 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:18.443821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef5b1bfb-09bb-4590-a993-b1dfeca54603 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:18.500462 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ef5b1bfb-09bb-4590-a993-b1dfeca54603 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:18.513083 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef5b1bfb-09bb-4590-a993-b1dfeca54603 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1259 microversion: 2.1 time: 0.073485 Aug 30 18:34:18.514182 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3654/7047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:18 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:19.537719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:19.538561 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:19.547441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:19.547983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:19.548510 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:19.549325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:19.549824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:19.550348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:19.630914 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:19.640229 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bb32762e-a1c5-4527-866f-7c8f0d917167 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1319 microversion: 2.1 time: 0.108760 Aug 30 18:34:19.640820 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3394/7048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:19 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:20.662638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:20.663273 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:20.671886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:20.672391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:20.672851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:20.673558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:20.674018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:20.674449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:20.815246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:20.823092 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c1053ea-a704-4f66-85f1-b4ec12cfdaba tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.165035 Aug 30 18:34:20.823919 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3655/7049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:20 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:21.846229 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:21.846765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:21.854203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:21.855073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:21.855803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:21.857048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:21.857775 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:21.858437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:22.000482 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:22.008398 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5a6dea2-9c56-4a88-8724-398ba6134dc0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.166205 Aug 30 18:34:22.008988 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3395/7050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:21 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:23.031206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:23.032006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:23.038994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:23.039517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:23.039964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:23.040675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:23.041136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:23.041807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:23.183717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:23.191762 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4cf1f06d-5040-4202-be4f-c9e842b1f185 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.165398 Aug 30 18:34:23.192346 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3656/7051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:23 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:24.212954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:24.213711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:24.220432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:24.220921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:24.221365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:24.222061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:24.222520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:24.222952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:24.364559 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:24.374652 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-549ae38e-a6c0-4c39-9c67-d22507071d84 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.165519 Aug 30 18:34:24.382951 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3396/7052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:24 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:25.395793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:25.396415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:25.404268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:25.404797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:25.405481 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:25.406262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:25.406812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:25.407310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:25.556288 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:25.565254 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7bbe4249-4fa3-42b1-9295-62c878e5a429 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.173455 Aug 30 18:34:25.565858 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3657/7053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:25 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:26.588184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:26.588797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:26.596781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:26.597277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:26.597725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:26.598437 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:26.598902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:26.599341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:26.738760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:26.747807 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6fcde5e-738c-4973-8e1c-9eae9c5befc1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.163921 Aug 30 18:34:26.748629 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3397/7054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:26 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:27.769404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:27.770058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:27.776981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:27.777509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:27.779064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:27.779788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:27.780248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:27.780676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:27.914914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:27.922715 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-976dbc6c-7dc2-4901-bde2-8e562438f5b3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.157292 Aug 30 18:34:27.923290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3658/7055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:27 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:28.880374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:28.886294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:28.888966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:28.895534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:28.896264 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:28.896892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:28.909140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] Creating event network-changed:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:34:28.914222 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-4e3a1c14-b9f8-4877-a322-0a79c73110b7 req-b0404c72-1b69-4e82-97af-61a8cc546fd5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037667 Aug 30 18:34:28.914825 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3398/7056] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:28.944293 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:28.945115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:28.947053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:28.954268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:28.954761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:28.955203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:28.955956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:28.956413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:28.956842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:29.098675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:29.107057 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e327bd1c-b2d3-49b3-a7f1-519127608bfd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.167018 Aug 30 18:34:29.107695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3659/7057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:28 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:30.129498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:30.130214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:30.136512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:30.137582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:30.137989 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:30.138696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:30.139161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:30.139629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:30.347448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:30.355341 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-76edb3b4-1ab8-4651-8604-c438de45f0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.230953 Aug 30 18:34:30.356210 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3399/7058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:30 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:31.376578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:31.377192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:31.384196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:31.384678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:31.385119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:31.385817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:31.386269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:31.386709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:31.515376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:31.523234 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f501a5da-82f2-4168-b690-e38595e52a23 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.150623 Aug 30 18:34:31.523855 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3660/7059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:31 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:32.545487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:32.546448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:32.553800 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:32.554292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:32.554741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:32.555438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:32.555929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:32.556361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:32.692110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:32.699931 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-59e27bb1-16a6-4d75-94a7-f528073a9c62 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.159245 Aug 30 18:34:32.700502 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3400/7060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:32 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:33.721161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:33.721788 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:33.728667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.729168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.729611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.730322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.731547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.731989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.741520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "name": "network-vif-plugged", "status": "completed", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:33.754010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.754665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.756010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.768565 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] Creating event network-vif-plugged:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:34:33.774178 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-65c85a3e-1b2e-47e3-a835-b725c6207efb req-1dbf8669-b6c2-4612-8690-33275250ecc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037077 Aug 30 18:34:33.775114 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3401/7061] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:33.870292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:33.879657 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3c065a43-f599-401c-a360-9da1463c68c9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1359 microversion: 2.1 time: 0.162393 Aug 30 18:34:33.880320 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3661/7062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:33 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:34.901027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:34.901735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:34.908852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:34.909338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:34.909784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:34.910479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:34.910937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:34.911369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.045226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:35.053006 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-959227cc-2add-4d8a-a184-07ad76e68f21 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1549 microversion: 2.1 time: 0.156406 Aug 30 18:34:35.053577 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3402/7063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:34 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:35.073512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:35.074748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:35.081658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.082186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.082628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.083324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.083816 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.084248 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.212537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:35.220863 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4c1da562-89e1-4cc7-95ca-bd70546fb0bc tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1549 microversion: 2.1 time: 0.151326 Aug 30 18:34:35.221447 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3662/7064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:35 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:35.241540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:35.246786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:35.247688 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Searching by: {'deleted': False, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:34:35.252926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.253410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.253897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.254623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.255079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.255600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.283115 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:34:35.311245 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7bfec190-7cf7-4a3d-bbfb-69c91536ede7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073780 Aug 30 18:34:35.311891 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3403/7065] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 18:34:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:35.322895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:35.323529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:35.329529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.330005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.330438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.331122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.331609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.332034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.466338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:35.474218 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-91b310af-620c-440b-a54b-bee212e13f5c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1549 microversion: 2.1 time: 0.155177 Aug 30 18:34:35.474794 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3663/7066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:35 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:37.002241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd28ab4c-5367-4930-aa48-d9a82d606883"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:37.004831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:37.012299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:37.012922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:37.013433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.014321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:37.014779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:37.015230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.253678 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e97a31f-7351-4faa-b39a-ce2efc561aa0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255233 Aug 30 18:34:37.254380 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3404/7067] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:34:36 2022] POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:50.267711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:50.268331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:50.270934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:50.271779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=54 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:50.279793 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:50.280327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:50.281130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:50.282068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:50.282595 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:50.283121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:50.418743 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:50.428017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3b82c45e-a0b3-46c8-9c0d-c95dab3ac4be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1595 microversion: 2.1 time: 0.166435 Aug 30 18:34:50.428616 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3664/7068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:50 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:52.385285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:52.387027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:52.387815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:52.545282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:52.566429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.567161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.567798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.594231 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] Creating event network-changed:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:34:52.601792 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-11b85998-4345-41f1-b99a-37e94b08e1c8 req-330ba33d-41a1-45b9-a776-efe262577d63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218348 Aug 30 18:34:52.602883 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3405/7069] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:53.529285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1115113890"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:53.530445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:53.541719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:53.680122 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Adding security group 791e2b01-a41a-4bc7-b149-5e95e142810d to port cd7bfcc6-067f-41e1-acd4-04829883df26 Aug 30 18:34:53.999606 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f1b49a2f-30f6-4417-ad93-4f6de9126116 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action" status: 202 len: 0 microversion: 2.1 time: 0.478770 Aug 30 18:34:54.001449 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3665/7070] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:34:53 2022] POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:54.010208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:54.011007 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:54.017539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.018100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.018713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.019798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.020430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.021020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.174689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:54.183981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e233db2b-f697-4eba-9e16-18ae2e8271a1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1761 microversion: 2.1 time: 0.178461 Aug 30 18:34:54.184748 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3406/7071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:54 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:54.619580 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:54.629179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.629652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.630081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.641066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] Creating event network-changed:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:34:54.646203 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c6bfa22f-0b60-4e3c-bf58-2f8e125dfda0 req-ac0b65db-91b9-4e3d-9103-4916ff71be24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031377 Aug 30 18:34:54.646806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3666/7072] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:32.354049 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:36:32.354565 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action (ip 10.222.0.50) !!! Aug 30 18:36:32.355226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:32.356009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:32.360978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:32.363280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:32.372214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.373225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.373659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.374385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.374846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.375295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.448601 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-368258e4-e8e5-478d-aa7b-c77897a6d650 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action" status: 202 len: 0 microversion: 2.1 time: 0.096957 Aug 30 18:36:32.449313 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3407/7073] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:36:32 2022] POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:32.457095 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:36:32.459112 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:36:32.459112 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 (ip 10.222.0.50) !!! Aug 30 18:36:32.461328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:32.462136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:32.475205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:32.476114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:32.483853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.484345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.484784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.485482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.485934 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.486358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.640188 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:32.648576 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cc2a2b18-4f2e-4a84-bd8c-780b7b38355b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1763 microversion: 2.1 time: 0.193534 Aug 30 18:36:32.649154 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3667/7074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:32 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1763 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:33.671875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:33.672579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:33.678670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.679157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.679627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.680330 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.680791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.681219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.886319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:33.895501 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6a11533-8629-4f2d-9a74-4038b6f30390 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1761 microversion: 2.1 time: 0.229054 Aug 30 18:36:33.896241 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3408/7075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:33 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1761 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:47.488317 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:47.489068 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:47.495244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1115113890"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:47.495917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:47.504543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.504965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.505397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.506080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.506527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.506947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.510130 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36494. Aug 30 18:37:47.646328 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Removing security group 791e2b01-a41a-4bc7-b149-5e95e142810d from port cd7bfcc6-067f-41e1-acd4-04829883df26 Aug 30 18:37:47.951344 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fd7b8105-ce64-453b-a7eb-880b321b1381 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action" status: 202 len: 0 microversion: 2.1 time: 0.466011 Aug 30 18:37:47.952014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3668/7076] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:47 2022] POST /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:47.960971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:47.968542 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:47.969278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:47.974105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.974893 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.975531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.988693 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] Creating event network-changed:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:37:47.995026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3dd0ff11-086f-4103-9d52-b66592690f67 req-f7320fcd-83b8-47ba-94ab-9ca6994bb229 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039076 Aug 30 18:37:47.996014 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3409/7077] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:49.198066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:49.198578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:49.204749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.205260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.205701 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.206392 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.206846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.207306 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.300042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lazy-loading 'services' on Instance uuid 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:49.374251 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [812dc94e-6a31-4438-a873-2c7211cc3289] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:37:50.014195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:50.024092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.024574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.025012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.036880 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] Creating event network-changed:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:37:50.041980 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8abfbb45-fea4-4061-9199-c78c61e9fe24 req-421a432c-0698-497b-99ae-955698e34657 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033227 Aug 30 18:37:50.042586 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3410/7078] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:37:50.383607 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [812dc94e-6a31-4438-a873-2c7211cc3289] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36522. Aug 30 18:37:50.387099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0e60877b-77a3-4b90-8531-f55bf63acb4f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments/dd28ab4c-5367-4930-aa48-d9a82d606883" status: 202 len: 0 microversion: 2.1 time: 1.193955 Aug 30 18:37:50.387822 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3669/7079] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:37:49 2022] DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments/dd28ab4c-5367-4930-aa48-d9a82d606883 => generated 0 bytes in 1195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:50.397395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:50.399887 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:50.406793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.407612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.408135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.408928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.409397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.409834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.442412 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8ded51eb-9218-4ace-9d6f-224391c9f754 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Aug 30 18:37:50.442981 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3411/7080] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:50 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:51.456625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:51.459066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:51.466833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.467423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.467885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.468587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.469034 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.469460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.500393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-85a172ee-3695-46f2-8979-5239be9d3ff0 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049708 Aug 30 18:37:51.500966 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3670/7081] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:51 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:52.512864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:52.515170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:52.522060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:52.522549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:52.522995 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:52.523760 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:52.524215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:52.524648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:52.555282 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b160724b-fdc0-4349-9f54-58d3a120c2ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Aug 30 18:37:52.555873 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3412/7082] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:52 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:53.567510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:53.569781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:53.577471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.577960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.578432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.579128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.579613 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.580044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.614131 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-63ffa948-61e1-4f21-b119-6f2bc2edbcef tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050683 Aug 30 18:37:53.614997 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3671/7083] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:53 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:54.627109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:54.629608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:54.639316 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.639834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.640280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.640992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.641449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.641881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.682050 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c0a12be9-f3e4-4ae8-bb40-28f4ae9972df tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059536 Aug 30 18:37:54.682809 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3413/7084] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:54 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:55.694476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:55.696795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:55.703978 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.704470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.704915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.705627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.706084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.706516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.736394 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8119eb44-1d49-479b-90b0-78ad29d02b92 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046044 Aug 30 18:37:55.736962 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3672/7085] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:55 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:37:55.747786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:55.748401 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:55.755228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.755833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.756304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.757040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.757497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.757930 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.832458 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] HTTP exception thrown: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 is not attached to volume dd28ab4c-5367-4930-aa48-d9a82d606883 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Request method failure captured: Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: request: DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments/dd28ab4c-5367-4930-aa48-d9a82d606883 HTTP/1.1 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlgbGmSFFScjtiE29bFp7SDk5IWrkJqvzN9Mmv06LNFHskRQofmb1ybC_UlSOYU6mLgSnf-IauFeumr5kGuFLp598Dn3DFi18m-KQWkxHLeb6kdzx7r61AM4u9yhl2aVMMaxJs-Q5ZNBQlMEPqGGKa0rbfTcoQfBIPd6eFqmCEWuRhM Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_49f5d9cade5c47f6a02fa6191b38a5b1"}]}] Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 79d69cb7ed0547898977333d748cc49a Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 is not attached to volume dd28ab4c-5367-4930-aa48-d9a82d606883 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'server_id': '5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042', 'id': 'dd28ab4c-5367-4930-aa48-d9a82d606883'} Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dd28ab4c-5367-4930-aa48-d9a82d606883. Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 is not attached to volume dd28ab4c-5367-4930-aa48-d9a82d606883 Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:55.834442 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 is not attached to volume dd28ab4c-5367-4930-aa48-d9a82d606883 Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Returning 404 to user: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 is not attached to volume dd28ab4c-5367-4930-aa48-d9a82d606883 {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14a2cb5d-754c-4210-a767-74633c32f41a tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments/dd28ab4c-5367-4930-aa48-d9a82d606883" status: 404 len: 154 microversion: 2.1 time: 0.092379 Aug 30 18:37:55.838744 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3414/7086] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:37:55 2022] DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042/os-volume_attachments/dd28ab4c-5367-4930-aa48-d9a82d606883 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:59.084979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.085471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.092583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.093296 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.093726 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.094452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.094901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.095642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.121433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:59.207274 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6c27433c-4799-45ce-8353-ccc68957c700 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 204 len: 0 microversion: 2.1 time: 0.125855 Aug 30 18:37:59.207909 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3673/7087] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:59 2022] DELETE /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:59.218856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.219604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.227414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.228017 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.228522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.229244 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.229727 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.230205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.371258 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:59.379937 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a2c01c9a-0c38-4423-b0d6-20c0b5d94e4c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1555 microversion: 2.1 time: 0.167643 Aug 30 18:37:59.380519 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3415/7088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:59 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:00.401222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:00.401927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:00.409426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.409911 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.410348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.411037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.411497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.411932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.546472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:00.554697 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d62d174-fe35-4acd-84f1-21cc397f3957 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1555 microversion: 2.1 time: 0.157805 Aug 30 18:38:00.555302 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3674/7089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:00 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:01.276890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042", "name": "network-vif-deleted", "tag": "cd7bfcc6-067f-41e1-acd4-04829883df26"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:01.287730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.288215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.288653 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.303104 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] Creating event network-vif-deleted:cd7bfcc6-067f-41e1-acd4-04829883df26 for instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 on n-h2-852771-11 Aug 30 18:38:01.309131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-6f8d17e8-e7da-4b8f-9a4a-9e1bffc8d1bd req-bfdc5323-b363-4703-90fc-38888519d1f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100789 Aug 30 18:38:01.312194 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3416/7090] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:01.576576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:01.577357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:01.584428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.584913 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.585346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.586046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.586496 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.586923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.621634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.622127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.623147 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.623739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lazy-loading 'fault' on Instance uuid 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:38:01.666962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:01.674920 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2f99f58-22e9-4667-b478-14952235c896 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 200 len: 1349 microversion: 2.1 time: 0.103158 Aug 30 18:38:01.675547 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3675/7091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:01 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:02.697269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:02.698009 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:02.705741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.706228 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.706672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.707367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.707852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.708285 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.722369 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] HTTP exception thrown: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Request method failure captured: Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 HTTP/1.1 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlgbGmSFFScjtiE29bFp7SDk5IWrkJqvzN9Mmv06LNFHskRQofmb1ybC_UlSOYU6mLgSnf-IauFeumr5kGuFLp598Dn3DFi18m-KQWkxHLeb6kdzx7r61AM4u9yhl2aVMMaxJs-Q5ZNBQlMEPqGGKa0rbfTcoQfBIPd6eFqmCEWuRhM Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_49f5d9cade5c47f6a02fa6191b38a5b1"}]}] Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 79d69cb7ed0547898977333d748cc49a Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042'} Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:02.724038 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Returning 404 to user: Instance 5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bc47a13c-1db5-449d-8d35-095d68e1b088 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042" status: 404 len: 111 microversion: 2.1 time: 0.032497 Aug 30 18:38:02.728735 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3417/7092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:02 2022] GET /compute/v2.1/servers/5f3deaa7-ded9-4e16-b6e7-a9fa8ce59042 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:38:02.734269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-302062b2-d6dc-4b55-8cf7-07919f31cfe9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '.version_select at 0x7f2d9885fe50>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:02.738787 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-302062b2-d6dc-4b55-8cf7-07919f31cfe9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:38:03.746814 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-302062b2-d6dc-4b55-8cf7-07919f31cfe9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36566. Aug 30 18:38:03.766943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-302062b2-d6dc-4b55-8cf7-07919f31cfe9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2125838186" status: 202 len: 0 microversion: 2.1 time: 1.036556 Aug 30 18:38:03.767695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3676/7093] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 18:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2125838186 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:12.483939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-96ace9e8-4297-4018-a0c3-34a8da9f3c87 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: .version_select at 0x7f2d9cc38700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1971178011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ0cn1sGp3D7Ms9Y2rvCJa7/rCGLCzT5M1DMXtnPNvVKDSqu4Ur3lAKFI/MLs8Li2ET2imWE/KkuyNJ7K3sqSoZxWP6iWtBCYpJAmi51T8an87cfT4LXrENLm/fzDKIGQ=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:12.504608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-96ace9e8-4297-4018-a0c3-34a8da9f3c87 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:38:12.509828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-96ace9e8-4297-4018-a0c3-34a8da9f3c87 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for user 79d69cb7ed0547898977333d748cc49a and project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:38:12.535731 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-96ace9e8-4297-4018-a0c3-34a8da9f3c87 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056307 Aug 30 18:38:12.536270 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3418/7094] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:38:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:12.585136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:12.589605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-540650602", "imageRef": "de0e4e24-8b4a-41eb-8078-fe3d659c6150", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1971178011", "networks": [{"uuid": "84141dca-8a95-4204-8955-69a72878b669"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:12.641864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] validate_networks() for [('84141dca-8a95-4204-8955-69a72878b669', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:38:13.065918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:38:13.066346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:38:13.066824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:38:13.067241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:38:13.067691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:38:13.077514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.077928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.078367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.079100 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.079587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.080019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.097033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:38:13.102299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Getting quotas for user 79d69cb7ed0547898977333d748cc49a and project 49f5d9cade5c47f6a02fa6191b38a5b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:38:13.115056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:38:13.117282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de0e4e24-8b4a-41eb-8078-fe3d659c6150',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:38:13.164608 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a39a67b4-409e-476f-bcc1-cdc12c4dc5b5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581694 Aug 30 18:38:13.165261 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3677/7095] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:38:13.173357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=38 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:13.177608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1c7d2521-275e-46f2-85d2-d994704a063f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:13.178221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1c7d2521-275e-46f2-85d2-d994704a063f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:13.238463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1c7d2521-275e-46f2-85d2-d994704a063f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:13.245652 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1c7d2521-275e-46f2-85d2-d994704a063f tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1258 microversion: 2.1 time: 0.073181 Aug 30 18:38:13.246224 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3419/7096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:13 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:14.267370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:14.268035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:14.274918 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:14.275414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:14.275888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:14.276594 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:14.277054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:14.277486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:14.354763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:14.365084 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3e5dc760-6d64-4b0b-ae13-c9956cb5dadf tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1316 microversion: 2.1 time: 0.102029 Aug 30 18:38:14.365697 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3678/7097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:14 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:15.387169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:15.387959 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:15.395335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:15.396130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:15.396743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:15.397620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:15.398243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:15.398848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:15.548074 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:15.557444 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-14eb6717-16fc-41ad-a30f-7360c006fdc9 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.174267 Aug 30 18:38:15.558049 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3420/7098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:15 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:16.578903 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:16.579833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:16.588265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:16.588789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:16.589491 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:16.590316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:16.591437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:16.592038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:16.738852 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:16.748140 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d49249f5-6ad3-43a6-923e-440320f6bcf7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.173683 Aug 30 18:38:16.749016 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3679/7099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:16 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:17.771899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:17.773349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:17.780399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:17.780898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:17.781345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:17.782057 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:17.782515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:17.782983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:17.927951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:17.936911 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f915df8a-f83e-4f15-ae3b-8eaf6b27eb27 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.170251 Aug 30 18:38:17.937514 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3421/7100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:17 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:18.958557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:18.959285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:18.961897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:18.968687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:18.969204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:18.969688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:18.970445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:18.970955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:18.971386 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:19.125567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:19.133800 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b2692d5b-98ce-41a3-aec6-71d957193829 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.179593 Aug 30 18:38:19.134395 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3680/7101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:18 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:20.155265 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:20.156299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:20.159809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:20.163885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:20.164680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:20.165128 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:20.165844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:20.166303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:20.166786 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:20.371083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:20.380601 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44825855-d5d3-460b-af1f-08a310c4f633 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.230010 Aug 30 18:38:20.383530 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3422/7102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:20 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:21.410334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:21.410945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:21.417801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:21.418340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:21.419427 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:21.420408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:21.420872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:21.421309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:21.554851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:21.564265 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3af9e57a-b61a-4e3d-b3ab-fc97919f47dd tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.157815 Aug 30 18:38:21.564862 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3681/7103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:21 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:22.584659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:22.585377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:22.593053 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:22.593597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:22.594079 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:22.594781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:22.595295 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:22.595757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:22.749382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:22.760079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:22.760958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:22.761399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:22.773661 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] Creating event network-changed:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:38:22.779549 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4c23fa37-8b2e-4617-ba35-8752f3a7ffbc req-f8f1a3d9-b410-47d1-a287-bcf42df12cf9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035743 Aug 30 18:38:22.780531 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3682/7104] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:38:22.853310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:22.861914 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1a4e5e29-4a22-4bba-b8d9-c5ae5f6bc7b1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.281183 Aug 30 18:38:22.862531 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3423/7105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:22 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:23.879632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:23.880410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:23.885301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:23.886006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:23.893601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:23.894079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:23.894516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:23.895206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:23.895690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:23.896124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:24.029002 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:24.039121 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-741b9de3-7716-4c2d-8042-69face133eeb tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.160430 Aug 30 18:38:24.039774 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3683/7106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:23 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:25.060643 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:25.061186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:25.063140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:25.069426 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.069926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.070372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:25.071070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.071563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.072004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:25.202248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:25.210031 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6cfc900b-4ba7-4646-91fd-f2bea4963076 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.153464 Aug 30 18:38:25.210616 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3424/7107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:25 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:26.231835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:26.232450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:26.239290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.240049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.240480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.241162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.241611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.242030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.373289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:26.381927 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-214f36cc-e7d8-4971-b27f-9eee4815f5d5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.154438 Aug 30 18:38:26.382575 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3684/7108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:26 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:26.550933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "name": "network-vif-plugged", "status": "completed", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:26.562144 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.562625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.563062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.573950 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] Creating event network-vif-plugged:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:38:26.579692 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d4f3da03-e37f-4fc9-8bb6-ec38042e9139 req-7a0724b5-d499-4440-af71-1f002cbddcd4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088672 Aug 30 18:38:26.580284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3425/7109] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:27.404851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:27.405464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:27.412300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:27.412778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:27.413214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:27.413902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:27.414350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:27.414772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:27.551272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:27.559177 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-194a7d71-c031-40ea-bc20-ae2a61568465 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1358 microversion: 2.1 time: 0.158775 Aug 30 18:38:27.559897 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3685/7110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:27 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:28.582083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:28.582714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:28.588943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.589425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.589869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.591294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.591782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.592214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.723581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:28.731347 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f447e457-ecbe-4132-ac31-1332a3b6c8c6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1549 microversion: 2.1 time: 0.154514 Aug 30 18:38:28.731957 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3426/7111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:28 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:28.752456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:28.753071 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:28.759865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.760343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.760776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.761461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.762531 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.763103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.891970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:28.899679 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2f0ceceb-c943-4d1d-924c-95a4affc1181 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1549 microversion: 2.1 time: 0.151017 Aug 30 18:38:28.900254 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3686/7112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:28 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:28.919603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:28.924347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:28.925135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Searching by: {'deleted': False, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1'} {{(pid=122123) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:38:28.930455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.930944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.931392 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.932169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.932631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.933068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.957518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.multi_cell_list [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:38:28.984884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c81111c4-2b5d-4be4-bfde-cd8b462efec1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069286 Aug 30 18:38:28.985486 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3427/7113] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 18:38:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:38:28.998204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:28.998823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:29.004982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.005476 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.005917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.006620 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.007078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.007530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.138729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:29.146506 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-75e89816-fa67-4094-8751-a369bdf1c5be tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1549 microversion: 2.1 time: 0.152957 Aug 30 18:38:29.147088 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3687/7114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:28 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:30.655583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abea6923-5cbc-4e95-b9e8-8f66ff0d596f"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:30.657936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:30.664717 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:30.665210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:30.665660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:30.666358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:30.666818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:30.667251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:30.902961 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-10ab672a-103d-455f-a542-86948829532b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251269 Aug 30 18:38:30.908708 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3428/7115] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 18:38:30 2022] POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:41.667706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:41.668418 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:41.670905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=15 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:41.671570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=58 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:41.677065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:41.677544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:41.677979 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:41.678665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:41.679111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:41.679562 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:41.809884 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:41.818221 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d98ce079-d6cc-47ec-b625-0adeaea74fda tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1595 microversion: 2.1 time: 0.154646 Aug 30 18:38:41.818791 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3688/7116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:41 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:43.398828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:43.399645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=13 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:43.400312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:43.405978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:43.420668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:43.421159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:43.421596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:43.434509 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] Creating event network-changed:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:38:43.440214 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-afab0303-1210-484a-a765-1a7eadc62bb9 req-2385f230-5158-4eea-b2e2-1c83ca387696 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042966 Aug 30 18:38:43.441062 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3429/7117] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:44.542910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1885712926"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:44.543512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:44.550924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:44.551394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:44.552064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:44.552779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:44.553412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:44.553845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:44.767348 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Adding security group c8e9151a-7e60-4248-8a42-900b8873797b to port c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 Aug 30 18:38:45.380387 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b6559fa-48a3-4fe9-a8d3-6b6962083be7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.841851 Aug 30 18:38:45.381376 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3689/7118] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:44 2022] POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:45.391183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:45.391922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:45.398106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:45.398592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:45.399035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.399765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:45.400225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:45.400656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.459204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:45.470467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:45.470960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:45.471639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.483809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] Creating event network-changed:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:38:45.490350 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-88bba841-3b7f-4200-8369-0ce5f58cd44b req-de346e13-b780-4bef-8c32-6453093b90c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Aug 30 18:38:45.490982 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3690/7119] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:45.620114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:45.630264 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b2fecc24-7d07-45fb-b918-c3b77fc74eb2 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1760 microversion: 2.1 time: 0.244431 Aug 30 18:38:45.630867 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3430/7120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:45 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1760 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:00.571648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:00.574009 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:00.577463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.578124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.583976 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.584465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.584907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.585604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.586058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.586484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.671556 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f2798ea-a420-42a4-af34-10f7ffda16d6 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.103990 Aug 30 18:39:00.672225 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3691/7121] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:39:00 2022] POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:00.680384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:00.681021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:00.683759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.684447 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=8 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.690607 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.691092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.691592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.692348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.692870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.693373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.970470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:00.978854 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5552370-acb9-4211-8d12-fd69f204b0a7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1752 microversion: 2.1 time: 0.302416 Aug 30 18:39:00.979452 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3431/7122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:00 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:02.003156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:02.003880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:02.010113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.010591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.011022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.011730 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.012176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.013200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.158807 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:02.167066 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8eca21fd-cb8a-4a74-8cf8-0350f6b6acb3 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.169363 Aug 30 18:39:02.167671 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3692/7123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:01 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:03.188792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:03.189410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:03.192690 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:39:03.192835 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 (ip 10.222.0.50) !!! Aug 30 18:39:03.203758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.204256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.204707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.205414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.205879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.206324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.349331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:03.357762 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-286da416-13d4-4d86-a784-6a353279668e tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.173329 Aug 30 18:39:03.358346 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3432/7124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:03 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:04.379036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:04.379691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:04.387051 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.387682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.388146 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.388834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.389285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.389711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.535783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:04.544524 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eaab8e8e-4cbf-4c09-a74b-a4f63356dc57 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.169449 Aug 30 18:39:04.545372 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3693/7125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:04 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:05.565754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:05.566291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:05.573211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.573702 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.574148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:05.574885 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.575436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.575888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:05.731993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:05.740480 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0cf73637-99a8-4c78-92bd-9d9c73e3f4fa tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.178766 Aug 30 18:39:05.741063 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3433/7126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:05 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:06.762341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:06.763142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:06.769826 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:06.770300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:06.770732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:06.771420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:06.771904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:06.772315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:06.914268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:06.923150 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c508d490-07a9-497b-adbf-18d8e00ab582 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.164807 Aug 30 18:39:06.923757 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3694/7127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:06 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:07.944624 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:07.945242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:07.952692 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.953183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.953623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:07.954307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.954762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.955218 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.100369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:08.108753 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf75ae8a-5766-4269-b789-a9ea267a094b tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.168242 Aug 30 18:39:08.109332 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3434/7128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:07 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:09.179145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:09.179797 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:09.186357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:09.186836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:09.187270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:09.187990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:09.188445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:09.188872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:09.337787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:09.346838 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-389aa4d7-afbd-4ed1-8ef0-d83a42c47965 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.220606 Aug 30 18:39:09.347435 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3695/7129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:09 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:10.367588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:10.368220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:10.376130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:10.376626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:10.377076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:10.377781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:10.378243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:10.378680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:10.524547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:10.533333 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-953c0bb9-8b84-4eb9-870d-40ed54340d04 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.170000 Aug 30 18:39:10.533917 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3435/7130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:10 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:11.556026 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:11.556582 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:11.563747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.564221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.564648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.565327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.565771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.566189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.710643 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:11.719847 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5c316d09-52d0-4a46-9b2e-6bf75f43887c tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1757 microversion: 2.1 time: 0.167763 Aug 30 18:39:11.720427 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3696/7131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:11 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:12.741065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:12.741725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:12.749718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:12.750213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:12.750659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:12.751387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:12.751878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:12.752349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:12.893068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:12.901411 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2e09f017-4506-4125-bde1-d6e678f6f294 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1760 microversion: 2.1 time: 0.164507 Aug 30 18:39:12.901985 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3436/7132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:12 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:45.160555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1885712926"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:45.161172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:45.163509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:45.164303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:45.170343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.170838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.171958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.172677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.173177 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.173610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.312368 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.network.security_group_api [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Removing security group c8e9151a-7e60-4248-8a42-900b8873797b from port c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 Aug 30 18:39:45.628641 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b9c3c342-73f6-49c4-b5c7-cbd5a85deb59 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.472250 Aug 30 18:39:45.633250 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3697/7133] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:39:45 2022] POST /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:45.638349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:45.647511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=12 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:45.650028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:45.652109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.653114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.654421 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.668958 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] Creating event network-changed:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:39:45.674739 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-21236d70-9f46-448b-828c-61b68ecd0ba8 req-6c57c02c-ca06-40e6-97b6-0322ff36fe11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040441 Aug 30 18:39:45.676199 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3437/7134] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:46.842723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:46.843217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:46.849297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:46.849779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:46.850216 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:46.850907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:46.851359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:46.851817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:46.936909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lazy-loading 'services' on Instance uuid a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:39:47.014770 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d4a31556-0c51-4ae0-a953-b154825431b7 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments/abea6923-5cbc-4e95-b9e8-8f66ff0d596f" status: 202 len: 0 microversion: 2.1 time: 0.176651 Aug 30 18:39:47.015558 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3698/7135] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:39:46 2022] DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments/abea6923-5cbc-4e95-b9e8-8f66ff0d596f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:47.025753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:47.028241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:47.035226 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:47.035758 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:47.036221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:47.037085 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:47.037551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:47.038064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:47.073567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afcd641e-cc5b-4d57-93e6-07fe234f12ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053379 Aug 30 18:39:47.074151 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3438/7136] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:47 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:39:47.695227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:47.705694 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:47.706163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:47.706586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:47.718418 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] Creating event network-changed:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:39:47.725224 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a5ba7a59-57dc-48d9-b16b-6f20312852ae req-d3aa109f-7e52-40ea-bbac-c1affd1a52f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Aug 30 18:39:47.725929 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3699/7137] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:39:48.086695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:48.088858 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:48.096537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.097027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.097479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.098185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.098642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.099309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.137842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-48b55f8f-4e17-405c-b0aa-2cd61af6a576 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054104 Aug 30 18:39:48.142842 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3439/7138] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:48 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:49.152347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:49.154810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:49.161124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:49.161609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:49.162048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.162746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:49.163201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:49.163668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.194712 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0c586a5f-a560-4ae2-b39d-8496c83eecc8 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047706 Aug 30 18:39:49.195292 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3700/7139] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:49 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:50.207487 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:50.209678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:50.217763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.218263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.218711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.219420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.219911 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.220348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.254327 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d35f7c12-4c7f-4191-a1e6-12cecfc727a5 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050875 Aug 30 18:39:50.254899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3440/7140] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:50 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:51.268059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:51.270310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:51.277802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:51.278292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:51.278729 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:51.279442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:51.279907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:51.280335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:51.316616 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c4dd1d65-0437-4251-bda0-6253ebcb3f13 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052740 Aug 30 18:39:51.317204 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3701/7141] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:51 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:52.329063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:52.331289 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:52.338095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.338581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.339026 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.339768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.340235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.340662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.369904 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf66f03b-731f-44a7-8388-814f8e87f54d tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044961 Aug 30 18:39:52.370463 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3441/7142] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 18:39:52 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:52.381615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:52.382215 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:52.389362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.389840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.390271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.390953 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.391401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.391847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.467447 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] HTTP exception thrown: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 is not attached to volume abea6923-5cbc-4e95-b9e8-8f66ff0d596f Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Request method failure captured: Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: request: DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments/abea6923-5cbc-4e95-b9e8-8f66ff0d596f HTTP/1.1 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlgbGmSFFScjtiE29bFp7SDk5IWrkJqvzN9Mmv06LNFHskRQofmb1ybC_UlSOYU6mLgSnf-IauFeumr5kGuFLp598Dn3DFi18m-KQWkxHLeb6kdzx7r61AM4u9yhl2aVMMaxJs-Q5ZNBQlMEPqGGKa0rbfTcoQfBIPd6eFqmCEWuRhM Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_49f5d9cade5c47f6a02fa6191b38a5b1"}]}] Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 79d69cb7ed0547898977333d748cc49a Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 is not attached to volume abea6923-5cbc-4e95-b9e8-8f66ff0d596f Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'server_id': 'a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0', 'id': 'abea6923-5cbc-4e95-b9e8-8f66ff0d596f'} Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id abea6923-5cbc-4e95-b9e8-8f66ff0d596f. Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 is not attached to volume abea6923-5cbc-4e95-b9e8-8f66ff0d596f Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:52.469126 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 is not attached to volume abea6923-5cbc-4e95-b9e8-8f66ff0d596f Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Returning 404 to user: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 is not attached to volume abea6923-5cbc-4e95-b9e8-8f66ff0d596f {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fa796475-389f-46a4-976a-2f7fb8660197 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments/abea6923-5cbc-4e95-b9e8-8f66ff0d596f" status: 404 len: 154 microversion: 2.1 time: 0.093139 Aug 30 18:39:52.473886 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3702/7143] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 18:39:52 2022] DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0/os-volume_attachments/abea6923-5cbc-4e95-b9e8-8f66ff0d596f => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:55.722652 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:55.723275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:55.730067 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.730690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.731803 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:55.732515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.732988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.733430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:55.759750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:39:55.841669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8aac34c3-5012-4432-9a96-3582438df184 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 204 len: 0 microversion: 2.1 time: 0.122322 Aug 30 18:39:55.842637 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3442/7144] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:39:55 2022] DELETE /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:39:55.852963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:55.853588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:55.868217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.868717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.869157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:55.869865 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.870322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.870748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:56.011084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:56.019670 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-311c63e5-2b7b-455f-9eee-75c28879d262 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1555 microversion: 2.1 time: 0.172454 Aug 30 18:39:56.020258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3703/7145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:55 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:57.041331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:57.042088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:57.050680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:57.051182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:57.051670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:57.052386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:57.052852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:57.053297 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:57.184834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:57.192729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8c16f0eb-f1e6-4652-b543-8774c38d94ad tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1555 microversion: 2.1 time: 0.155699 Aug 30 18:39:57.193316 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3443/7146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:57 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:58.026459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0", "name": "network-vif-deleted", "tag": "c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:58.043980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.044706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.045104 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.057729 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] Creating event network-vif-deleted:c61610ab-b23e-4cf2-a9f2-d7c9b0df1cb0 for instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 on n-h1-852771-11 Aug 30 18:39:58.063226 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-631c838a-4803-4c99-bf93-9c779ab27aa6 req-39620fc8-562d-41bd-9f8e-65a7236b9ba0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Aug 30 18:39:58.064290 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3704/7147] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:58.214463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:58.215107 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:58.223682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.224122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.224577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.225296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.225763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.226206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.260726 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.261222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.261709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.262476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lazy-loading 'fault' on Instance uuid a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:39:58.306931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d69cb7ed0547898977333d748cc49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f5d9cade5c47f6a02fa6191b38a5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:58.316927 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c2d64dc-ac6a-4f29-949c-fc7102b10741 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 200 len: 1348 microversion: 2.1 time: 0.107021 Aug 30 18:39:58.317568 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3444/7148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:58 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:59.339656 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:59.340893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] [instance: a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:59.347349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:59.347870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:59.348344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:59.349047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:59.349504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:59.349931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:59.364702 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] HTTP exception thrown: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Request method failure captured: Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 HTTP/1.1 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlgbGmSFFScjtiE29bFp7SDk5IWrkJqvzN9Mmv06LNFHskRQofmb1ybC_UlSOYU6mLgSnf-IauFeumr5kGuFLp598Dn3DFi18m-KQWkxHLeb6kdzx7r61AM4u9yhl2aVMMaxJs-Q5ZNBQlMEPqGGKa0rbfTcoQfBIPd6eFqmCEWuRhM Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/49f5d9cade5c47f6a02fa6191b38a5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_49f5d9cade5c47f6a02fa6191b38a5b1"}]}] Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: 49f5d9cade5c47f6a02fa6191b38a5b1 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967945028 Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: 79d69cb7ed0547898977333d748cc49a Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestMinimumBasicScenario-1967945028-project Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': 'a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0'} Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:59.366328 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Returning 404 to user: Instance a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e16b322d-e882-4dd0-b327-ed5c0f6c86e1 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0" status: 404 len: 111 microversion: 2.1 time: 0.033295 Aug 30 18:39:59.371207 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3705/7149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:59 2022] GET /compute/v2.1/servers/a97b7eae-7f97-4ba5-9247-d3b7eccbd3f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:59.376352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-af589f2c-adf7-4c29-91a4-3386fc428227 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] Calling method '.version_select at 0x7f2d98578940>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:59.396019 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-af589f2c-adf7-4c29-91a4-3386fc428227 tempest-TestMinimumBasicScenario-1967945028 tempest-TestMinimumBasicScenario-1967945028-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1971178011" status: 202 len: 0 microversion: 2.1 time: 0.023386 Aug 30 18:39:59.396600 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3445/7150] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 30 18:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1971178011 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:40:08.661162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c44eea8c-8767-4bc5-b844-772408f4c228 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: .version_select at 0x7f2d93868940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1823488292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWg1ZeL77/HnTElfJxk+BTPE8fuySXbKv6zGQ/Vn17yOjgFQUEGXd4monNrAjSrbM5QJTfqYvVZ8m9hrlN9Bc9Z6r2zU5x7fzZOxdxilRwoDMP8eagrIDq+wuq9PJPbJg=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:08.677767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c44eea8c-8767-4bc5-b844-772408f4c228 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:08.683973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-c44eea8c-8767-4bc5-b844-772408f4c228 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:08.708688 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c44eea8c-8767-4bc5-b844-772408f4c228 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.216050 Aug 30 18:40:08.709295 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3706/7151] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:40:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:14.538682 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:14.539714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:14.544907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1228768188", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "70003696-521c-4262-8bbf-3cf65eb2083e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1823488292", "security_groups": [{"name": "tempest-secgroup-smoke-605030410"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:14.665175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] validate_networks() for [('70003696-521c-4262-8bbf-3cf65eb2083e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:40:15.105994 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:40:15.106428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:40:15.106910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:40:15.107328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:40:15.107781 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:40:15.116934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:15.117424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:15.117868 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:15.118601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:15.119088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:15.119552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:15.138398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:15.143747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:15.156230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:40:15.158545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:40:15.209759 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d8788024-5399-4b33-ad33-699c2c339e38 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672945 Aug 30 18:40:15.210736 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3446/7152] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:40:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:40:15.218514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:15.224283 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-2498c6f7-dba8-426b-a7f6-85fc1dc44bda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:15.224907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-2498c6f7-dba8-426b-a7f6-85fc1dc44bda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:15.228775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:15.293231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-2498c6f7-dba8-426b-a7f6-85fc1dc44bda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:15.300415 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-2498c6f7-dba8-426b-a7f6-85fc1dc44bda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1267 microversion: 2.1 time: 0.083000 Aug 30 18:40:15.301233 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3707/7153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:15 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:16.322278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:16.322908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:16.337660 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.338162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.338825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.339639 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.340274 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.340895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.416860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:16.428467 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5af49882-e1be-4014-b120-aa1e4402cdeb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1319 microversion: 2.1 time: 0.109985 Aug 30 18:40:16.429090 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3447/7154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:16 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:17.453653 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:17.454191 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:17.465149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.465641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.466079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.466792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.467246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.467699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.615501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:17.625229 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-43daeb80-992c-4213-991f-3d80a527b2c9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.177137 Aug 30 18:40:17.626376 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3708/7155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:17 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:17.924848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134165fc-11e2-4ece-955b-84fbde66652c", "tag": "f2863144-5409-4bba-9ff6-6c8ac3d33ae6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:17.936108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.936889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.937579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.949712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] Creating event network-changed:f2863144-5409-4bba-9ff6-6c8ac3d33ae6 for instance 134165fc-11e2-4ece-955b-84fbde66652c on n-h2-852771-11 Aug 30 18:40:17.954793 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-9976fc10-d218-4f11-b3c0-33f3ae751ddf req-0408b554-be13-40f8-8ee8-082cbf92facd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034023 Aug 30 18:40:17.955539 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3448/7156] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:18.647963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:18.648490 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:18.655623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:18.656103 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:18.656541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:18.657227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:18.657681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:18.658102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:18.788516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:18.798301 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4b98a0f0-3c99-419e-90f4-1559a80d89bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.154330 Aug 30 18:40:18.798897 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3709/7157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:18 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:19.821021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:19.821657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:19.828546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:19.829032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:19.829484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:19.830189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:19.830658 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:19.831099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:19.966305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:19.974047 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5f1bd93d-ca36-4a8b-a74d-09d689bb0e67 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.158200 Aug 30 18:40:19.974645 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3449/7158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:19 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:20.995452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:20.996969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:21.003449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.003966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.004406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:21.005096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.005548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.005973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:21.136321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:21.144752 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1730bc7e-38f9-4a16-aa25-7d7c1f877fd5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.153338 Aug 30 18:40:21.145332 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3710/7159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:20 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:22.165280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:22.165915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:22.173681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:22.174209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:22.174705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:22.175408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:22.175908 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:22.176353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:22.307884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:22.316608 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5e790003-5228-48d8-af84-95cce42da412 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.155318 Aug 30 18:40:22.317187 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3450/7160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:22 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:23.337162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:23.337787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:23.345217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:23.345675 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:23.346137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:23.346863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:23.347323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:23.347780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:23.355298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134165fc-11e2-4ece-955b-84fbde66652c", "name": "network-vif-plugged", "status": "completed", "tag": "f2863144-5409-4bba-9ff6-6c8ac3d33ae6"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:23.367695 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:23.368350 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:23.369348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:23.381849 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] Creating event network-vif-plugged:f2863144-5409-4bba-9ff6-6c8ac3d33ae6 for instance 134165fc-11e2-4ece-955b-84fbde66652c on n-h2-852771-11 Aug 30 18:40:23.386880 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-842d06e3-13ed-4ff8-b4dd-a97f0ac725bb req-e77f2bdb-23df-474b-a088-84727dd3c4b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035327 Aug 30 18:40:23.388276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3451/7161] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:23.504503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:23.512380 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3048ce8e-1c81-470b-aa8a-f88b1f5d593a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1392 microversion: 2.1 time: 0.179244 Aug 30 18:40:23.513194 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3711/7162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:23 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:24.536045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:24.536677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:24.542951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.543452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.544001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.545183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.545657 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.546097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.683130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:24.692201 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d444bfbd-7e10-4223-bc4d-8eb00e3d2657 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1564 microversion: 2.1 time: 0.161437 Aug 30 18:40:24.692782 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3452/7163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:24 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:24.712482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:24.713397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:24.720809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.721294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.721724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.722411 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.722858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.723279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.853745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:24.862302 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-200d619a-58ad-4275-80a1-2342fee1e28b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1564 microversion: 2.1 time: 0.153717 Aug 30 18:40:24.862875 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3712/7164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:24 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:26.748814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:26.750114 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:26.752220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:26.752453 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:26.753411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:26.760304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:26.760802 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:26.761247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:26.761956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:26.762442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:26.763135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:26.814096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134165fc-11e2-4ece-955b-84fbde66652c", "tag": "f2863144-5409-4bba-9ff6-6c8ac3d33ae6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:26.823655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:26.824348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:26.824780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:26.837059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] Creating event network-changed:f2863144-5409-4bba-9ff6-6c8ac3d33ae6 for instance 134165fc-11e2-4ece-955b-84fbde66652c on n-h2-852771-11 Aug 30 18:40:26.842465 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-01d21fc0-405d-405a-8cea-90c0817eadf3 req-3a052865-e136-4fc8-b7b1-8e5924e15cb0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095065 Aug 30 18:40:26.843409 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3713/7165] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:26.940477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:26.949460 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-45fdc0c8-5d21-4817-bbb7-8eea9c58510b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1564 microversion: 2.1 time: 0.205299 Aug 30 18:40:26.950160 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3453/7166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:26 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:50.204309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=15 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.205063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.209286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:50.211686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:50.219381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:50.219900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:50.220349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:50.221058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:50.221517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:50.221951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:50.289256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e417507f-b986-48e5-821b-4832e6caadc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action" status: 200 len: 24575 microversion: 2.1 time: 0.086723 Aug 30 18:40:50.289991 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3714/7167] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:50 2022] POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action => generated 24575 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:40:56.709754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:56.710407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:56.712251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:56.713100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:56.719880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.720390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.720814 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.721508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.721967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.722399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.792036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-572d7da2-ef4a-4351-99cd-1423f36efd94 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action" status: 202 len: 0 microversion: 2.1 time: 0.086338 Aug 30 18:40:56.792700 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3454/7168] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:56 2022] POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:40:56.801601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:56.802615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:56.810401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.810968 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.811415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.812159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.812617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.813048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.946967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:56.956425 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-293b29ab-a55f-4429-9bff-29beab7bab39 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1687 microversion: 2.1 time: 0.159000 Aug 30 18:40:56.957081 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3715/7169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:56 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:57.981536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:57.982250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:57.988955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:57.989450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:57.989903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:57.990605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:57.991071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:57.991537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:58.130719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:58.139221 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3c8e4ba2-24a1-477c-a8c4-73ded6c345e4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1667 microversion: 2.1 time: 0.163273 Aug 30 18:40:58.139842 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3455/7170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:57 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:59.230389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:59.233548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:59.241945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.242509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.242981 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.243769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.244824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.244824 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.296190 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ef0d970e-2fd1-4520-9a99-ae61ec01b693 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action" status: 200 len: 32650 microversion: 2.1 time: 0.069537 Aug 30 18:40:59.296860 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3716/7171] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:59 2022] POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action => generated 32650 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:40:59.308213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:59.308769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:59.316456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.316978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.317436 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.318148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.318620 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.319063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.389869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7ba4732e-116e-4e95-abcc-dc2aeb52f7a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action" status: 202 len: 0 microversion: 2.1 time: 0.085287 Aug 30 18:40:59.390519 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3456/7172] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:59 2022] POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:40:59.399319 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:59.400042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:59.407695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.408182 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.408612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.409301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.409749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.410172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.552609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:59.561938 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c9548c0f-826d-4e4a-a955-acaece0aa7c4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1674 microversion: 2.1 time: 0.166771 Aug 30 18:40:59.567258 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3717/7173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:59 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:00.586116 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:00.586750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:00.594298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.594840 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.595425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.596213 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.596693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.597138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.733600 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:00.741486 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-842b6dc7-6ee1-494d-824a-88a312fc6648 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1682 microversion: 2.1 time: 0.160569 Aug 30 18:41:00.742061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3457/7174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:00 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:00.832869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:00.835081 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:00.843243 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.843713 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.844170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.844868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.845331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.845766 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.896822 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8999bdd9-6ed2-496f-8574-ec67c334c083 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action" status: 200 len: 35607 microversion: 2.1 time: 0.067756 Aug 30 18:41:00.897457 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3718/7175] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:00 2022] POST /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c/action => generated 35607 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:41:02.244529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:02.245034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:02.247227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134165fc-11e2-4ece-955b-84fbde66652c", "tag": "f2863144-5409-4bba-9ff6-6c8ac3d33ae6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:02.252260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.252925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.253382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.254089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.254731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.255335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.262864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.263356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.263853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.276137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] Creating event network-changed:f2863144-5409-4bba-9ff6-6c8ac3d33ae6 for instance 134165fc-11e2-4ece-955b-84fbde66652c on n-h2-852771-11 Aug 30 18:41:02.281742 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-97dcb9c6-c397-4b7a-a5c9-fde423015bb0 req-b92713bf-fd72-43d3-b5fd-3290426541ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038684 Aug 30 18:41:02.285272 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3719/7176] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:02.285738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:41:02.400170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a2c09a6e-f2ed-464b-8630-dc19abaa0085 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 204 len: 0 microversion: 2.1 time: 0.159330 Aug 30 18:41:02.401119 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3458/7177] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:41:02 2022] DELETE /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:41:02.410984 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:02.412039 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:02.419160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.420382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.420832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.421724 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.422359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.422792 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.576540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:02.584500 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e2f857a5-dac5-490b-853e-18ea942cd296 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1688 microversion: 2.1 time: 0.178452 Aug 30 18:41:02.585100 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3720/7178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:02 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:03.607191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:03.608153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:03.615160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:03.615696 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:03.616157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:03.616855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:03.617321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:03.617757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:03.824177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:03.832716 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5463bc3-6add-4d66-8218-3d9d3d5dcfd0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1688 microversion: 2.1 time: 0.230195 Aug 30 18:41:03.833288 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3459/7179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:03 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1688 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:04.421513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134165fc-11e2-4ece-955b-84fbde66652c", "name": "network-vif-deleted", "tag": "f2863144-5409-4bba-9ff6-6c8ac3d33ae6"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:04.435311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.435992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.436425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:04.456227 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] Creating event network-vif-deleted:f2863144-5409-4bba-9ff6-6c8ac3d33ae6 for instance 134165fc-11e2-4ece-955b-84fbde66652c on n-h2-852771-11 Aug 30 18:41:04.461612 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0d49b92a-af8f-45b8-b8c4-abca1ccc0cab req-ead90b0f-acef-4f35-836b-c791a6137bc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044638 Aug 30 18:41:04.462596 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3721/7180] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:04.854413 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:04.855036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:04.862145 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.862637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.863081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:04.864061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.864524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.864955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:04.898403 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.898901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.899355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:04.899842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lazy-loading 'fault' on Instance uuid 134165fc-11e2-4ece-955b-84fbde66652c {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:41:04.943075 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:04.950300 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-69e121a4-f1f1-4a2b-a889-b5c4f7a758b8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 200 len: 1357 microversion: 2.1 time: 0.099658 Aug 30 18:41:04.951297 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3460/7181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:04 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:05.974149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:05.974774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 134165fc-11e2-4ece-955b-84fbde66652c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:05.981836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:05.982328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:05.982767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:05.983463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:05.983943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:05.984379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:05.998656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] HTTP exception thrown: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Request method failure captured: Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c HTTP/1.1 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlmHAwgVDPR1stzAmBOPAttO9fdctZPpT2Urvfniv4saEFiKOmCYp9ptqnDj6rZ-n0LiLC1oedqMTFT2fzDWljU2QypX8ahUpmD9tSQ9_tYU5i7bA-XbMYU0VdRQitZGfROjQvl_g_QARZEtMS6eFdfIl1Zl5z1xv0XD9vVL6qIJXZU Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2515b3487624a2d9419bb97c9d5acca"}]}] Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2a9e5e851c94583b9240a29390f476f Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '134165fc-11e2-4ece-955b-84fbde66652c'} Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:41:06.000241 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Returning 404 to user: Instance 134165fc-11e2-4ece-955b-84fbde66652c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1eff0503-2fd6-4656-8458-ff07e4e02039 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 30 18:41:06.005137 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3722/7182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:05 2022] GET /compute/v2.1/servers/134165fc-11e2-4ece-955b-84fbde66652c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:41:08.981449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-40ad632c-e676-4d61-84be-61753e4a02fd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '.version_select at 0x7f2d98db48b0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:09.004203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-40ad632c-e676-4d61-84be-61753e4a02fd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1823488292" status: 202 len: 0 microversion: 2.1 time: 0.026596 Aug 30 18:41:09.004801 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3461/7183] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1823488292 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:41:09.028357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7c020ede-516e-4d5b-8777-adaba9d6796b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: .version_select at 0x7f2d93895820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1618269978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr0uhajh5CnqYLMvK49Xw5c0pDDSiLAr59eglLjQkSkxBaFbOpXZcX91e9Ww/tRT92hSf2p4ONnQF7Tyh0gbQ81xE0S+IXFNIlI4olREV2hYBdp0MUAf2YpkaLI2ZyzKw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:09.045148 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7c020ede-516e-4d5b-8777-adaba9d6796b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:41:09.052226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-7c020ede-516e-4d5b-8777-adaba9d6796b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:41:09.077019 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7c020ede-516e-4d5b-8777-adaba9d6796b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052428 Aug 30 18:41:09.077579 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3723/7184] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:41:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:14.855312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1145972600", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "9be596e0-efa4-4ec6-96be-7704fe3051cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1618269978", "security_groups": [{"name": "tempest-secgroup-smoke-2091845903"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:14.953936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:14.980588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] validate_networks() for [('9be596e0-efa4-4ec6-96be-7704fe3051cf', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:41:15.439367 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:41:15.439830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:41:15.440329 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:41:15.440750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:41:15.441192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:41:15.451246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.452731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.453479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:15.454278 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.454754 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.455203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:15.478667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:41:15.485608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:41:15.500348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:41:15.502723 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:41:15.559604 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4a237dbc-29cd-43de-81a9-eff445a60924 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709370 Aug 30 18:41:15.560670 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3462/7185] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:41:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:41:15.571846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-00b039ad-cd00-4fe7-a1b5-93cbe565e4b3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:15.573571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-00b039ad-cd00-4fe7-a1b5-93cbe565e4b3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:15.637468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-00b039ad-cd00-4fe7-a1b5-93cbe565e4b3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:15.645305 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-00b039ad-cd00-4fe7-a1b5-93cbe565e4b3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1267 microversion: 2.1 time: 0.077725 Aug 30 18:41:15.659670 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3724/7186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:15 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:16.668520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:16.669179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:16.683634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:16.684234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:16.684770 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:16.685563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:16.686149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:16.686588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:16.779833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:16.789902 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5707d3ca-9786-4a5c-b481-fd0a4192d6cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1327 microversion: 2.1 time: 0.127457 Aug 30 18:41:16.790975 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3463/7187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:16 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:17.810335 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:17.810962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:17.813929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=36 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:17.820951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:17.821819 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:17.822435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:17.823338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:17.823987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:17.824589 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:17.976070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:17.985111 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a10c856-ec14-4ba5-9327-9776d58d0e83 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.178629 Aug 30 18:41:17.987269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3725/7188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:17 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:18.231124 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deaa9eb-5161-403d-8253-eb4bd09b795c", "tag": "53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:18.244174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.244670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.245298 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.257606 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] Creating event network-changed:53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30 for instance 2deaa9eb-5161-403d-8253-eb4bd09b795c on n-h1-852771-11 Aug 30 18:41:18.265846 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-e73dcd63-a471-4366-85c7-4729c0ac847c req-c8111635-3687-4f1b-87fc-4dcae5b0ae2f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043630 Aug 30 18:41:18.267024 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3464/7189] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:19.010416 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:19.011050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:19.017914 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:19.018678 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:19.019115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:19.019831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:19.020290 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:19.020716 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:19.158851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:19.166992 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f91b6609-92d7-4d06-a103-646ebf202364 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.160410 Aug 30 18:41:19.167598 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3726/7190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:19 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:20.190485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:20.191207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:20.197448 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.197946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.198395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.199126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.199636 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.200078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.335301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:20.343072 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-46830f73-1883-4ff6-b0e2-7027882a7457 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.158461 Aug 30 18:41:20.343730 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3465/7191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:20 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:21.364755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:21.365378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:21.368220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:21.374122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.374610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.375718 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:21.376423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.376885 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.377316 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:21.509431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:21.517307 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-93b44774-e0e8-4d10-984e-b291c3827efc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.156662 Aug 30 18:41:21.517822 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3727/7192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:21 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:22.538365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:22.538909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:22.545951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:22.546446 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:22.547629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:22.548456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:22.548921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:22.549361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:22.683036 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:22.690743 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b3f3fe09-4198-40ef-89af-416be72a15fc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.156391 Aug 30 18:41:22.691315 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3466/7193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:22 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:23.682530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deaa9eb-5161-403d-8253-eb4bd09b795c", "name": "network-vif-plugged", "status": "completed", "tag": "53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:23.693910 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.694400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.694838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.706650 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] Creating event network-vif-plugged:53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30 for instance 2deaa9eb-5161-403d-8253-eb4bd09b795c on n-h1-852771-11 Aug 30 18:41:23.711993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-4b717b59-126a-4ce3-b60e-8672da253a69 req-6486b545-dad1-44a8-9bfb-91e1a02922db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Aug 30 18:41:23.712136 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:23.712833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:23.712970 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3728/7194] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:23.720765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.721334 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.722013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.722944 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.723507 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.724173 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.931351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:23.939151 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7fe5eda4-5506-4c61-bfa2-ec827ed532c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1393 microversion: 2.1 time: 0.231121 Aug 30 18:41:23.939746 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3467/7195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:23 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1393 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:24.960928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:24.963469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:24.968369 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:24.968876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:24.969299 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:24.970125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:24.970728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:24.971604 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:25.115633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.123453 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-97428f32-0a75-4a9b-9f0d-a47bc677882a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1565 microversion: 2.1 time: 0.167803 Aug 30 18:41:25.124055 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3729/7196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:24 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:25.144279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:25.144906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:25.151699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:25.152194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:25.152642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:25.153344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:25.153808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:25.154246 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:25.290621 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.299146 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-58f4276f-b393-485d-a131-51a1f344379c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1565 microversion: 2.1 time: 0.158712 Aug 30 18:41:25.299770 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3468/7197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:25 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:27.206691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:27.207229 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:27.209338 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:27.210386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deaa9eb-5161-403d-8253-eb4bd09b795c", "tag": "53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:27.216366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:27.217037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:27.217558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:27.217688 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:27.218268 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:27.219873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:27.220038 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:27.220601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:27.221602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:27.228055 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:27.229005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:27.229438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:27.244389 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] Creating event network-changed:53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30 for instance 2deaa9eb-5161-403d-8253-eb4bd09b795c on n-h1-852771-11 Aug 30 18:41:27.250292 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-415eca84-7363-4595-b6fe-16025e5ea106 req-56cb82ed-9a8c-4048-a487-e7e6df7f9097 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043490 Aug 30 18:41:27.251280 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3469/7198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:27.383635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.391832 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03532fa8-47cb-4c42-87a6-0f86b36fd782 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1565 microversion: 2.1 time: 0.191195 Aug 30 18:41:27.392656 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3730/7199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:27 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:50.644949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:50.649266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:50.651590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:50.659517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.660011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.660459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.661164 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.661628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.662064 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.719651 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c0e109e-4f74-44b0-ac81-2f68db52e65d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action" status: 200 len: 24577 microversion: 2.1 time: 0.077526 Aug 30 18:41:50.720287 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3470/7200] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:50 2022] POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action => generated 24577 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:41:57.165621 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:57.167894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:57.170063 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:41:57.170211 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action (ip 10.222.0.50) !!! Aug 30 18:41:57.172851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:57.173552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:57.183430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.183947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.184384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.185080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.185586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.186049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.266376 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c7888de0-492e-4dec-b34c-4a78ecb7401b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action" status: 202 len: 0 microversion: 2.1 time: 0.104596 Aug 30 18:41:57.270228 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3731/7201] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:57 2022] POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:41:57.279940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:57.293000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:57.304161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.304917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.305616 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.306716 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.307452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.308125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.535572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:57.543505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1ef1423a-6fac-421f-af52-a086dd22330d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1676 microversion: 2.1 time: 0.270492 Aug 30 18:41:57.544309 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3471/7202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:57 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1676 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:58.566665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:58.567289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:58.573511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:58.573995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:58.574438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:58.575131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:58.575623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:58.576055 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:58.709557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:58.718499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4a63c52c-66c0-4ae2-aeea-3c20e98e54e5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.156255 Aug 30 18:41:58.719091 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3732/7203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:58 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:59.740827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:59.741486 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:59.749186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:59.749943 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:59.751005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:59.751721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:59.752181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:59.752612 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:59.883066 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:59.891818 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e7996121-e5ac-415c-8235-e9129acc4cb6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.155274 Aug 30 18:41:59.892465 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3472/7204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:59 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:00.913923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:00.914517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:00.922371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:00.922872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:00.923304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:00.924021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:00.924530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:00.924956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:01.054005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:01.061882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-72ba7f3f-95a6-4946-8413-c6337207f369 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.151904 Aug 30 18:42:01.062620 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3733/7205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:00 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:02.082592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:02.083241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:02.090520 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:02.091111 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:02.091763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:02.092478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:02.092950 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:02.093986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:02.247919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:02.256069 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-36ac54c7-9d78-49ea-97c1-690b9b194809 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.177565 Aug 30 18:42:02.256656 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3473/7206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:02 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:03.278031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:03.278646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:03.285818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:03.286301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:03.286737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:03.287429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:03.287906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:03.288329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:03.425125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:03.433134 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9bfe5156-ba79-490d-9842-f9106ac55c34 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.159025 Aug 30 18:42:03.433706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3734/7207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:03 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:04.455796 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:04.456601 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:04.463373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:04.463895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:04.464340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:04.465040 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:04.465498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:04.465931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:04.600129 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:04.608013 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a10c766-3dec-4bff-bea1-5d7a3040b9ca tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.157150 Aug 30 18:42:04.608654 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3474/7208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:04 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:05.630276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:05.630815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:05.637440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:05.637927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:05.638375 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:05.639070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:05.639552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:05.640014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:05.778470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:05.786582 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-206e1266-4cd4-45a0-bb05-3b93662bf7d9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.160384 Aug 30 18:42:05.787168 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3735/7209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:05 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:06.807582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:06.808201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:06.816032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:06.816521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:06.816967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:06.817664 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:06.818122 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:06.818553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:06.953152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:06.961073 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8f756179-ca7a-4d83-9ed4-ff736cf1b305 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.157373 Aug 30 18:42:06.961650 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3475/7210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:06 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:07.982234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:07.982795 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:07.990398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:07.990882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:07.991322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:07.992043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:07.992503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:07.992931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:08.127998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:08.135880 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a082afc-8b5e-49d9-a20e-a4f4a8a2c4f1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1681 microversion: 2.1 time: 0.157550 Aug 30 18:42:08.136460 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3736/7211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:07 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:09.158460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:09.159084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:09.165996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:09.166493 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:09.166945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:09.167677 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:09.168146 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:09.168610 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:09.306545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:09.314586 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8117901f-e46f-4ec6-8468-f7c39d064505 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1684 microversion: 2.1 time: 0.160698 Aug 30 18:42:09.315153 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3476/7212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:09 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:33.497178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:33.499398 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.502969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=12 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:33.503664 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:33.509615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.510102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.510541 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.511234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.511719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.512149 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.572653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9572928b-7130-48ed-bce3-7494687f2b64 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action" status: 200 len: 68887 microversion: 2.1 time: 0.079342 Aug 30 18:42:33.573229 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3737/7213] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:42:33 2022] POST /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c/action => generated 68887 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:42:40.623304 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:40.624214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:40.624864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deaa9eb-5161-403d-8253-eb4bd09b795c", "tag": "53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:40.627301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=15 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:40.628531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=40 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:40.634622 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.635449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.635818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.636255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.636689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.637263 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.637543 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.638625 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.639662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.653461 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] Creating event network-changed:53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30 for instance 2deaa9eb-5161-403d-8253-eb4bd09b795c on n-h1-852771-11 Aug 30 18:42:40.662119 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a0323e9f-659b-49c6-88fe-abb690ea761a req-7129f1eb-58f9-4fba-9b4a-879a9a4a1027 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041025 Aug 30 18:42:40.663066 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3738/7214] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:42:40.681545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:40.787694 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e829e806-e264-4a7d-9308-f941a10d603c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 204 len: 0 microversion: 2.1 time: 0.168567 Aug 30 18:42:40.788440 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3477/7215] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:40 2022] DELETE /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:40.800069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:40.800834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:40.808458 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.808991 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.809489 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.810196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.810647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.811070 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.963043 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:40.972106 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7aedfe60-d0b6-4be1-a0b6-58915f213818 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1690 microversion: 2.1 time: 0.179188 Aug 30 18:42:40.972892 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3739/7216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:40 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:41.994769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:41.995630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:42.003199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.003730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.004198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.004879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.005364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.005801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.165018 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.173719 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-64f0182d-8a9d-47db-a9f0-5c2306a88dfe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1690 microversion: 2.1 time: 0.183162 Aug 30 18:42:42.174344 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3478/7217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:41 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:42.789522 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deaa9eb-5161-403d-8253-eb4bd09b795c", "name": "network-vif-deleted", "tag": "53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:42.804097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.804501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.804942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.818615 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] Creating event network-vif-deleted:53fe5ab3-ef17-4f5d-880a-d3a2da8a5e30 for instance 2deaa9eb-5161-403d-8253-eb4bd09b795c on n-h1-852771-11 Aug 30 18:42:42.824627 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-05fe1afa-d4e6-4565-93a2-79ade069dbad req-486c773f-6028-47cf-8e4d-8338ee3013b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039460 Aug 30 18:42:42.825269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3740/7218] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:43.194516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:43.195234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:43.202189 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:43.202801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:43.203647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:43.204577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:43.205153 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:43.205515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:43.241149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:43.241646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:43.242097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:43.242560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lazy-loading 'fault' on Instance uuid 2deaa9eb-5161-403d-8253-eb4bd09b795c {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:42:43.286791 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:43.296424 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6b43584-1cf4-40a6-a767-c672fbe2b2e7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 200 len: 1357 microversion: 2.1 time: 0.105899 Aug 30 18:42:43.299741 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3479/7219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:43 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:44.319172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:44.319908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 2deaa9eb-5161-403d-8253-eb4bd09b795c] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:44.327045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:44.327567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:44.328015 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:44.328719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:44.329176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:44.329610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:44.343005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] HTTP exception thrown: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Request method failure captured: Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c HTTP/1.1 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlmHAwgVDPR1stzAmBOPAttO9fdctZPpT2Urvfniv4saEFiKOmCYp9ptqnDj6rZ-n0LiLC1oedqMTFT2fzDWljU2QypX8ahUpmD9tSQ9_tYU5i7bA-XbMYU0VdRQitZGfROjQvl_g_QARZEtMS6eFdfIl1Zl5z1xv0XD9vVL6qIJXZU Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2515b3487624a2d9419bb97c9d5acca"}]}] Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2a9e5e851c94583b9240a29390f476f Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '2deaa9eb-5161-403d-8253-eb4bd09b795c'} Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:42:44.345291 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Returning 404 to user: Instance 2deaa9eb-5161-403d-8253-eb4bd09b795c could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-584ce464-1c57-4af3-9117-cf5c3c20c4d6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c" status: 404 len: 111 microversion: 2.1 time: 0.031790 Aug 30 18:42:44.349883 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3741/7220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:44 2022] GET /compute/v2.1/servers/2deaa9eb-5161-403d-8253-eb4bd09b795c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:42:47.645023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dbd589f2-28a3-4543-88cc-3e305292bd72 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '.version_select at 0x7f2d93995820>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:47.670585 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dbd589f2-28a3-4543-88cc-3e305292bd72 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618269978" status: 202 len: 0 microversion: 2.1 time: 0.030881 Aug 30 18:42:47.671370 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3480/7221] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618269978 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:42:47.701469 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8f57babc-51ad-4777-9eec-7e7af7be4268 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: .version_select at 0x7f2d937a0790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1436686383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP34DKHYTNi2FWCdhqHBE9NEvPR1TaNVE0TYmEQO38ley8+Cy9EEk6OUaxrYmp6DkUFME/Z2h0mRZgG51iqbQ8Xe+HWbFjVJgbn9sY6tz/dKU5JW4tg3uc+qKhJGVWdvEg=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:47.721558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8f57babc-51ad-4777-9eec-7e7af7be4268 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:42:47.727849 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-8f57babc-51ad-4777-9eec-7e7af7be4268 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:42:47.752732 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8f57babc-51ad-4777-9eec-7e7af7be4268 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057428 Aug 30 18:42:47.753361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3742/7222] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:42:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:53.331049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:53.336126 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-473537592", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "f9f7219a-2636-4ec5-9da7-a99073fcf113"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1436686383", "security_groups": [{"name": "tempest-secgroup-smoke-1048243141"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:53.464888 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] validate_networks() for [('f9f7219a-2636-4ec5-9da7-a99073fcf113', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:42:53.884095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:42:53.884567 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:42:53.885061 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:42:53.885541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:42:53.886141 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:42:53.895898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:53.896456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:53.897101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:53.898030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:53.898506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:53.898971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:53.916162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:42:53.921544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:42:53.934571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:42:53.936958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:42:53.984036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-354b4281-adfe-493f-9217-11248b607779 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655766 Aug 30 18:42:53.985307 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3481/7223] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:42:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:42:53.997499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fb2b89c2-859f-4952-b00e-3b098102a5f3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:53.998285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fb2b89c2-859f-4952-b00e-3b098102a5f3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:54.054139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fb2b89c2-859f-4952-b00e-3b098102a5f3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:54.061340 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fb2b89c2-859f-4952-b00e-3b098102a5f3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1266 microversion: 2.1 time: 0.068963 Aug 30 18:42:54.062033 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3743/7224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:53 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:55.083560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f8fa6995-e5db-477b-bc27-c597d8b99c2f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:55.084433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f8fa6995-e5db-477b-bc27-c597d8b99c2f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:55.149790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f8fa6995-e5db-477b-bc27-c597d8b99c2f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:55.157829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f8fa6995-e5db-477b-bc27-c597d8b99c2f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1266 microversion: 2.1 time: 0.078593 Aug 30 18:42:55.158425 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3482/7225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:55 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:56.179379 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ee82adff-e24b-4135-8f73-b234d9636aa7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:56.180042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ee82adff-e24b-4135-8f73-b234d9636aa7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:56.182057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=16 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:56.238904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ee82adff-e24b-4135-8f73-b234d9636aa7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:56.246052 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ee82adff-e24b-4135-8f73-b234d9636aa7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1266 microversion: 2.1 time: 0.070612 Aug 30 18:42:56.248468 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3744/7226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:56 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:57.280243 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2aaa521f-fea4-42e2-83de-feaefc74b273 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:57.280952 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2aaa521f-fea4-42e2-83de-feaefc74b273 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:57.341117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2aaa521f-fea4-42e2-83de-feaefc74b273 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:57.350805 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2aaa521f-fea4-42e2-83de-feaefc74b273 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1266 microversion: 2.1 time: 0.085711 Aug 30 18:42:57.351718 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3483/7227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:57 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:58.375714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:58.376328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:58.383234 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.383748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.384194 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.384881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.385337 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.385764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.452514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:58.462393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46f7c343-569a-4c89-98a4-9183c1f6ec8d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1270 microversion: 2.1 time: 0.091024 Aug 30 18:42:58.463009 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3745/7228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:58 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:59.483378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:59.484579 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:59.492563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:59.493058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:59.493503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:59.494208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:59.494667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:59.495109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:59.557322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:59.565805 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e57ed6d4-306b-4606-8cfd-3a157178a7fa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1324 microversion: 2.1 time: 0.086327 Aug 30 18:42:59.566398 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3484/7229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:59 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1324 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:00.350540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:00.367220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:00.367869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:00.368437 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:00.384460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] Creating event network-changed:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h2-852771-11 Aug 30 18:43:00.391882 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-0e287011-b812-46a2-bf42-21b98f0049ca req-93438d55-b02a-45b2-bd5c-f5e0ef19a39b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048488 Aug 30 18:43:00.392770 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3746/7230] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:00.587024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:00.588322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:00.595524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:00.596047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:00.596494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:00.597201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:00.597662 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:00.598098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:00.730956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:00.739967 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2ea77746-72a6-4d0d-b01b-4a078b61897b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.156966 Aug 30 18:43:00.740554 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3485/7231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:00 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:01.763278 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:01.764083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:01.771355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:01.771888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:01.772334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:01.773053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:01.773513 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:01.773947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:02.236016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:02.244159 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d3257091-9559-43a4-b713-84207fca6722 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.486113 Aug 30 18:43:02.244771 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3747/7232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:01 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:03.264896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:03.265751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:03.273668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.274166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.274614 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:03.275324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.275811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.276248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:03.416347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:03.425326 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1df4447-0b11-4286-8f61-3ab9bfc45b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.164434 Aug 30 18:43:03.426069 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3486/7233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:03 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:04.446253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:04.446848 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:04.449764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:04.455924 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:04.456233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:04.456661 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.457502 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:04.458006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:04.458420 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.601608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.609899 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-03feb6d2-ddcf-468c-a85e-14dcaf0218da tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.167011 Aug 30 18:43:04.610592 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3748/7234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:04 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:05.631506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:05.632050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:05.633934 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:05.640268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.640759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.641214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:05.641910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.642374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.642818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:05.773975 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:05.782507 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-20b4d126-cab5-41f6-9fa5-f3d119ed8b42 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.155049 Aug 30 18:43:05.783086 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3487/7235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:05 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:06.163033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "name": "network-vif-plugged", "status": "completed", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:06.173511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:06.173994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:06.174426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:06.185825 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] Creating event network-vif-plugged:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h2-852771-11 Aug 30 18:43:06.191071 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9815cf03-4806-4efd-8b9f-ac1293798953 req-9d0663b7-0af4-450b-823c-36fc511fc856 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031830 Aug 30 18:43:06.191695 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3749/7236] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:06.802390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:06.803022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:06.810034 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:06.810533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:06.810996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:06.811741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:06.812863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:06.813400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:06.949575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:06.957400 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-44c2525e-d4f2-4271-ac9e-7a26a261c242 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1392 microversion: 2.1 time: 0.158910 Aug 30 18:43:06.957987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3488/7237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:06 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:07.975371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:07.980342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:07.981037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:07.987444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:07.987993 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:07.988687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:07.989373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:07.989820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:07.990242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.126142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:08.133858 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-31bfd2ec-51b7-4bed-82c8-b2f322b497ea tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1564 microversion: 2.1 time: 0.159512 Aug 30 18:43:08.134443 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3750/7238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:07 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:08.154106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:08.154740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:08.157457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:08.163831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.164333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.164789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.165496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.165966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.166409 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.300342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:08.308212 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a1efc11c-408b-4a37-b9cb-4995d3dcdf6f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1564 microversion: 2.1 time: 0.157950 Aug 30 18:43:08.308803 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3489/7239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:08 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:09.891549 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:09.892775 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:09.900373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:09.900851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:09.901297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:09.902007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:09.902470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:09.902902 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:09.965008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:09.974748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:09.975235 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:09.975773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:09.990026 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] Creating event network-changed:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h2-852771-11 Aug 30 18:43:09.995289 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-a93e7fae-5ffd-4f6c-a713-976ae0c1fbbd req-c397b2d0-aae2-4e7a-9f87-f11386a66f6e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102669 Aug 30 18:43:09.996276 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3490/7240] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:10.072809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:10.080886 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-841e012c-7b06-43f4-91e1-e2173ae949a8 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1564 microversion: 2.1 time: 0.193972 Aug 30 18:43:10.081500 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3751/7241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:09 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:31.334087 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:31.335785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=40 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:31.340699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:31.343532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:31.350789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:31.351279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:31.351757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:31.352458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:31.352920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:31.353354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:31.410041 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7c74baa7-33eb-45dc-9e8a-8f064337416e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action" status: 200 len: 24571 microversion: 2.1 time: 0.077813 Aug 30 18:43:31.410697 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3491/7242] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:43:31 2022] POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:43:42.456090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:42.458343 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:42.460759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=7 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:42.461421 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=34 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:42.466997 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.467501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.467943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:42.468639 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.469095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.469524 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:42.570805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:42.577280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Old instance type m1.heat2, new instance type m1.heat {{(pid=122124) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:43:42.584570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:43:42.584995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:43:42.585470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:43:42.585881 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:43:42.586292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:43:42.650704 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3a3f38b3-94d1-4f3e-bd52-be143015edda tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action" status: 202 len: 0 microversion: 2.1 time: 0.198776 Aug 30 18:43:42.651326 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3752/7243] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:43:42 2022] POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:43:42.660852 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:42.661575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:42.664572 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:42.665342 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:42.671926 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.672481 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.672992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:42.673780 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.675031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.675501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:42.855872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:42.864438 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-092e4535-6eff-433c-8587-b27a291ebb92 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1692 microversion: 2.1 time: 0.208345 Aug 30 18:43:42.865021 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3492/7244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:42 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:43.886652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:43.887259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:43.894464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:43.894942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:43.895372 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:43.896091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:43.896540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:43.896961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.029942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:44.038783 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f5914069-5471-41b3-991e-ee3f86ab37dc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1692 microversion: 2.1 time: 0.156048 Aug 30 18:43:44.039399 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3753/7245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:43 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:45.060357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:45.061032 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:45.068183 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:45.068680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:45.069130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:45.069832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:45.070296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:45.070735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:45.203745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:45.212564 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4145d2a8-b702-4188-a6af-8c890934055b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.156168 Aug 30 18:43:45.213146 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3493/7246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:45 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:46.234244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:46.234858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:46.243167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:46.243685 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:46.244125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:46.244817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:46.245270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:46.245700 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:46.445904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:46.453686 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4f927bf4-6fdc-4796-b7d2-6d451ce69423 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.223392 Aug 30 18:43:46.454266 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3754/7247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:46 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:47.476380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:47.477005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:47.483381 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.483898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.484347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.485049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.485512 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.485947 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.620045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:47.628139 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-066500b7-105d-4dfe-9f86-1b5e01216bcf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.156349 Aug 30 18:43:47.628712 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3494/7248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:47 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:48.648555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:48.649115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:48.655949 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:48.656430 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:48.656864 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:48.657547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:48.657998 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:48.658422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:48.797691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:48.805565 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-16d1dd7e-6129-444d-aaff-9af4603317ff tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.161095 Aug 30 18:43:48.806145 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3755/7249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:48 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:49.827096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:49.827757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:49.834755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.835256 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.835745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.836453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.836924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.837368 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.966181 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:49.974516 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-aeb15324-8bc2-419e-886d-507abe0d0b5e tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.151345 Aug 30 18:43:49.975101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3495/7250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:49 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:50.996397 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:50.997044 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:51.004080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.004570 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.005754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.006536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.007000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.007434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.137113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:51.145137 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dfe4b421-39e5-440b-b2cf-bed03ab7f8b1 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.152665 Aug 30 18:43:51.145780 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3756/7251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:50 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:52.166737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:52.167345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:52.174225 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.174712 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.175157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.175878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.176338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.176771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.312042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:52.321008 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-99f8b699-8de5-4f57-bd10-072aab31e354 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.158176 Aug 30 18:43:52.321721 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3496/7252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:52 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:53.346300 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:53.346892 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:53.355017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.355526 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.355964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.356665 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.357115 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.357536 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.494474 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:53.502428 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53efc2d2-0034-4741-a18b-c601640d864c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.160101 Aug 30 18:43:53.503070 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3757/7253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:53 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:54.524613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.525195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:54.532104 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.532595 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.533042 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.533735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.534194 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.534661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.669533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:54.677981 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eb7eb12b-8ae3-4d78-ae69-683e99416b71 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.157471 Aug 30 18:43:54.678570 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3497/7254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:55.699425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:55.700077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:55.707052 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:55.707573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:55.708804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:55.709516 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:55.709977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:55.710410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:55.844809 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:55.853919 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-180b2900-ace5-4603-ad93-cb7bc84f1475 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.158391 Aug 30 18:43:55.854497 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3758/7255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:55 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:56.875261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:56.875907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:56.882762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:56.883247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:56.883721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:56.884416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:56.884872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:56.885306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.017676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:57.026266 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2c4fd23-f8c7-4a9a-9edc-ea6aac9d5028 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.154846 Aug 30 18:43:57.026841 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3498/7256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:56 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:58.048020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:58.048747 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:58.056029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.056509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.056943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.057632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.058082 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.058533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.190214 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:58.198546 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9990a50b-95ac-42bb-ac67-b82989345630 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.154484 Aug 30 18:43:58.199121 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3759/7257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:58 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:59.220442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:59.221113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:59.228089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.228580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.229025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.229719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.230177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.230609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.368475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:59.376328 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c07f50a4-bcf4-4c2a-88dc-6859967ea5a7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.159803 Aug 30 18:43:59.376905 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3499/7258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:59 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:00.398880 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:00.399419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:00.406315 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.406802 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.407244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:00.407982 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.408425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.408853 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:00.540703 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:00.548773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a48ff891-c7fb-4c86-b69f-8146f10b30d5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1697 microversion: 2.1 time: 0.154531 Aug 30 18:44:00.549361 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3760/7259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:00 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:01.571210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:01.572505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:01.579875 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.580379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.580835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.581794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.582268 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.582711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.844167 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:01.852892 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2019cb97-b666-4bf2-85dd-982e018be6b5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1696 microversion: 2.1 time: 0.286036 Aug 30 18:44:01.853489 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3500/7260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:01 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1696 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:02.121436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "name": "network-vif-unplugged", "status": "completed", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:02.132722 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.133212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.133704 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:02.146005 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Creating event network-vif-unplugged:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h1-852771-11 Aug 30 18:44:02.151503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:44:02.163045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-6781dd25-2778-4475-89f8-0d80e8156ee3 req-f3eb45f3-1087-48ab-8f8d-05f086c542a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045373 Aug 30 18:44:02.163702 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3761/7261] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:44:02.875300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:02.876227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:02.883678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.884184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.884655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:02.885377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.885851 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.886333 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.123382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:03.132247 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5708228e-bd44-40f9-b0f0-9921ea0f53a5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1696 microversion: 2.1 time: 0.260849 Aug 30 18:44:03.133047 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3501/7262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:02 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1696 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:04.154196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:04.154931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:04.161124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:04.161640 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:04.162135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:04.162818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:04.163270 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:04.163719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:04.180428 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:04.190650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:04.191140 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:04.191619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:04.207489 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Creating event network-changed:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h1-852771-11 Aug 30 18:44:04.214106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-11', 'n-h1-852771-11'} {{(pid=122123) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:44:04.226568 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-24a3d2b5-8caf-48d0-9653-f695d921be00 req-43f7479f-6ce0-45e2-9c37-1346e5d049c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049954 Aug 30 18:44:04.227235 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3502/7263] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:44:04.350480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:04.359945 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bbf520ec-3045-4ee6-a2cf-b4fe06dc8197 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1694 microversion: 2.1 time: 0.210908 Aug 30 18:44:04.360544 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3762/7264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:04 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:05.383922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:05.384645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.391916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.392412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.392905 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.393619 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.394094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.394537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.534536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:05.543796 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a5805980-6e69-4895-b5cf-18b0e2031da0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1691 microversion: 2.1 time: 0.164373 Aug 30 18:44:05.544422 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3503/7265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:05 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:05.565199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:05.565969 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.573483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.573964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.574399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.575090 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.575569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.576019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.634424 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-907991e2-91b1-4a5f-92d2-5b7c0151dedf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action" status: 204 len: 0 microversion: 2.1 time: 0.073149 Aug 30 18:44:05.635191 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3763/7266] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:05 2022] POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:44:05.643551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:05.644184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.650946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.651515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.652083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.652826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.653328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.654406 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.789113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:05.797299 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-afdb1e4e-4769-42f1-87fd-e59593e3ba80 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1691 microversion: 2.1 time: 0.157715 Aug 30 18:44:05.797886 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3504/7267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:05 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:05.817936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:05.819286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.825425 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.825907 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.826557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.827254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.827734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.828157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.051555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:06.060805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-fffe2e93-4170-4619-9b92-939896fb24d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1691 microversion: 2.1 time: 0.246982 Aug 30 18:44:06.061387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3764/7268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:05 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:07.082279 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:07.082820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:07.089819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.090317 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.090765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.091464 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.091946 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.092382 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.225693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:07.233664 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-eceec483-c2b5-4c94-a1c5-818773299c1c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1683 microversion: 2.1 time: 0.155374 Aug 30 18:44:07.234262 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3505/7269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:07 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:08.462736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "name": "network-vif-plugged", "status": "completed", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:08.474139 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:08.474624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:08.475738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:08.487061 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] Creating event network-vif-plugged:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h1-852771-11 Aug 30 18:44:08.492519 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f1578c1a-10ea-4500-8428-986fe9e70281 req-8bb051af-3b5b-4d3b-bb3b-5bb8617c0a4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095102 Aug 30 18:44:08.493037 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3765/7270] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:29.448015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:29.450248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:29.453025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=28 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:29.453698 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=82 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:29.460450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:29.460949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:29.461402 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.462110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:29.462577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:29.463016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.517986 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-65ad98b8-d200-4225-9d92-a23ce5ebdf35 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action" status: 200 len: 24574 microversion: 2.1 time: 0.073688 Aug 30 18:44:29.518591 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3506/7271] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:29 2022] POST /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:37.004408 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:37.005196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:37.011202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:37.017185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:37.017785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:37.022846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.023344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.023834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.025614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.026168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.026601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.027514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.027776 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.028205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.038102 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] Creating event network-changed:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h1-852771-11 Aug 30 18:44:37.043815 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-33195706-45cf-4744-b317-51ac66f0d0a8 req-770424cc-589a-4dd4-a9e5-744fe9f746b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036653 Aug 30 18:44:37.044908 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3507/7272] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:37.058829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:44:37.145337 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b160efe1-e34a-4954-a2d8-7b49c1d6ba19 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 204 len: 0 microversion: 2.1 time: 0.142843 Aug 30 18:44:37.146678 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3766/7273] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:44:37 2022] DELETE /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:44:37.158371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:37.159834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:37.167180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.167736 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.168430 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.169156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.169628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.170132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.322434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:37.331184 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfe455c7-061a-4309-abbd-801e4d9cc5ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1689 microversion: 2.1 time: 0.179855 Aug 30 18:44:37.332204 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3508/7274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:37 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:38.353153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:38.353962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:38.361520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.362001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.362435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.363153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.363638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.364064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.504736 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:38.512659 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a02a3878-5f61-48a7-a078-81ddcecb3caa tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 200 len: 1689 microversion: 2.1 time: 0.163687 Aug 30 18:44:38.513249 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3767/7275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:38 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:39.031827 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e008ec-03cc-4f75-b964-fc9863c61f67", "name": "network-vif-deleted", "tag": "4f569fdf-d852-497e-8731-1133554999b3"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:39.044529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.045556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.046002 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.057928 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] Creating event network-vif-deleted:4f569fdf-d852-497e-8731-1133554999b3 for instance 61e008ec-03cc-4f75-b964-fc9863c61f67 on n-h1-852771-11 Aug 30 18:44:39.062874 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-f43132e5-a8bd-4f7b-8b41-bd71d0f82bd9 req-bb9c468f-3149-4ba4-be28-82b8f3e1d74d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Aug 30 18:44:39.063491 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3509/7276] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:39.534429 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:39.535046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 61e008ec-03cc-4f75-b964-fc9863c61f67] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:39.542263 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.542692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.543124 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.543845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.544292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.544715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.558656 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] HTTP exception thrown: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Request method failure captured: Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 HTTP/1.1 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlmHAwgVDPR1stzAmBOPAttO9fdctZPpT2Urvfniv4saEFiKOmCYp9ptqnDj6rZ-n0LiLC1oedqMTFT2fzDWljU2QypX8ahUpmD9tSQ9_tYU5i7bA-XbMYU0VdRQitZGfROjQvl_g_QARZEtMS6eFdfIl1Zl5z1xv0XD9vVL6qIJXZU Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2515b3487624a2d9419bb97c9d5acca"}]}] Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2a9e5e851c94583b9240a29390f476f Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '61e008ec-03cc-4f75-b964-fc9863c61f67'} Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:44:39.560250 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Returning 404 to user: Instance 61e008ec-03cc-4f75-b964-fc9863c61f67 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e37d4ae3-1554-453c-987e-563536702c2b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67" status: 404 len: 111 microversion: 2.1 time: 0.031899 Aug 30 18:44:39.565754 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3768/7277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:39 2022] GET /compute/v2.1/servers/61e008ec-03cc-4f75-b964-fc9863c61f67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:42.914706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-21d8cb5a-f8d8-4c5b-9933-bfd692c14e37 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '.version_select at 0x7f2d98f120d0>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:42.938394 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-21d8cb5a-f8d8-4c5b-9933-bfd692c14e37 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1436686383" status: 202 len: 0 microversion: 2.1 time: 0.027823 Aug 30 18:44:42.939038 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3510/7278] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1436686383 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:44:42.967687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-abbc1f6d-458d-4555-94a2-7ed07a99e613 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: .version_select at 0x7f2d93895820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1966214118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8p3tlsKCcV2W76JbuyUpCQ8YpFbZ24usfXmwDVTLB3bsu75nBL3TQHOw4gESwvBuaZIYKHduSLuUKBW1GXWaCVY0MiOFxsiLYNaA0qXn9KXpk4rSRkl2+kOvzHuLL4Sw=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:42.985254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-abbc1f6d-458d-4555-94a2-7ed07a99e613 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:42.990687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-abbc1f6d-458d-4555-94a2-7ed07a99e613 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:43.014562 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-abbc1f6d-458d-4555-94a2-7ed07a99e613 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052302 Aug 30 18:44:43.015167 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3769/7279] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:44:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:48.783993 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1572421711", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "6ffb2247-c32d-4db8-a441-2744631a372e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1966214118", "security_groups": [{"name": "tempest-secgroup-smoke-238855853"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:48.944591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] validate_networks() for [('6ffb2247-c32d-4db8-a441-2744631a372e', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:44:49.052341 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=14 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:49.407280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:44:49.407751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:44:49.408275 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:44:49.409585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:44:49.410020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:44:49.419100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:49.420134 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:49.420611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:49.421458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:49.421929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:49.422375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:49.443532 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:49.448984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:49.462170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:44:49.464676 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:44:49.515035 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-11d87c2a-7c0f-45d0-b8dc-77dec3fc5ff2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737560 Aug 30 18:44:49.516073 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3511/7280] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:44:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:44:49.535905 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-75c0c81c-111a-4b10-816a-1b3801df72bc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:49.537111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-75c0c81c-111a-4b10-816a-1b3801df72bc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:49.555563 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:49.633265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-75c0c81c-111a-4b10-816a-1b3801df72bc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:49.641830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-75c0c81c-111a-4b10-816a-1b3801df72bc tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1267 microversion: 2.1 time: 0.118613 Aug 30 18:44:49.642740 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3770/7281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:49 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:50.667687 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:50.669169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:50.678560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.680015 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.680684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.681746 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.683014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.683895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.776706 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:50.786073 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1b628fe5-f34e-47ab-9c6b-8ff402ca4326 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1337 microversion: 2.1 time: 0.124492 Aug 30 18:44:50.786828 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3512/7282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:50 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1337 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:51.807021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:51.807728 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:51.816805 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.817111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.817558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.818280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.818737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.819246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.960799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.969872 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a93a41ef-78ee-48c9-9868-23aaae707c9a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.166786 Aug 30 18:44:51.970467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3771/7283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:51 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:52.050397 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca45afde-8a82-4905-841d-2a58bce3d16a", "tag": "b3ae5f89-4715-49a7-9933-b63f3d03da90"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:52.064996 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.065592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:52.066106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:52.079167 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] Creating event network-changed:b3ae5f89-4715-49a7-9933-b63f3d03da90 for instance ca45afde-8a82-4905-841d-2a58bce3d16a on n-h1-852771-11 Aug 30 18:44:52.084790 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-8c47d2d8-2b8f-4161-8e6d-e131cb047c5d req-b8a22fe5-aa25-4554-9d51-febf4c31c278 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Aug 30 18:44:52.085411 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3513/7284] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:52.990634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:52.991280 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:52.999227 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.999738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.000189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.000882 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.001339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.001767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.136670 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:53.144418 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-dcb6822e-ba2e-48c4-86c7-514045fd7aec tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.158039 Aug 30 18:44:53.145018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3772/7285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:52 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:54.165016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:54.165656 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:54.172889 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.173383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.173834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.174537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.175003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.175442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.313672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.321441 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-46ddd38b-5bfa-4f5d-b450-1868733f97f0 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.160804 Aug 30 18:44:54.322027 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3514/7286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:54 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:55.342371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:55.342973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:55.349780 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.350244 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.350677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.351362 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.351840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.352264 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.491441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:55.499895 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-42551314-457c-40fc-8d01-97c3a61e0356 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.161495 Aug 30 18:44:55.500480 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3773/7287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:55 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:56.520290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:56.520968 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:56.527907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:56.528408 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:56.529376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:56.530192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:56.530699 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:56.531142 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:56.666509 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.675593 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c2016e5a-c4e3-42c8-a973-96c60e75242f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.159261 Aug 30 18:44:56.676219 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3515/7288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:56 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:57.697220 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:57.697831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:57.705265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.705750 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.706189 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.706877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.707334 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.707813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.841017 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.849488 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ee452ed-400e-462c-9251-9cf6f3c79999 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.156203 Aug 30 18:44:57.850066 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3774/7289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:57 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:58.644386 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca45afde-8a82-4905-841d-2a58bce3d16a", "name": "network-vif-plugged", "status": "completed", "tag": "b3ae5f89-4715-49a7-9933-b63f3d03da90"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:58.655815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.656310 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.656757 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.668091 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] Creating event network-vif-plugged:b3ae5f89-4715-49a7-9933-b63f3d03da90 for instance ca45afde-8a82-4905-841d-2a58bce3d16a on n-h1-852771-11 Aug 30 18:44:58.673668 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3518d426-3622-418d-adab-6c8a8f84be25 req-073b10b7-2745-4f37-ac22-a9e5fb9f50e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033013 Aug 30 18:44:58.674264 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3516/7290] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:58.870835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:58.871497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:58.878717 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.879201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.879680 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.880373 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.880834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.881257 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:59.012938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:59.021220 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6483606c-3f30-4f70-a233-30bb87b161a2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1392 microversion: 2.1 time: 0.154609 Aug 30 18:44:59.021800 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3775/7291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:58 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:00.039565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:00.040371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:00.046198 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:00.046907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:00.048740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:00.055589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.056082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.056524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.057232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.057683 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.058120 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.193631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:00.201488 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-473da643-e6a7-4b4f-aec2-82ee21d9bf6c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1564 microversion: 2.1 time: 0.162905 Aug 30 18:45:00.202070 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3517/7292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:00 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:00.231591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:00.232799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:00.234714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:00.241262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.241745 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.242179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.242870 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.243638 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.244064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.381790 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:00.389691 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aebaa5cb-40ea-4799-b16c-0eb8be822034 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1564 microversion: 2.1 time: 0.162829 Aug 30 18:45:00.390265 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3776/7293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:00 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:02.288414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:02.289108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:02.289417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca45afde-8a82-4905-841d-2a58bce3d16a", "tag": "b3ae5f89-4715-49a7-9933-b63f3d03da90"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:02.297319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:02.297818 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:02.298568 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:02.299293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:02.299789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:02.300233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:02.301891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:02.302435 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:02.302932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:02.315719 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] Creating event network-changed:b3ae5f89-4715-49a7-9933-b63f3d03da90 for instance ca45afde-8a82-4905-841d-2a58bce3d16a on n-h1-852771-11 Aug 30 18:45:02.320858 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e3cec4ab-eadb-4536-9cfe-4689f6f41bb9 req-298ce207-5050-421f-a73f-ff439d5cb588 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035510 Aug 30 18:45:02.321868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3777/7294] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:02.524432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:02.534137 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2fd2f861-f73e-465c-9807-d81b6e963cb5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1564 microversion: 2.1 time: 0.251835 Aug 30 18:45:02.548042 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3518/7295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:02 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:25.786301 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:25.786970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=38 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:25.856445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:25.858966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:25.865391 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:25.865872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:25.866311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:25.866990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:25.867440 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:25.867886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:25.924316 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-857f228e-777d-441e-b50f-c58b6f525a95 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action" status: 200 len: 24570 microversion: 2.1 time: 0.143702 Aug 30 18:45:25.924928 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3778/7296] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:25 2022] POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action => generated 24570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:45:32.345038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:32.347299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:32.347987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:32.354180 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:32.354667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:32.355113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:32.378981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Going to try to stop instance {{(pid=122123) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:45:32.421336 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0f03f2c1-a5be-4acf-b836-78ffc10573ee tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action" status: 202 len: 0 microversion: 2.1 time: 0.080481 Aug 30 18:45:32.421942 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3519/7297] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:32 2022] POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:45:32.430625 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:32.431933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:32.439465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:32.439964 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:32.440402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:32.441109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:32.441565 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:32.442083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:32.580818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:32.588720 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae982f0d-fd0a-47b5-a4ea-1827f4a027eb tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.162264 Aug 30 18:45:32.589306 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3779/7298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:32 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:33.612828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:33.613551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:33.620062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:33.620558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:33.621020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:33.621732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:33.622277 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:33.623458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:33.754846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:33.762711 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e50187b6-f970-4042-9173-3623012456a4 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.155891 Aug 30 18:45:33.763317 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3520/7299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:33 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:34.785576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:34.786206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:34.793102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:34.793592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:34.794060 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:34.795539 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:34.796007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:34.796615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:34.929861 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:34.937637 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c210d2b2-cab2-4532-be0f-b6a240ede97c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.156236 Aug 30 18:45:34.938222 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3780/7300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:34 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:35.958276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:35.958902 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:35.965876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:35.966674 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:35.966979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:35.967718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:35.968187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:35.968626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:36.098211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:36.106048 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e27aa9d-a8a8-468c-b23f-d86e1baee968 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.151657 Aug 30 18:45:36.107198 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3521/7301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:35 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:37.128040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:37.128698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:37.135843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.136336 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.136779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.137530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.138667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.139105 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.272831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:37.280711 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8d937587-c90d-4432-8afe-a4ee28caab02 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.156589 Aug 30 18:45:37.281307 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3781/7302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:37 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:38.302200 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:38.302828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:38.309782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:38.310537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:38.311000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:38.311742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:38.312208 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:38.312650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:38.446207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:38.455138 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06976177-e0d7-4a4c-9aee-aff98af7ae5d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.156850 Aug 30 18:45:38.455751 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3522/7303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:38 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:39.478064 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:39.478689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:39.485636 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:39.486119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:39.486557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:39.487259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:39.487744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:39.488179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:39.618564 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:39.627110 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98af22d9-fcd7-48e5-9763-544829c42a8a tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.153145 Aug 30 18:45:39.627729 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3782/7304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:39 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:40.647809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:40.648433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:40.655552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:40.656048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:40.656496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:40.657195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:40.657661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:40.658095 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:40.791704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:40.799855 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f4b65a99-0b07-4072-bd08-93a8cbd1da36 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.155954 Aug 30 18:45:40.800445 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3523/7305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:40 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:41.821342 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:41.821890 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:41.829313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:41.829794 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:41.830231 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:41.830927 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:41.831376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:41.831822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:41.970992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:41.978809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c2ae69db-eb76-4b76-a448-ba9ed84b0896 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1693 microversion: 2.1 time: 0.161574 Aug 30 18:45:41.979387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3783/7306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:41 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:42.999763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.000387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:43.007322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.007844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.008290 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.008983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.009441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.009879 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.147147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.155537 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d84ac513-2027-4b55-b86b-8e6110326063 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1670 microversion: 2.1 time: 0.159834 Aug 30 18:45:43.156137 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3524/7307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:42 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:44.249567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:44.251878 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:44.258748 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.259238 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.259708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.260615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.261076 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.261504 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.313495 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7e46d297-a7de-44e6-b6ce-24ec3ff0dcc5 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action" status: 200 len: 35621 microversion: 2.1 time: 0.068291 Aug 30 18:45:44.314149 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3784/7308] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:44 2022] POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action => generated 35621 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:45:44.326248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:44.333201 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.333691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.334139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.357783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Going to try to start instance {{(pid=122123) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:45:44.400508 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a3c83768-3a08-42a9-a541-1933d4d92013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action" status: 202 len: 0 microversion: 2.1 time: 0.078431 Aug 30 18:45:44.401037 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3525/7309] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:44 2022] POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:45:44.410822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:44.411552 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:44.419558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.420744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.421208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.421922 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.422382 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.422893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.567370 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:44.575499 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6e050900-bc63-42d2-b0ca-e13a077f97d3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1679 microversion: 2.1 time: 0.168715 Aug 30 18:45:44.576085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3785/7310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:44 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:45.599195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:45.599940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:45.606427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.606972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.607427 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.608184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.608655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.609096 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.754665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:45.763982 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-410bbe1e-212d-42de-b27f-fdc3a64fd579 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1679 microversion: 2.1 time: 0.169803 Aug 30 18:45:45.764591 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3526/7311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:45 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:46.786096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:46.786633 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:46.793572 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.794823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.795272 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.795995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.796477 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.796909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.928845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:46.936826 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c45124c9-2a9a-49a3-88c4-49b9744941a3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1683 microversion: 2.1 time: 0.154781 Aug 30 18:45:46.937403 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3786/7312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:46 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:11.126884 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:11.129147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:11.131569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:11.132385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:11.138293 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:11.138792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:11.139249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:11.139983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:11.140455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:11.140895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:11.196724 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-84ed902c-2e8d-40b4-a3b2-5f2f884ea1cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action" status: 200 len: 60172 microversion: 2.1 time: 0.074429 Aug 30 18:46:11.197396 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3527/7313] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:46:11 2022] POST /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a/action => generated 60172 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:46:18.202693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:18.203428 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:18.205872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca45afde-8a82-4905-841d-2a58bce3d16a", "tag": "b3ae5f89-4715-49a7-9933-b63f3d03da90"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:18.206777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:18.207668 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=50 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:18.214030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:18.215488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:18.216019 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:18.216798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:18.216948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:18.217256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:18.217390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:18.217682 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:18.217806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:18.229633 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] Creating event network-changed:b3ae5f89-4715-49a7-9933-b63f3d03da90 for instance ca45afde-8a82-4905-841d-2a58bce3d16a on n-h1-852771-11 Aug 30 18:46:18.234747 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-ca8bfca6-55d9-4b36-91e2-ee614e79599b req-1a179559-ce0a-46f1-81fe-18cef9bda698 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033466 Aug 30 18:46:18.235385 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3528/7314] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:46:18.246128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:46:18.339853 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-81172a94-1711-4d7f-89ae-7220396b8455 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 204 len: 0 microversion: 2.1 time: 0.140322 Aug 30 18:46:18.340812 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3787/7315] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:46:18 2022] DELETE /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:46:18.351753 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:18.352627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:18.360462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:18.361492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:18.361957 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:18.362785 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:18.363262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:18.363741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:18.525794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:18.534617 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f28cae18-41cc-4537-a0e4-7590341fb9c3 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1689 microversion: 2.1 time: 0.188309 Aug 30 18:46:18.535284 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3529/7316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:18 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:19.636932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:19.637648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:19.645814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:19.646304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:19.646749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:19.647456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:19.647947 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:19.648377 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:19.782431 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:19.790501 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-eb4659b4-08d5-4b2d-962d-194653b6cded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1689 microversion: 2.1 time: 0.157911 Aug 30 18:46:19.791085 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3788/7317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:19 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:20.353809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca45afde-8a82-4905-841d-2a58bce3d16a", "name": "network-vif-deleted", "tag": "b3ae5f89-4715-49a7-9933-b63f3d03da90"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:20.367953 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:20.368380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:20.368829 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:20.383033 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] Creating event network-vif-deleted:b3ae5f89-4715-49a7-9933-b63f3d03da90 for instance ca45afde-8a82-4905-841d-2a58bce3d16a on n-h1-852771-11 Aug 30 18:46:20.389915 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-b346ad97-4a8e-4812-a8d5-f3b2b6131de2 req-34e988aa-570a-4718-8bd8-a7fc8609c0dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040678 Aug 30 18:46:20.390529 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3530/7318] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:46:20.812119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:20.812742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:20.820387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:20.820876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:20.821324 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:20.822033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:20.822494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:20.822928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:20.855697 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:20.856198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:20.856642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:20.857162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lazy-loading 'fault' on Instance uuid ca45afde-8a82-4905-841d-2a58bce3d16a {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:46:20.903759 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:20.911186 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-432a55eb-77b8-41f8-98db-2bc2b52d0ded tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 200 len: 1357 microversion: 2.1 time: 0.103065 Aug 30 18:46:20.911809 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3789/7319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:20 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:21.933767 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:21.934499 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: ca45afde-8a82-4905-841d-2a58bce3d16a] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:21.941895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:21.942394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:21.942853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:21.943591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:21.944063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:21.944505 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:21.957797 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] HTTP exception thrown: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Request method failure captured: Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a HTTP/1.1 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDlmHAwgVDPR1stzAmBOPAttO9fdctZPpT2Urvfniv4saEFiKOmCYp9ptqnDj6rZ-n0LiLC1oedqMTFT2fzDWljU2QypX8ahUpmD9tSQ9_tYU5i7bA-XbMYU0VdRQitZGfROjQvl_g_QARZEtMS6eFdfIl1Zl5z1xv0XD9vVL6qIJXZU Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2515b3487624a2d9419bb97c9d5acca"}]}] Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: c2a9e5e851c94583b9240a29390f476f Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'ca45afde-8a82-4905-841d-2a58bce3d16a'} Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:46:21.959417 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Returning 404 to user: Instance ca45afde-8a82-4905-841d-2a58bce3d16a could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7a904a68-8951-4f5f-8f75-e0314053508d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a" status: 404 len: 111 microversion: 2.1 time: 0.031456 Aug 30 18:46:21.964361 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3531/7320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:21 2022] GET /compute/v2.1/servers/ca45afde-8a82-4905-841d-2a58bce3d16a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:46:24.947702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-829dbd88-18ef-4d38-85e0-0ba3d62fe649 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '.version_select at 0x7f2d938b9c10>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:24.968146 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-829dbd88-18ef-4d38-85e0-0ba3d62fe649 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1966214118" status: 202 len: 0 microversion: 2.1 time: 0.024297 Aug 30 18:46:24.968748 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3790/7321] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 30 18:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1966214118 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:46:25.002537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a26ed919-3361-45fb-b86b-247fe2f4f27d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: .version_select at 0x7f2d9cbc6c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-429883867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVQlWWvNw0+soCIXgwcR4mqXPo4b3iyOMUNnvzz/ZtnD3YPhV0iBM32MiP4XTGAyxhmDK52gQkqp5VtFZ5WqjSuvwcOP2xyaUoJTT9nx45TV0Liz7LZP9uBRGxRW6QiWg=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:25.019826 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a26ed919-3361-45fb-b86b-247fe2f4f27d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:25.025024 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-a26ed919-3361-45fb-b86b-247fe2f4f27d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:25.049631 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a26ed919-3361-45fb-b86b-247fe2f4f27d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051079 Aug 30 18:46:25.050234 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3532/7322] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:46:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:31.003676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:31.007851 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-162414509", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "networks": [{"uuid": "c0615b86-b3ff-448e-9927-214821877804"}], "key_name": "tempest-TestNetworkAdvancedServerOps-429883867", "security_groups": [{"name": "tempest-secgroup-smoke-1232261929"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:31.130812 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] validate_networks() for [('c0615b86-b3ff-448e-9927-214821877804', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:46:31.523042 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:46:31.523507 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:46:31.524314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:46:31.524733 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:46:31.525176 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:46:31.534932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:31.535424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:31.535894 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:31.536814 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:31.537279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:31.537715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:31.555940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:31.561630 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Getting quotas for user c2a9e5e851c94583b9240a29390f476f and project f2515b3487624a2d9419bb97c9d5acca. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:31.575209 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:46:31.577576 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:46:31.628665 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [c3bc900b-d1e4-46e5-87b5-9c6e2a7c96b9] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:46:32.638650 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [c3bc900b-d1e4-46e5-87b5-9c6e2a7c96b9] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37886. Aug 30 18:46:32.646309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-52e98a24-19b6-456c-bcc6-1261d70e9cdd tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.644386 Aug 30 18:46:32.652174 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3791/7323] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:46:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:46:32.656148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=16 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:32.662001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f932799d-be20-4c49-9064-0a1a3cb7ac89 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:32.664513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f932799d-be20-4c49-9064-0a1a3cb7ac89 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:32.723862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f932799d-be20-4c49-9064-0a1a3cb7ac89 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:32.731582 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f932799d-be20-4c49-9064-0a1a3cb7ac89 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1265 microversion: 2.1 time: 0.077068 Aug 30 18:46:32.732172 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3533/7324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:32 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:33.756018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:33.757276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:33.775049 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.776645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.777359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.778554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.779503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.781626 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.886063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:33.901457 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-73191e20-0fdd-4452-a1e5-dac497903c16 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1325 microversion: 2.1 time: 0.151039 Aug 30 18:46:33.902226 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3792/7325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:33 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:34.924352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:34.925050 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:34.939324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:34.939819 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:34.940497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:34.941583 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:34.942294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:34.942961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.092169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:35.100083 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-55bebfb4-e824-4e20-87ae-5469bc931013 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.180407 Aug 30 18:46:35.100681 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3534/7326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:34 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:35.203711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac43799-b8e6-4929-82fa-ab9f0fe2db76", "tag": "74099460-4a2f-4c44-93b0-48a1cb31df20"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:35.214696 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.215255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.215785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.228045 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] Creating event network-changed:74099460-4a2f-4c44-93b0-48a1cb31df20 for instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 on n-h2-852771-11 Aug 30 18:46:35.233235 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e22faf13-6b5b-4c80-a5cd-89cb97ba0b95 req-48a10045-571e-4d1d-827a-bf4c3b083bdc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090178 Aug 30 18:46:35.234014 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3793/7327] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:36.121139 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:36.121764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:36.129831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:36.130327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:36.130804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:36.131534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:36.132004 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:36.132443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:36.269679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:36.277514 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4bbd8c14-b626-40c4-ab58-e91eaacc4300 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.160336 Aug 30 18:46:36.278101 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3535/7328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:36 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:37.300734 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:37.301436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:37.308557 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:37.309040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:37.309475 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:37.310161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:37.310610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:37.311029 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:37.443084 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:37.450773 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8447b8a7-b776-4c31-b696-b50fc7ebd66d tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.155038 Aug 30 18:46:37.451341 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3794/7329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:37 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:38.472590 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:38.473232 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:38.481832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:38.482495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:38.482945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:38.483684 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:38.484149 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:38.484588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:38.623690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:38.632115 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-07885f7a-d16b-4516-a34c-123063e06b78 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.164052 Aug 30 18:46:38.632706 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3536/7330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:38 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:39.652999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:39.653655 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:39.661004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.661773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.662223 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.662923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.663378 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.663835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.800160 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:39.807840 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9a39ba0a-1e4a-41ba-9caa-89899863c0d7 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.158730 Aug 30 18:46:39.808413 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3795/7331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:39 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:40.829504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:40.830233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:40.837383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:40.837892 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:40.838376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:40.839090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:40.839611 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:40.840058 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:40.976985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:40.987884 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f5947550-23c3-48d8-ab1c-adfdb74d84db tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.162954 Aug 30 18:46:40.988498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3537/7332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:40 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:41.154787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac43799-b8e6-4929-82fa-ab9f0fe2db76", "name": "network-vif-plugged", "status": "completed", "tag": "74099460-4a2f-4c44-93b0-48a1cb31df20"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:41.165930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:41.166404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:41.166830 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:41.178338 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] Creating event network-vif-plugged:74099460-4a2f-4c44-93b0-48a1cb31df20 for instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 on n-h2-852771-11 Aug 30 18:46:41.183369 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-f6cc3e39-56b8-4ea9-af1f-a58366f2d681 req-4c962e0b-2ee0-4fb4-8182-7cf3b0b4fd54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 Aug 30 18:46:41.184792 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3796/7333] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:42.008498 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:42.009172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:42.011937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:42.018217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:42.018720 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:42.019177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:42.019917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:42.020388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:42.020832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:42.154338 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:42.162669 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e50c9ee5-fd92-4f9e-967f-a029251a3859 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1391 microversion: 2.1 time: 0.158127 Aug 30 18:46:42.163247 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3538/7334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:42 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:43.181438 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:43.182247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:43.187512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:43.188847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:43.195989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.196763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.197203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.197900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.198349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.198799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.330528 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:43.338201 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cbcc8692-28dd-44f4-8a25-84bcb8fa978c tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1562 microversion: 2.1 time: 0.157717 Aug 30 18:46:43.338774 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3797/7335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:43 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:43.358538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:43.359166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:43.361823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:43.368209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.368707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.369151 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.369845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.370305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.370740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.513536 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:43.522116 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-86e2ede8-d4b9-49f1-8a4d-f1baf01f5848 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1562 microversion: 2.1 time: 0.167379 Aug 30 18:46:43.522686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3539/7336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:43 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:45.114247 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:45.114866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:45.116849 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac43799-b8e6-4929-82fa-ab9f0fe2db76", "tag": "74099460-4a2f-4c44-93b0-48a1cb31df20"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:45.122192 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.122897 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.123512 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.124540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.124988 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.126464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.128728 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.129221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.129667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.144986 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] Creating event network-changed:74099460-4a2f-4c44-93b0-48a1cb31df20 for instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 on n-h2-852771-11 Aug 30 18:46:45.150036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-3fdcfcee-b289-47ad-9f01-102017440106 req-94276224-91fe-4f93-af7d-72751d046422 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037448 Aug 30 18:46:45.151025 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3540/7337] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:45.361127 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:45.369895 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e8f52754-d9c0-46a3-b62c-f2a3d20dc647 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1562 microversion: 2.1 time: 0.259990 Aug 30 18:46:45.371002 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3798/7338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:45 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:06.624119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:06.624830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=38 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:06.626095 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:47:06.626241 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action (ip 10.222.0.50) !!! Aug 30 18:47:06.631638 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:06.633925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:06.642025 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.642523 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.642974 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:06.643707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.644178 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.644617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:06.695446 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-06395b66-11c7-4df5-899e-6952cab9449f tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action" status: 200 len: 24572 microversion: 2.1 time: 0.073243 Aug 30 18:47:06.696410 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3541/7339] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:06 2022] POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:47:17.775321 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:17.776205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:17.778162 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:17.778834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=36 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:17.785946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.786548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.786965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.787683 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.788136 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.788554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.818409 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lazy-loading 'flavor' on Instance uuid 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:47:17.884563 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9059332b-2746-41c3-a77e-d8e971be0603 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action" status: 202 len: 0 microversion: 2.1 time: 0.112747 Aug 30 18:47:17.887429 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3799/7340] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:17 2022] POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:47:17.894718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:17.895438 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:17.898227 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:17.899094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:17.905738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.906233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.906680 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.907388 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.908078 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.908641 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:18.042743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:18.051157 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e19fde38-da65-44de-9e1c-6015536d5fbe tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1688 microversion: 2.1 time: 0.161556 Aug 30 18:47:18.051762 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3542/7341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:17 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:19.074444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:19.075143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:19.082152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:19.082628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:19.083058 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:19.083778 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:19.084225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:19.084647 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:19.215540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:19.224006 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-683f86ed-86c6-43ab-af7a-242e7d8045cf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1671 microversion: 2.1 time: 0.153801 Aug 30 18:47:19.224618 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3800/7342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:19 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:20.333645 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:20.335935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:20.343597 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.344098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.344546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.345245 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.345718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.346157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.397032 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c642d854-9718-427b-8ed3-1eb86b40b990 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action" status: 200 len: 38388 microversion: 2.1 time: 0.067337 Aug 30 18:47:20.397693 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3543/7343] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:20 2022] POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action => generated 38388 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:47:20.409654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:20.410199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:20.417221 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.417714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.418159 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.418866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.419323 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.419785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.495452 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-98897395-24cc-4450-b4b2-cf0771736490 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action" status: 202 len: 0 microversion: 2.1 time: 0.089462 Aug 30 18:47:20.496130 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3801/7344] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:20 2022] POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:47:20.505642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:20.506349 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:20.514543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.515102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.515578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.516288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:20.516750 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:20.517230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:20.652718 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:20.662181 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c6d95d03-69eb-4add-85c6-d4808129cd26 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1677 microversion: 2.1 time: 0.161475 Aug 30 18:47:20.662774 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3544/7345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:20 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:21.685003 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:21.685711 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:21.692930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:21.693414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:21.693854 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:21.694548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:21.695000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:21.695426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:21.832514 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:21.840257 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-83d8b5c4-c98d-4854-85a5-d2fccdb423bf tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1677 microversion: 2.1 time: 0.159594 Aug 30 18:47:21.840828 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3802/7346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:21 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:22.862385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:22.863000 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:22.871008 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:22.871516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:22.871966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:22.872655 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:22.873113 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:22.873543 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:23.003533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:23.011290 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-df5150a5-a30d-4c91-b29b-1d5155a7d595 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1680 microversion: 2.1 time: 0.153668 Aug 30 18:47:23.011881 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3545/7347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:22 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:23.108266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:23.110467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:23.118488 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:23.118915 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:23.119357 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:23.120079 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:23.120545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:23.120977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:23.160682 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-faea793f-0e87-44f1-9f62-94e55222a701 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action" status: 200 len: 38388 microversion: 2.1 time: 0.056274 Aug 30 18:47:23.161317 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3803/7348] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:23 2022] POST /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76/action => generated 38388 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:47:24.135919 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:24.136433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:24.138255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac43799-b8e6-4929-82fa-ab9f0fe2db76", "tag": "74099460-4a2f-4c44-93b0-48a1cb31df20"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:24.143830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:24.144322 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:24.144765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:24.145471 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:24.145929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:24.146360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:24.150199 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:24.150940 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:24.151681 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:24.162864 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] Creating event network-changed:74099460-4a2f-4c44-93b0-48a1cb31df20 for instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 on n-h2-852771-11 Aug 30 18:47:24.168017 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-74c22f29-dc06-494d-8dc3-7e4b2d122210 req-0363af07-13c9-4466-be9f-3cfaf67a3cdb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033752 Aug 30 18:47:24.169164 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3804/7349] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:24.178978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:47:24.270777 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fd57faf2-d58a-4139-9d11-a29dcac5540b tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 204 len: 0 microversion: 2.1 time: 0.138559 Aug 30 18:47:24.275460 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3546/7350] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:47:24 2022] DELETE /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:47:24.285452 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:24.287644 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:24.298810 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:24.299311 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:24.299833 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:24.300547 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:24.301131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:24.301619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:24.453093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:24.461217 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5ddf010f-dcba-496a-9a57-63944d5c8934 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1686 microversion: 2.1 time: 0.183384 Aug 30 18:47:24.461818 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3805/7351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:24 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:25.486325 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:25.487242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:25.494249 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:25.494751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:25.495205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:25.495970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:25.496440 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:25.496886 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:25.638577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:25.647074 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ce8a6cf-88a5-48e4-8edb-e0977c238cf6 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1686 microversion: 2.1 time: 0.166541 Aug 30 18:47:25.647684 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3547/7352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:25 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:26.238772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac43799-b8e6-4929-82fa-ab9f0fe2db76", "name": "network-vif-deleted", "tag": "74099460-4a2f-4c44-93b0-48a1cb31df20"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:26.252107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:26.252600 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:26.253040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:26.266230 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] Creating event network-vif-deleted:74099460-4a2f-4c44-93b0-48a1cb31df20 for instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 on n-h2-852771-11 Aug 30 18:47:26.272962 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-baa264bf-ee87-49a0-ae46-f234b2426809 req-fdee5144-91e6-4be2-8806-2268d0976f42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Aug 30 18:47:26.273941 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3806/7353] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:26.672588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:26.674215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:26.683302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:26.683917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:26.684370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:26.685364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:26.687665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:26.688390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:26.724169 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:26.724673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:26.725117 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:26.725669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lazy-loading 'fault' on Instance uuid 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:47:26.768219 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a9e5e851c94583b9240a29390f476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2515b3487624a2d9419bb97c9d5acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:26.775401 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2f62fd02-506a-4e02-9018-fe87ee82d625 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 200 len: 1355 microversion: 2.1 time: 0.109688 Aug 30 18:47:26.776019 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3548/7354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:26 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 1355 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:27.797904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:27.799527 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] [instance: 4ac43799-b8e6-4929-82fa-ab9f0fe2db76] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:27.806205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:27.806686 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:27.807121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:27.807838 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:27.808286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:27.808708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:27.822461 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.wsgi [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] HTTP exception thrown: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Request method failure captured: Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: request: GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 HTTP/1.1 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Accept: application/json Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Accept-Encoding: identity Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Connection: close Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Content-Length: 0 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Content-Type: application/json Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Host: 10.222.0.50 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: Openstack-System-Scope: None Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Auth-Token: gAAAAABjDlmHAwgVDPR1stzAmBOPAttO9fdctZPpT2Urvfniv4saEFiKOmCYp9ptqnDj6rZ-n0LiLC1oedqMTFT2fzDWljU2QypX8ahUpmD9tSQ9_tYU5i7bA-XbMYU0VdRQitZGfROjQvl_g_QARZEtMS6eFdfIl1Zl5z1xv0XD9vVL6qIJXZU Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Id: None Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Domain-Name: None Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Identity-Status: Confirmed Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Is-Admin-Project: True Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Id: default Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Domain-Name: Default Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Role: reader,member Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Roles: reader,member Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2515b3487624a2d9419bb97c9d5acca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2515b3487624a2d9419bb97c9d5acca"}]}] Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Id: f2515b3487624a2d9419bb97c9d5acca Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2057626901 Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-User: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Id: default Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Domain-Name: Default Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Id: c2a9e5e851c94583b9240a29390f476f Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2057626901-project Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: method: > Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: exception: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: action_args: {'id': '4ac43799-b8e6-4929-82fa-ab9f0fe2db76'} Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:47:27.824093 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: ERROR nova.api.openstack.wsgi Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Returning 404 to user: Instance 4ac43799-b8e6-4929-82fa-ab9f0fe2db76 could not be found. {{(pid=122124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9857484f-6137-4fbd-bbd4-f36d9175d1d2 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76" status: 404 len: 111 microversion: 2.1 time: 0.031879 Aug 30 18:47:27.829756 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3807/7355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:27 2022] GET /compute/v2.1/servers/4ac43799-b8e6-4929-82fa-ab9f0fe2db76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:47:31.116907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-32024711-c29b-43bc-a8ae-17f306a161b9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] Calling method '.version_select at 0x7f2d99357e50>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:31.138087 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-32024711-c29b-43bc-a8ae-17f306a161b9 tempest-TestNetworkAdvancedServerOps-2057626901 tempest-TestNetworkAdvancedServerOps-2057626901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-429883867" status: 202 len: 0 microversion: 2.1 time: 0.025254 Aug 30 18:47:31.139078 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3549/7356] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 30 18:47:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-429883867 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:47:42.292390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=18 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:42.293279 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:42.496863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e17f2755-5c5e-46a6-bd05-c5003a249c71 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'create', calling method: .version_select at 0x7f2d9cd93ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1281922373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrd7/m25/GRw+B8fk2ibOR3L3N+hPv3p49qDuqSyhlLzonsjmQgAapvfYgf+d/GWZP2JLy5Sluketq9DD+/Lr+IW06vUA9d2N8xiRYpRCze7v+A3h1IdGwFxYE0rWluKg=="}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:42.515652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e17f2755-5c5e-46a6-bd05-c5003a249c71 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for project f1de6b3687b649179db40a12eaaa29f6. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:47:42.526746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-e17f2755-5c5e-46a6-bd05-c5003a249c71 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for user 6602ea719db2457fa6233f00ddf992cf and project f1de6b3687b649179db40a12eaaa29f6. Resources: {'key_pairs'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:47:42.557174 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e17f2755-5c5e-46a6-bd05-c5003a249c71 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.270338 Aug 30 18:47:42.557880 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3808/7357] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:47:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:43.661300 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:43.662856 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:43.668327 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1315833328", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1281922373", "security_groups": [{"name": "tempest-secgroup-smoke-1042708375"}], "networks": [{"uuid": "19cc4e3b-aea7-4e3b-a84f-230a4e066fa4"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:43.790704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] validate_networks() for [('19cc4e3b-aea7-4e3b-a84f-230a4e066fa4', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:47:44.279835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:47:44.280511 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:47:44.281138 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:47:44.281730 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:47:44.282922 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:47:44.292575 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:44.293076 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:44.293546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:44.294312 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:44.294774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:44.295211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:44.312529 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for project f1de6b3687b649179db40a12eaaa29f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:47:44.317985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for user 6602ea719db2457fa6233f00ddf992cf and project f1de6b3687b649179db40a12eaaa29f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:47:44.330931 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:47:44.333276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:47:44.381852 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c4378ee2-db5c-49ff-a38a-faec8800f56f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722219 Aug 30 18:47:44.382517 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3550/7358] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:47:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:47:44.394041 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-00e10e6c-2e96-449a-9a80-7e9e28740983 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:44.394829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-00e10e6c-2e96-449a-9a80-7e9e28740983 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:44.454995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-00e10e6c-2e96-449a-9a80-7e9e28740983 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:44.462653 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-00e10e6c-2e96-449a-9a80-7e9e28740983 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1247 microversion: 2.1 time: 0.073186 Aug 30 18:47:44.463237 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3809/7359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:44 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:45.485863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1d549e96-24b8-4d0d-b17a-c1c5e96234c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:45.486592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1d549e96-24b8-4d0d-b17a-c1c5e96234c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:45.542051 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1d549e96-24b8-4d0d-b17a-c1c5e96234c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:45.550680 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1d549e96-24b8-4d0d-b17a-c1c5e96234c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1247 microversion: 2.1 time: 0.070441 Aug 30 18:47:45.551255 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3551/7360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:45 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:46.570839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b0a0c59-1453-4cdf-beb1-04c32730b836 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:46.571432 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b0a0c59-1453-4cdf-beb1-04c32730b836 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:46.624585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b0a0c59-1453-4cdf-beb1-04c32730b836 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:46.632238 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b0a0c59-1453-4cdf-beb1-04c32730b836 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1247 microversion: 2.1 time: 0.065313 Aug 30 18:47:46.632806 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3810/7361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:46 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:47.653080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0a302bb-4fd7-4083-9d66-3a90e5eadc58 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:47.653713 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0a302bb-4fd7-4083-9d66-3a90e5eadc58 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:47.712991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0a302bb-4fd7-4083-9d66-3a90e5eadc58 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:47.720131 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0a302bb-4fd7-4083-9d66-3a90e5eadc58 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1247 microversion: 2.1 time: 0.070948 Aug 30 18:47:47.720709 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3552/7362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:47 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:48.742822 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:48.743444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:48.750782 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.751277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.751753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.752457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.752930 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.753349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.814460 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:48.822296 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d9c2d4d5-cdeb-484a-a544-e4d98b4dec11 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1251 microversion: 2.1 time: 0.084116 Aug 30 18:47:48.822868 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3811/7363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:48 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:49.843912 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:49.844580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:49.853147 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:49.853648 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:49.854100 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:49.854809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:49.855276 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:49.855743 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:49.943027 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:49.952821 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4cb2f343-f0f3-4546-bfce-28b0904e2eeb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1307 microversion: 2.1 time: 0.113224 Aug 30 18:47:49.953752 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3553/7364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:49 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:50.974762 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:50.975376 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:50.982414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:50.982960 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:50.983402 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:50.984138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:50.984593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:50.985020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:51.121763 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:51.129668 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4709a952-b180-4244-a6a7-6320529bd42c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.159517 Aug 30 18:47:51.130252 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3812/7365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:50 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:51.553056 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:51.565396 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:51.567170 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:51.568159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:51.581443 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] Creating event network-changed:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h1-852771-11 Aug 30 18:47:51.586324 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-46dc5298-547a-4d93-974a-27276ea675e0 req-24659dae-8f58-49e3-a224-01c571e11300 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037208 Aug 30 18:47:51.587105 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3554/7366] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:52.150412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:52.150956 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:52.157916 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:52.158928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:52.159381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:52.160111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:52.160544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:52.161235 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:52.297102 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:52.305531 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7f089f2e-1d88-4bec-9acf-5971ddc85662 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.159104 Aug 30 18:47:52.306109 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3813/7367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:52 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:53.327022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:53.327779 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:53.334110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.334609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.335059 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.335904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.336378 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.336820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.475569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:53.483512 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-233a8b29-82f1-417c-b77c-5e0e07390df0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.161751 Aug 30 18:47:53.484339 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3555/7368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:53 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:54.504906 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:54.505542 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:54.512433 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:54.512912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:54.513340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:54.514020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:54.514483 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:54.514889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:54.643509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:54.651393 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-44702095-fa54-45c4-a987-3fef721ff3a3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.150520 Aug 30 18:47:54.652033 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3814/7369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:54 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:55.672442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:55.673070 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:55.675223 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:55.681336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.681843 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.682291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.682986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.683449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.683909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.827069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:55.836268 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cc370409-c4dc-4aa3-ba1e-681d6613faaa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.167652 Aug 30 18:47:55.836899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3556/7370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:55 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:56.856856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:56.857465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:56.860137 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=8 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:56.866695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.867167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.867627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.868313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.868758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.869175 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:57.004806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:57.012569 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d5208e5c-81b3-4f6d-827e-edae688adb95 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.159574 Aug 30 18:47:57.013173 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3815/7371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:56 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:57.463661 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "name": "network-vif-plugged", "status": "completed", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:57.475337 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:57.475864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:57.476315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:57.488645 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] Creating event network-vif-plugged:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h1-852771-11 Aug 30 18:47:57.494109 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-25fdc645-7b3c-4201-a115-f0f56e7add2b req-7813c7d4-43e8-450a-89db-2d7abeb9a170 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034159 Aug 30 18:47:57.494753 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3557/7372] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:58.033781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:58.034384 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:58.041267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.041684 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.042389 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.043078 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.043561 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.043987 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.174803 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:58.182608 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d77c810-d9a3-4eb8-affb-53bc146461b5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1373 microversion: 2.1 time: 0.152723 Aug 30 18:47:58.183188 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3816/7373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:58 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:59.200456 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=10 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:59.206443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:59.207161 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:59.213673 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.214160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.214603 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:59.215301 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.215792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.216230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:59.350663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:59.358818 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4356f1fc-0f7c-4c92-a14f-5019f9087be7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1555 microversion: 2.1 time: 0.159273 Aug 30 18:47:59.359754 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3558/7374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:59 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:59.381742 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:59.382367 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:59.389282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.389770 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.390212 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:59.390908 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.391365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.391832 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:59.523260 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:59.531059 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6d8552bf-0a7b-4974-8ada-f6975f601109 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1555 microversion: 2.1 time: 0.153963 Aug 30 18:47:59.531667 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3817/7375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:59 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:01.440296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:01.451374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.451983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.452496 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.464873 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] Creating event network-changed:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h1-852771-11 Aug 30 18:48:01.470208 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-1020b585-5055-4a56-b7b9-a8407bd3c413 req-b7483186-7375-4747-b891-60c217e9248a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Aug 30 18:48:01.472203 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3559/7376] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:53.479186 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:49:53.480304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:53.481056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=42 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:53.481996 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:49:53.482149 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action (ip 10.222.0.50) !!! Aug 30 18:49:53.483425 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:49:53.483614 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action (ip 10.222.0.50) !!! Aug 30 18:49:53.488037 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:53.488571 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:53.500692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.501179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.501619 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.502313 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.502773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.503198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.527434 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lazy-loading 'flavor' on Instance uuid a152bed0-f018-4ab4-b934-e25f4c16166d {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:49:53.851023 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-62231b5f-8827-405d-a0a8-092aaa19fc16 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action" status: 202 len: 0 microversion: 2.1 time: 0.372205 Aug 30 18:49:53.851669 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3818/7377] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:49:53 2022] POST /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:49:53.858105 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 18:49:53.859033 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 18:49:53.859681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:53.860434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=32 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:53.861644 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:49:53.861779 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d (ip 10.222.0.50) !!! Aug 30 18:49:53.868518 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:53.869238 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:53.878459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.878955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.879411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.880148 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.880792 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.881242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:54.063640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:54.071736 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3f05bafe-46a4-45a5-8d18-8baebea23b87 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.215481 Aug 30 18:49:54.072316 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3560/7378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:53 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:55.095259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:55.096057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:55.105292 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.105771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.106204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.106891 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.107339 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.107789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.113414 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38236. Aug 30 18:49:55.248172 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:55.256761 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8a857df7-ec37-44c2-ad62-94f8a05f86d6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.166702 Aug 30 18:49:55.257371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3819/7379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:55 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:56.277845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:56.278465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:56.292010 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.292508 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.292971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.293685 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.294152 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.294593 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.298551 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38244. Aug 30 18:49:56.302884 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38242. Aug 30 18:49:56.434416 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:56.442277 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3d35c973-a546-455f-af37-e177322cb333 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.168393 Aug 30 18:49:56.442899 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3561/7380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:56 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:57.464592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:57.465203 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:57.472030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:57.472508 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:57.472938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:57.473648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:57.474107 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:57.474783 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:57.605010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:57.612827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b36d6f2d-929c-4ce3-8c9d-1f1c2c84e055 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.152272 Aug 30 18:49:57.613400 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3820/7381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:57 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:58.634986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:58.635551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:58.642411 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.642949 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.643357 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.644082 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.644549 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.644988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.784470 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:58.792261 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c09baa9a-5b55-4d38-aa93-c3466c369d22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.161266 Aug 30 18:49:58.792854 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3562/7382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:58 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:59.812753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:59.813366 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:59.820399 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.820877 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.821308 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.821992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.822441 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.822863 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.953331 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:59.962103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c59e3f5e-f9ec-4e44-af5c-77529f7a17a9 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.153220 Aug 30 18:49:59.962686 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3821/7383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:59 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:00.984348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:00.984981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:00.992842 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.993335 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.993782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.994514 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.994983 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.995422 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:01.130571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:01.138829 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4c6a6a56-6b3e-40eb-a145-2250f051061e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.158449 Aug 30 18:50:01.139419 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3563/7384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:00 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:02.160179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:02.160777 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:02.167772 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:02.168256 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:02.168695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:02.169394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:02.169846 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:02.170271 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:02.307121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:02.314967 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1ea9695a-ca86-46a3-881b-bcfd0940c936 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.158805 Aug 30 18:50:02.315573 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3822/7385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:02 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:03.338080 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:03.338738 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:03.345963 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:03.346504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:03.346986 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:03.347811 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:03.348272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:03.348705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:03.483667 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:03.491538 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-146c3f42-9939-4d56-afa4-8a75bd388b51 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1680 microversion: 2.1 time: 0.158288 Aug 30 18:50:03.492566 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3564/7386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:03 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:04.513967 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:04.514521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:04.521484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.522556 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.523157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:04.523901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.524359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.524789 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:04.657560 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:04.665830 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a215deb9-6e2e-457a-a28b-a40f63f10f8c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1701 microversion: 2.1 time: 0.155875 Aug 30 18:50:04.666410 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3823/7387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:04 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:05.688175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:05.688805 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:05.695985 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:05.696503 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:05.696971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:05.697651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:05.698110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:05.698544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:05.831574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:05.840202 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e69a2f6f-6831-43af-aa68-3fc1bce901f4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1701 microversion: 2.1 time: 0.155950 Aug 30 18:50:05.840810 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3565/7388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:05 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:06.862381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:06.863001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:06.870597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.871314 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.871941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.872823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.873482 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.874057 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.026715 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:07.036505 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-88b0eb09-bfb5-4deb-ada4-064cde7184cb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.178046 Aug 30 18:50:07.037160 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3824/7389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:06 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:08.063516 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:08.065845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:08.073970 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:08.074591 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:08.075420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:08.076453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:08.076980 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:08.077635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:08.252798 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:08.264379 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d70b61c8-c22d-4550-8e0e-5b8df0ff9c3a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.204969 Aug 30 18:50:08.266477 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3566/7390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:08 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:08.353198 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "name": "network-vif-plugged", "status": "completed", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:08.364168 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:08.364901 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:08.368699 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:08.382210 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] Creating event network-vif-plugged:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h1-852771-11 Aug 30 18:50:08.390805 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-5d878278-5318-4b3a-ad25-15865bbe44f8 req-5bcbf9f0-bc4a-4311-836b-b46d1f5abdf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106524 Aug 30 18:50:08.392056 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3825/7391] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:09.291355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:09.292023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:09.300497 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:09.301094 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:09.301678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:09.302525 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:09.303708 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:09.304168 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:09.490903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:09.501463 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c94d1a65-6a92-4972-8b6a-5cc3fff4d580 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.214852 Aug 30 18:50:09.502061 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3567/7392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:09 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:10.526169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:10.527617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:10.534768 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.535320 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.535961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.536866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.538269 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.538939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.701141 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:10.713256 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1b8460d6-a54a-47ad-9aa0-9c16e95be5dc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.191569 Aug 30 18:50:10.713871 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3826/7393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:10 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:11.735207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:11.735923 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.744948 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.745548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.746071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.746891 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.747441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.747988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.907054 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:11.916810 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ce685f4f-d276-4db1-a837-84c22c0c259a tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.185663 Aug 30 18:50:11.917446 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3568/7394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:11 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:12.938658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:12.939823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:12.949401 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:12.950125 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:12.950648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:12.951451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:12.952022 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:12.952529 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:13.124558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:13.134095 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-737cda17-7fc2-4736-8475-9202d96207a2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.199318 Aug 30 18:50:13.135517 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3827/7395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:12 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:14.158097 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:14.159459 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:14.168230 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.169494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.169494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.170060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.170538 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.170962 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.329039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:14.337842 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0a5572f5-5e47-4274-83ba-2c836702f90f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.183741 Aug 30 18:50:14.338619 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3569/7396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:14 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:15.360415 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:15.361018 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:15.368836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.369347 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.369779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:15.370480 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.370928 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.371345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:15.513712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:15.522705 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0cf50158-39c2-4685-a89e-ad86bceeade4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1696 microversion: 2.1 time: 0.166232 Aug 30 18:50:15.523237 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3828/7397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:15 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:16.550003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:16.550668 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:16.558261 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.558765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.559220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.559971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.560472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.560918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.698733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:16.706580 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fc830016-67a2-4cc1-9827-3318cd913fd7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1678 microversion: 2.1 time: 0.165258 Aug 30 18:50:16.707166 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3570/7398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:16 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:17.728255 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:17.728873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:17.735779 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.736266 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.736709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.737406 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.737866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.738294 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.871156 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:17.878902 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bd97d723-d3a9-4f6d-8d70-f9f4f4f2dd1b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1678 microversion: 2.1 time: 0.154682 Aug 30 18:50:17.879502 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3829/7399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:17 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:18.901065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:18.901806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:18.908809 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:18.909294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:18.909733 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:18.910425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:18.910877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:18.911306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.040596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:19.048619 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-08b9be82-abc3-4176-b2ed-8febd344d2d0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1621 microversion: 2.1 time: 0.152218 Aug 30 18:50:19.049232 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3571/7400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:18 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1621 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:19.070163 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:19.070799 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:19.077646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.078130 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.078610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.079309 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.079834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.080267 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.179525 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122124) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 18:50:19.246642 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a28b422c-f841-4e66-b4e6-0fbbb4b2c5c6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action" status: 202 len: 0 microversion: 2.1 time: 0.181167 Aug 30 18:50:19.247274 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3830/7401] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:19 2022] POST /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:50:19.255384 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:19.256537 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:19.262831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.263339 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.263839 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.264551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.265020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.265476 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.410722 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:19.419423 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b7e858db-0cb1-4522-9fb5-90f41f038c70 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1629 microversion: 2.1 time: 0.167701 Aug 30 18:50:19.420498 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3572/7402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:19 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1629 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:20.093610 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "name": "network-vif-unplugged", "status": "completed", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:20.106893 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.107381 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.107847 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.118771 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] Unable to find a host for instance a152bed0-f018-4ab4-b934-e25f4c16166d. Dropping event network-vif-unplugged {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:50:20.119708 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e48422ef-3785-463a-af9a-2c6eb48cb576 req-affcc965-a14d-404a-9348-ee29b62d5fa9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031218 Aug 30 18:50:20.120897 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3831/7403] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:50:20.441363 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:20.441984 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:20.449488 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.449954 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.450393 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.451081 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.451560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.451992 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.587772 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:20.595634 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95a7b3cf-19c6-4888-b247-29927f0473d1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1629 microversion: 2.1 time: 0.158134 Aug 30 18:50:20.596216 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3573/7404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:20 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:21.617586 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:21.618111 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:21.625013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.625505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.625944 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.626641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.627097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.627555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.760478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:21.764098 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:21.769262 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-3da9553d-7607-4833-9129-850d623b6194 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1629 microversion: 2.1 time: 0.156155 Aug 30 18:50:21.769849 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3832/7405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:21 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:22.791951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.792587 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:22.799649 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.800158 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.800586 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.801287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.801747 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.802177 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.939209 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:22.947222 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-cfe3f931-b78b-4954-835b-027acfcf5454 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1629 microversion: 2.1 time: 0.160002 Aug 30 18:50:22.947842 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3574/7406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:23.970611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:23.971591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:23.976242 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:23.986354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.987217 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.987920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.989008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.989710 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.990857 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:24.140506 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:24.149087 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-4fbccb55-6845-4660-8533-61e13fa57350 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1629 microversion: 2.1 time: 0.184630 Aug 30 18:50:24.149891 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3833/7407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:23 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1629 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:25.171901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:25.172531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:25.175287 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=31 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:25.180847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.181352 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.181845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.182565 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.183033 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.183489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.188044 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=91 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:25.310904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:25.321284 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.321844 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.322361 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.336779 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] Creating event network-changed:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h2-852771-11 Aug 30 18:50:25.341993 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-62ab3de7-4951-4f2d-9a10-a1595043ccaa req-cc263388-ebcf-449f-9173-21ccafb5a086 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115362 Aug 30 18:50:25.342698 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3834/7408] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:25.455534 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:25.463712 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03ff139d-765a-4610-bbd2-1a313fcd7946 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.295634 Aug 30 18:50:25.464307 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3575/7409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:25 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:26.497879 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:26.500739 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:26.516036 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:26.517031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:26.517965 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:26.518980 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:26.519693 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:26.520690 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:26.703080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:26.713210 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ceab8089-c854-46d4-b49e-b4ce2b7e0d26 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.230282 Aug 30 18:50:26.714872 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3835/7410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:26 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:27.750191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:27.752618 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:27.767450 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:27.768714 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:27.769247 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:27.770273 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:27.770921 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:27.771460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:27.952848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:27.969821 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5d1ecb92-72af-4347-be5b-d5fefeec8145 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.235485 Aug 30 18:50:27.984302 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3576/7411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:27 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:28.997698 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:28.998349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:29.005404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:29.006374 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:29.006823 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:29.007548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:29.008012 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:29.008444 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:29.161251 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:29.171103 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46c4b22c-cd44-4b04-aeae-f15793af9dbc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.177224 Aug 30 18:50:29.186732 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3836/7412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:28 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:30.193659 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:30.194474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:30.201578 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:30.202259 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:30.202663 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:30.203380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:30.203873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:30.204313 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:30.344646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:30.355084 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-34800a11-5363-4017-9e24-3cc375575d48 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.165239 Aug 30 18:50:30.356240 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3577/7413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:30 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:31.378171 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:31.378820 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:31.386240 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:31.386727 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:31.387166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:31.387896 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:31.388351 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:31.388840 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:31.534517 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:31.543407 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e0ed07a1-053e-4752-aea4-655a68f35cdb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.169170 Aug 30 18:50:31.544012 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3837/7414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:31 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:32.565047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:32.565576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:32.573231 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.573732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.574195 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.574903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.575366 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.575855 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.712478 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:32.721947 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-8878a86e-aa25-4a97-bf2f-f9efcfeff3aa tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.160875 Aug 30 18:50:32.725166 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3578/7415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:32 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:33.745466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:33.746178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:33.753232 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:33.753751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:33.754178 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:33.754875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:33.755322 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:33.756423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:33.890236 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:33.897997 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bb840167-3899-4f97-871e-55be72f17265 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.156844 Aug 30 18:50:33.898578 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3838/7416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:33 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:34.920939 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:34.921527 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:34.929280 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:34.929762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:34.930206 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:34.930900 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:34.931354 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:34.931813 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:35.074978 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:35.084351 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03ad18e5-a8d4-47f9-bb9b-7cf8f0cda693 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.166623 Aug 30 18:50:35.084708 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3579/7417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:34 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:36.105899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:36.106544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:36.112990 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:36.113466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:36.113898 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:36.114578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:36.116065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:36.116065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:36.251503 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:36.259501 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-8b46ed69-e03f-406f-ba4c-64993cb5822f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.157563 Aug 30 18:50:36.260387 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3839/7418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:36 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:37.281108 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:37.281729 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:37.288703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:37.289188 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:37.289630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:37.290328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:37.290787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:37.291250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:37.430540 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:37.438540 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5316b512-855f-4e47-8dc0-16ce42863da6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.161339 Aug 30 18:50:37.439152 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3580/7419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:37 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:38.461249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:38.462011 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:38.469045 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:38.469537 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:38.469977 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:38.470787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:38.471249 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:38.471709 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:38.615842 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:38.623890 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b7c02112-95d2-4832-b102-fdef740768f2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.167257 Aug 30 18:50:38.624509 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3840/7420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:38 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:39.646751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:39.647433 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:39.654377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:39.654860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:39.655302 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:39.656020 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:39.656479 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:39.656909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:39.788751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:39.796566 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a8570c3d-1c0d-4941-8aaf-a60e81f0a7ec tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.154293 Aug 30 18:50:39.797142 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3581/7421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:39 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:40.099769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "name": "network-vif-plugged", "status": "completed", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:40.110521 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:40.111142 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:40.111608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:40.124194 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] Creating event network-vif-plugged:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h2-852771-11 Aug 30 18:50:40.129182 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-83eb8428-52d0-4517-bea5-c5f9c5da9e8b req-eb0b846d-86b4-43c7-8673-cf4ddea20b4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Aug 30 18:50:40.129790 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3841/7422] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:40.818133 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:40.819179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:40.826881 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:40.827387 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:40.827990 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:40.828704 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:40.829175 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:40.829647 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:40.964778 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:40.972555 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-75f48a83-7aca-4d43-ae1c-c79f0cd80450 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1687 microversion: 2.1 time: 0.158468 Aug 30 18:50:40.973136 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3582/7423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:40 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:41.995975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:41.996587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:42.002663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:42.003467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:42.003931 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:42.004611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:42.005065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:42.005486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:42.136341 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:42.144082 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-a356cc40-a482-4665-b922-9e744c2251db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1674 microversion: 2.1 time: 0.154246 Aug 30 18:50:42.144668 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3842/7424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:41 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:52.839197 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=15 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:52.839991 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=47 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:52.843118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=19 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:52.844097 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=52 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:52.844239 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:52.844764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:52.859903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:52.860425 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:52.860876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:52.861602 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:52.862062 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:52.862495 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:52.891101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:51:52.912872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:52.922873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:52.923825 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:52.924511 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:52.939099 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] Creating event network-changed:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h2-852771-11 Aug 30 18:51:52.946058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-c8fe5de2-be72-4b3f-bdd8-9bffdf69467f req-0d776db5-f68f-4603-b82c-fd38e611e41a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105666 Aug 30 18:51:52.946970 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3843/7425] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:52.957611 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [512316ed-47c9-46c9-94d4-a679bcd11866] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:51:53.965362 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [512316ed-47c9-46c9-94d4-a679bcd11866] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38518. Aug 30 18:51:53.987170 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9efb31fa-2b28-4acb-aade-9c4e4e0e07eb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 204 len: 0 microversion: 2.1 time: 1.149935 Aug 30 18:51:53.987807 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3583/7426] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:51:52 2022] DELETE /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:51:54.000040 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:54.000781 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:54.009407 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:54.009899 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:54.010395 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:54.011033 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:54.012059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:54.012487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:54.151143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:54.158991 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-193bc700-a3a8-491c-85db-9732185a46ff tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1561 microversion: 2.1 time: 0.165468 Aug 30 18:51:54.159593 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3844/7427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:53 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:55.181906 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:55.182609 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:55.190254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:55.190768 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:55.191211 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:55.191940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:55.192394 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:55.192825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:55.396021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:55.403835 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-39cf90b6-766d-428b-bc80-a388d1173ecb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 200 len: 1561 microversion: 2.1 time: 0.227004 Aug 30 18:51:55.415267 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3584/7428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:55 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 1561 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:55.776032 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a152bed0-f018-4ab4-b934-e25f4c16166d", "name": "network-vif-deleted", "tag": "ca61f7d4-a2ba-488a-8b2d-3a1dff747521"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:55.787628 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:55.788829 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:55.789312 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:55.802091 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] Creating event network-vif-deleted:ca61f7d4-a2ba-488a-8b2d-3a1dff747521 for instance a152bed0-f018-4ab4-b934-e25f4c16166d on n-h2-852771-11 Aug 30 18:51:55.808282 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2763c3dc-bad1-40df-ab15-2a879fc94d02 req-261e1c99-ce44-4f55-99a2-ebef658ce855 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Aug 30 18:51:55.808892 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3845/7429] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:56.425773 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:56.426319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: a152bed0-f018-4ab4-b934-e25f4c16166d] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:56.432872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:56.433369 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:56.433847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:56.434555 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:56.435022 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:56.435462 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:56.449315 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] HTTP exception thrown: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Request method failure captured: Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d HTTP/1.1 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDltJvj4yImjMCPUk0LmkOBomk93lr9DbKtU11d9xRBg0rqVbTP0nkFvzfCeSiCSKn7biekTiEqYnuXaTElOGq6tk2rJ__MOOdgD4MiXkIVlBkV_kUsxOMmU4Kfv_DJya28TgXsyGa7PRBFY_XIg1M0OLfCtO6pVUNscCpNc61kfy1o4 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f1de6b3687b649179db40a12eaaa29f6 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestShelveInstance-1616690349 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f1de6b3687b649179db40a12eaaa29f6"}]}] Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestShelveInstance-1616690349 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f1de6b3687b649179db40a12eaaa29f6 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestShelveInstance-1616690349 Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestShelveInstance-1616690349-project Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6602ea719db2457fa6233f00ddf992cf Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestShelveInstance-1616690349-project Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'a152bed0-f018-4ab4-b934-e25f4c16166d'} Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:56.450955 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Returning 404 to user: Instance a152bed0-f018-4ab4-b934-e25f4c16166d could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2fc4dd31-682b-4aa3-b7c0-3c9d2bdffea0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d" status: 404 len: 111 microversion: 2.1 time: 0.030700 Aug 30 18:51:56.455897 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3585/7430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:56 2022] GET /compute/v2.1/servers/a152bed0-f018-4ab4-b934-e25f4c16166d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:51:56.616741 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5bd006db-f0dc-4002-88d6-e6ece7e585db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '.version_select at 0x7f2d93316af0>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:56.621690 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bd006db-f0dc-4002-88d6-e6ece7e585db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:51:57.629181 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bd006db-f0dc-4002-88d6-e6ece7e585db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38532. Aug 30 18:51:57.650067 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5bd006db-f0dc-4002-88d6-e6ece7e585db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1281922373" status: 202 len: 0 microversion: 2.1 time: 1.037550 Aug 30 18:51:57.650690 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3846/7431] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 30 18:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1281922373 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:57.675997 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-25fda029-f775-4740-b612-64fdcad14852 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'create', calling method: .version_select at 0x7f2d9878d9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-872510059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpeN1GbS4Gd73tqG235N+QzXRfJwXNIM7BrAuAUfyp1/BmLJ+AODZgsQoPUXngX2LjRtIvpsMA6BDCtW7oLMIsIh8e8f99u2JKjK7JcKP8ONODRe/ZBXvDeAR0R3F+VqA=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:57.693390 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-25fda029-f775-4740-b612-64fdcad14852 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for project f1de6b3687b649179db40a12eaaa29f6. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:51:57.698637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-25fda029-f775-4740-b612-64fdcad14852 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for user 6602ea719db2457fa6233f00ddf992cf and project f1de6b3687b649179db40a12eaaa29f6. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:51:57.726359 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-25fda029-f775-4740-b612-64fdcad14852 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053708 Aug 30 18:51:57.726958 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3586/7432] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:51:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:14.040344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-136199014", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-872510059", "security_groups": [{"name": "tempest-secgroup-smoke-1886353551"}], "networks": [{"uuid": "19cc4e3b-aea7-4e3b-a84f-230a4e066fa4"}], "block_device_mapping_v2": [{"uuid": "5f246aea-b78e-420a-972d-572f26692dae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:14.051166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=10 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:14.051839 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:14.166254 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] validate_networks() for [('19cc4e3b-aea7-4e3b-a84f-230a4e066fa4', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:52:14.548895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:52:14.549325 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:52:14.549804 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:52:14.550222 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:52:14.550641 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:52:14.559654 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.560140 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.560583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.561350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.561811 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.562241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.579714 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for project f1de6b3687b649179db40a12eaaa29f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:52:14.585858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Getting quotas for user 6602ea719db2457fa6233f00ddf992cf and project f1de6b3687b649179db40a12eaaa29f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:52:14.643046 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:52:14.645364 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f246aea-b78e-420a-972d-572f26692dae',volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:52:14.772602 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-017ec24b-e358-4143-a32f-6f9dd0418e79 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737733 Aug 30 18:52:14.773269 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3847/7433] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:52:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:52:14.784216 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-faa73961-0096-40bc-90c4-5f0cb0b3c24c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:14.784870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-faa73961-0096-40bc-90c4-5f0cb0b3c24c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:14.787955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:14.788864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=4 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:14.789502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:14.848896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-faa73961-0096-40bc-90c4-5f0cb0b3c24c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:14.856158 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-faa73961-0096-40bc-90c4-5f0cb0b3c24c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1087 microversion: 2.1 time: 0.075843 Aug 30 18:52:14.856752 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3587/7434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:14 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:15.879200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:15.879904 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:15.886658 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.887132 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.887614 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.888744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.888744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.889169 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.958784 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:15.968337 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f623506b-66ab-478e-a3b2-d379ba5d70b4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1203 microversion: 2.1 time: 0.093991 Aug 30 18:52:15.969264 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3848/7435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:15 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1203 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:16.989407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:16.990028 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:17.000522 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.001215 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.001665 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.002373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.003012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.003630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.200544 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:17.207895 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:17.214609 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.215520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.216241 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.226099 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a3b96fc6-d817-467e-b706-0fe79d077ab1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1271 microversion: 2.1 time: 0.239855 Aug 30 18:52:17.227702 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3588/7436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:16 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:17.243943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] Creating event network-changed:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h1-852771-11 Aug 30 18:52:17.253673 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e6b763db-8ec7-4aaf-9897-b70a08859c6c req-9cb9c0b0-8a3c-47e3-80dc-15d27d8e10d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056707 Aug 30 18:52:17.254909 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3849/7437] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:18.249569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:18.250801 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:18.259783 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.260631 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.261286 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.262221 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.262878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.263530 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.508039 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:18.516544 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-16bb3a09-13e6-45e2-b0d5-d97d1dff8180 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1271 microversion: 2.1 time: 0.271292 Aug 30 18:52:18.517139 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3589/7438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:18 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:19.540131 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:19.540755 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:19.547117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.547615 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.548053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.548746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.549200 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.549627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.689835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:19.698170 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-94f33003-4250-44e8-9463-8d211f9ba380 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1271 microversion: 2.1 time: 0.164088 Aug 30 18:52:19.698984 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3850/7439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:19 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:20.719102 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:20.719910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:20.727898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.728463 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.728972 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.729765 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.730291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.730789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.873089 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.880856 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-7b7dc76f-a6c6-4b24-92fd-49dc4c3139b7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1271 microversion: 2.1 time: 0.165831 Aug 30 18:52:20.881436 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3590/7440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:20 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:21.901648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:21.902286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:21.909077 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.909583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.910020 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.910702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.911153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.911605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.042869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.050651 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cf2eda3b-6b74-4326-b619-4d21c279f6c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.153285 Aug 30 18:52:22.051219 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3851/7441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:21 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:23.073052 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:23.073671 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:23.080563 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.081049 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.081491 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.082184 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.082640 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.083071 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.214577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:23.222311 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-d5699cc2-0f99-418e-ae83-edc79d525bc7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.153860 Aug 30 18:52:23.222882 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3591/7442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:23 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:24.243500 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:24.244119 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:24.251413 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.251920 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.252349 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.253063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.253510 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.253932 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.387422 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:24.395187 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d6f3e984-aa61-45e3-add0-e068b5b802c0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.156045 Aug 30 18:52:24.395807 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3852/7443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:24 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:25.417021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:25.417560 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:25.419777 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:52:25.419924 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 (ip 10.222.0.50) !!! Aug 30 18:52:25.421859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:25.429435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:25.429920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:25.431019 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:25.431745 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:25.432207 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:25.432642 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:25.568347 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:25.576505 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f2087e59-af60-46bc-bc00-aa62d84f2acf tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.164032 Aug 30 18:52:25.577084 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3592/7444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:25 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:26.597818 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:26.598348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:26.600390 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:26.601165 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:26.608387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.608875 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.609305 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.610000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.610450 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.610872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.740961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:26.749625 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ec96311c-c90e-46ae-8962-98114f733198 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.155971 Aug 30 18:52:26.750197 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3853/7445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:26 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:27.770192 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:27.770820 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:27.777933 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.778429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.778870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:27.779672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.780137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.780577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:27.921872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:27.929869 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e6ed4d29-d09e-4aaf-9583-783268f0734b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.163539 Aug 30 18:52:27.931060 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3593/7446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:27 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:28.952028 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:28.952642 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:28.959677 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:28.960170 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:28.960592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:28.961974 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:28.962459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:28.962900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:29.098602 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:29.106859 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-aef2ffcf-4d8c-489c-8089-f86f99dfe217 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.158927 Aug 30 18:52:29.107718 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3854/7447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:28 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:30.128474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:30.129137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:30.136336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:30.136822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:30.137262 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.137956 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:30.138441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:30.138870 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.273383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:30.282140 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ff334303-df3b-451d-97c6-71737273650c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.157588 Aug 30 18:52:30.282750 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3594/7448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:30 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:30.913597 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "name": "network-vif-plugged", "status": "completed", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:30.925118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:30.925530 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:30.925962 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.941038 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] Creating event network-vif-plugged:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h1-852771-11 Aug 30 18:52:30.947364 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-72d1b8d3-8e39-43e4-ab94-4aac64bda145 req-22efcb5b-7336-4aca-9dd9-7ee245e71ad5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036402 Aug 30 18:52:30.948037 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3855/7449] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:31.303407 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:31.304086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:31.312068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.312562 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.313003 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.313700 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.314157 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.314585 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.444834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:31.452897 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4e42c4c2-3f9f-4b0f-923e-853d76e9b32b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1259 microversion: 2.1 time: 0.153489 Aug 30 18:52:31.453480 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3595/7450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:31 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:32.474900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:32.475634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:32.481929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:32.482419 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:32.482869 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:32.483593 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:32.484056 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:32.484485 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:32.622426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:32.630264 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6201da5e-995e-4976-8c57-24ca281ebbd4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1441 microversion: 2.1 time: 0.160455 Aug 30 18:52:32.630841 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3856/7451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:32 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:32.651109 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:32.651764 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:32.658554 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:32.659048 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:32.659539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:32.660251 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:32.660719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:32.661160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:32.790859 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:32.798903 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-03cc7a54-d77a-4e48-b74c-30de1938bdf6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1441 microversion: 2.1 time: 0.152027 Aug 30 18:52:32.799506 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3596/7452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:32 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:34.375627 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:34.386359 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:34.386921 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:34.387417 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:34.398689 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] Creating event network-changed:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h1-852771-11 Aug 30 18:52:34.404136 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e171c4c4-52a8-48f5-b3ef-77e08e644c56 req-6ad10ae8-9af5-43d7-b1b9-9b321a666fd5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Aug 30 18:52:34.404821 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3857/7453] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:30.529302 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:54:30.530174 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:54:30.530762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:30.531633 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=54 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:30.596255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:30.596797 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:30.602862 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.603360 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.603848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.604545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.605012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.605452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.629414 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.objects.instance [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lazy-loading 'flavor' on Instance uuid 5f8d27b7-5a9c-41f8-a680-213c9a39e849 {{(pid=122123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:54:30.703635 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ed7d584c-35b1-444a-978b-f6a1a37e1947 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849/action" status: 202 len: 0 microversion: 2.1 time: 0.176147 Aug 30 18:54:30.704373 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3597/7454] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:30 2022] POST /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:30.711289 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:54:30.712142 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:54:30.712746 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:30.713689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=50 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:30.719145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:30.719961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:30.729117 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.729584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.730798 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.732567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.733050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.733459 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.870185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:30.878199 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-537778f1-f82f-4435-b621-1bd2dd8ae4ac tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.169415 Aug 30 18:54:30.878781 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3858/7455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:30 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:31.899573 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:31.900288 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:31.913878 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:31.914395 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:31.914838 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:31.915564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:31.916021 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:31.916453 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:31.922216 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38784. Aug 30 18:54:31.924484 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38782. Aug 30 18:54:32.058321 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:32.066964 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a95544b1-02bb-45f0-bc68-3bd776207016 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.171680 Aug 30 18:54:32.067502 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3598/7456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:31 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:33.087787 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:33.088387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:33.099186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:33.099702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:33.100145 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:33.100843 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:33.101297 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:33.101723 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:33.102695 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38790. Aug 30 18:54:33.108077 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38788. Aug 30 18:54:33.236449 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:33.244568 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-67ee9feb-3b7a-455b-82df-09edeb7978d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.160761 Aug 30 18:54:33.245155 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3859/7457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:33 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:34.266291 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:34.266920 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:34.273793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.274315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.274763 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.275457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.275937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.276370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.417517 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:34.426024 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-98d8f5ce-7f82-41ec-8f6f-857f4f4e6002 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.163666 Aug 30 18:54:34.426601 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3599/7458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:34 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:35.447303 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:35.447958 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:35.454858 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:35.455350 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:35.455845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:35.456545 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:35.457008 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:35.457470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:35.588587 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:35.596534 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-28279762-e4d5-422f-abee-b9b5ac7ced22 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.153070 Aug 30 18:54:35.597126 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3860/7459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:35 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:36.618596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:36.619196 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:36.626725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:36.627220 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:36.627707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:36.628415 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:36.628880 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:36.629324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:36.765005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:36.773219 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-3b3ba769-6149-4f2e-a8e9-abeb75bf5d9b tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.158869 Aug 30 18:54:36.773790 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3600/7460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:36 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:37.794470 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:37.795109 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:37.802445 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:37.802917 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:37.803344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:37.804054 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:37.804569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:37.804992 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:37.934946 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:37.943471 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5b31de7c-416c-4e93-949a-57c34e31499d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.152976 Aug 30 18:54:37.944128 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3861/7461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:37 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:38.964740 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:38.965361 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:38.972898 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:38.973383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:38.973823 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:38.974515 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:38.974971 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:38.975399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:39.108627 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:39.116413 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-12bfac00-d31a-4fb7-b729-dbb76cb2fd5c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.155564 Aug 30 18:54:39.116989 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3601/7462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:38 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:40.137225 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:40.137761 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:40.145735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:40.146253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:40.146719 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:40.147412 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:40.147889 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:40.148310 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:40.294400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:40.303158 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-ae6c4e47-6e1c-4b5e-88aa-2b194d1fb7d5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.169920 Aug 30 18:54:40.303816 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3862/7463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:40 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:41.324412 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:41.325068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:41.332202 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:41.332690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:41.333130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:41.333848 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:41.334307 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:41.334739 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:41.488732 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:41.496901 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-90dabfff-9c5d-4570-83c6-c2c8861d073d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.176396 Aug 30 18:54:41.497474 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3602/7464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:41 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:42.519463 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:42.520083 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:42.527069 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:42.527588 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:42.528031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:42.528721 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:42.529184 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:42.530329 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:42.661196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:42.669032 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-bfa73b09-8ff0-4c36-9735-d27f5cfb319d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.154016 Aug 30 18:54:42.669613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3863/7465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:42 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:43.691869 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:43.692504 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:43.699981 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:43.700489 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:43.700945 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:43.701731 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:43.702210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:43.702654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:43.842029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:43.850105 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-23272f83-1396-4b07-8265-313a04fcc38e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.162341 Aug 30 18:54:43.850686 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3603/7466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:43 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:44.872617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:44.873767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:44.880623 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:44.881114 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:44.881554 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:44.882250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:44.882707 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:44.883135 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.026197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:45.034268 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-7eab918c-333d-49b4-b2d9-3d460e98f4ad tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1566 microversion: 2.1 time: 0.165758 Aug 30 18:54:45.034853 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3864/7467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:44 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:45.055466 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:45.056254 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:45.064635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.065135 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.065672 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.066569 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.067045 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.067500 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.158240 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122123) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 18:54:45.223156 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9961777b-d80d-4d8c-885e-e715198194d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "POST /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849/action" status: 202 len: 0 microversion: 2.1 time: 0.171611 Aug 30 18:54:45.223798 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3604/7468] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:45 2022] POST /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:45.231943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:45.233080 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:45.239456 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.240024 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.240467 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.241205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.241925 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.242353 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.432122 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:45.440901 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-80aae3f7-9d63-4434-b037-df3adafd6da8 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1514 microversion: 2.1 time: 0.212860 Aug 30 18:54:45.441488 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3865/7469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:45 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:46.462484 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:46.463105 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:46.469353 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:46.469834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:46.470272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:46.470955 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:46.471410 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:46.471860 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:46.609793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:46.617918 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e34e8323-f798-4ce8-8bea-0cb827e3f05f tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1516 microversion: 2.1 time: 0.160026 Aug 30 18:54:46.618487 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3605/7470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:46 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:47.373228 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "name": "network-vif-unplugged", "status": "completed", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:47.391950 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:47.392540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:47.393096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:47.406031 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.compute.server_external_events [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] Unable to find a host for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849. Dropping event network-vif-unplugged {{(pid=122124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:54:47.406941 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b632f8d7-e45f-4449-9e86-aa29c64917e0 req-02975408-d809-4baf-b63f-f4bac7b2d3d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044936 Aug 30 18:54:47.407870 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3866/7471] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 18:54:47.640574 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:47.641106 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:47.648132 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:47.648623 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:47.649068 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:47.649771 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:47.650233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:47.650670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:47.785545 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:47.793729 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-c1395782-a827-4119-90dd-80348f66205c tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1516 microversion: 2.1 time: 0.157797 Aug 30 18:54:47.794411 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3606/7472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:47 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:48.814873 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:48.815753 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:48.822985 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:48.823472 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:48.823948 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:48.824646 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:48.825106 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:48.825533 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:48.971966 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:48.980460 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9fa4e015-8bb3-4f57-b36c-6d8ff8739933 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1516 microversion: 2.1 time: 0.170030 Aug 30 18:54:48.981061 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3867/7473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:48 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:50.002541 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:50.003088 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:50.009976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:50.010457 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:50.010896 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:50.011613 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:50.012073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:50.012501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:50.153452 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:50.161567 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2edda8d4-6c5c-47b1-95e8-73d4d7cd35e1 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1516 microversion: 2.1 time: 0.162971 Aug 30 18:54:50.162590 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3607/7474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:49 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:51.183207 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:51.183856 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:51.191304 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:51.191815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:51.192250 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:51.192936 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:51.193387 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:51.193845 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:51.328048 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:51.336004 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d788fa6c-67f3-4f85-8f1b-0efde3c47370 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.156716 Aug 30 18:54:51.336721 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3868/7475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:51 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:51.875749 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:51.886605 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:51.887091 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:51.887551 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:51.899764 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] Creating event network-changed:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h2-852771-11 Aug 30 18:54:51.905378 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-d8e61c30-b38f-466e-9db7-32907920ba19 req-da00d228-b47f-414b-b32c-5fead00d819d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034192 Aug 30 18:54:51.905987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3608/7476] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:52.357970 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:52.358584 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:52.365687 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:52.366174 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:52.366617 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:52.367318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:52.368065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:52.368493 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:52.828197 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:52.840425 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-07e7bec7-9d10-4a82-9c8c-85389784d95e tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.485829 Aug 30 18:54:52.841483 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3869/7477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:52 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:53.863355 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:53.864101 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:53.871365 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:53.871899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:53.872351 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:53.873552 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:53.874014 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:53.874449 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:54.054582 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:54.063082 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a73e3f50-c03f-4bd1-ae2d-095204bea968 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.203974 Aug 30 18:54:54.063675 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3609/7478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:53 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:55.084942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:55.085534 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:55.088752 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 18:54:55.089997 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:54:55.090118 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 (ip 10.222.0.50) !!! Aug 30 18:54:55.091360 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:54:55.091607 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 (ip 10.222.0.50) !!! Aug 30 18:54:55.109005 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:55.109484 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:55.109919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:55.110606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:55.111059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:55.111497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:55.301501 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:55.309376 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0cfa49b8-c9f5-4089-a20e-929179d197d7 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.228492 Aug 30 18:54:55.309962 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3870/7479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:55 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:56.330296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:56.330915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.333990 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:54:56.334133 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:54:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 (ip 10.222.0.50) !!! Aug 30 18:54:56.343830 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.344315 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.344755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.345451 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.345907 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.346336 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.479824 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:56.487642 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-a4259c82-f873-4657-a620-be78cdd5860d tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.161272 Aug 30 18:54:56.488218 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3610/7480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:56 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:57.508941 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:57.509567 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:57.516632 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:57.517053 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:57.517494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:57.518180 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:57.518635 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:57.519059 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:57.650860 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:57.659189 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9711be24-367f-4b63-9cd1-03a711fac0db tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.154210 Aug 30 18:54:57.659819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3871/7481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:57 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:58.680987 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:58.681654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:58.689296 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:58.689787 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:58.690237 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:58.690940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:58.691404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:58.691864 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:58.695935 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:58.825186 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:58.833335 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-41d7f227-5bc3-4921-8949-c9b049d826bb tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.156419 Aug 30 18:54:58.833918 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3611/7482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:58 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:59.854282 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:59.854888 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:59.861994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:59.862468 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:59.862895 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:59.863611 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:59.864062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:59.864479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:59.994813 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:00.003277 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e437342d-1041-419c-9861-72b9352dfdf2 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.152911 Aug 30 18:55:00.003894 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3872/7483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:59 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:01.024909 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:01.025533 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:01.028282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:01.034328 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:01.034825 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:01.035272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:01.036001 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:01.036465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:01.036904 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:01.168371 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:01.176866 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-2bfce273-34b1-4120-8dff-a635d86e4eb6 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.155877 Aug 30 18:55:01.177443 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3612/7484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:01 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:02.198129 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:02.198744 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:02.201487 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=31 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:02.207095 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:02.207612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:02.208047 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:02.208732 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:02.209179 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:02.209601 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:02.212161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=87 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:02.341275 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:02.350439 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-c3f25bf3-3882-40cc-95e7-c72794821803 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.156158 Aug 30 18:55:02.351019 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3873/7485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:02 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:03.372903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:03.373553 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:03.380125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:03.380634 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:03.381060 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:03.381759 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:03.382217 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:03.382646 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:03.523424 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:03.531515 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b09b7c1a-a268-4af2-a356-5d707d545469 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.162764 Aug 30 18:55:03.532129 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3613/7486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:03 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:03.542695 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "name": "network-vif-plugged", "status": "completed", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:03.555660 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:03.556143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:03.556592 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:03.568596 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] Creating event network-vif-plugged:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h2-852771-11 Aug 30 18:55:03.575116 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-45b9d83b-271b-493c-9056-1efff24f4c49 req-0f76e70d-746c-48b2-a764-6cc76d96d859 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036338 Aug 30 18:55:03.575999 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3874/7487] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:55:04.553030 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:04.553577 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:04.560501 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:04.560988 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:04.561432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:04.562755 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:04.563224 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:04.563691 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:04.696635 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:04.706005 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-981fdf80-417c-431e-a95e-a6d0fbc2a609 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1572 microversion: 2.1 time: 0.156847 Aug 30 18:55:04.706609 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3614/7488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:04 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:05.729648 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:05.730345 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:05.736989 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:05.737471 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:05.737900 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:05.738578 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:05.739021 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:05.739455 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:05.879919 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:05.887916 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0746db88-a534-4c61-97f7-1beb03f6f144 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1559 microversion: 2.1 time: 0.163723 Aug 30 18:55:05.888518 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3875/7489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:05 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:16.402110 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=5 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:16.403272 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=22 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:16.404679 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=5 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:16.405447 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=13 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:16.407929 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:16.408442 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:16.426344 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:16.427086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:16.427494 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:16.428306 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:16.428774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:16.429214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:16.456910 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:56:16.470356 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:16.481352 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:16.482016 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:16.482555 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:16.495437 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] Creating event network-changed:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h2-852771-11 Aug 30 18:56:16.501603 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9cb61b7f-db57-46d2-9171-2670e5fc1cbb req-86ce1216-d890-4a3a-9576-beace8fa2861 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099037 Aug 30 18:56:16.502473 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3876/7490] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:56:16.545864 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0c1ede87-465f-41d5-8170-6f568e9064e0 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 204 len: 0 microversion: 2.1 time: 0.145166 Aug 30 18:56:16.546671 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3615/7491] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 18:56:16 2022] DELETE /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:56:16.556166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:16.557050 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:16.563938 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:16.564573 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:16.565118 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:16.565923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:16.567785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:16.567785 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:16.982855 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:16.991320 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-e34c6d37-4b65-493c-a9f5-4c633b998301 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.439608 Aug 30 18:56:16.991935 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3877/7492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:16 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:18.014443 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:18.015154 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:18.022834 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:18.023707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:18.024159 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:18.024899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:18.025358 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:18.025969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:18.199742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:18.207882 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f3315d65-fbb6-489c-afda-e12a6645cff3 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1565 microversion: 2.1 time: 0.197630 Aug 30 18:56:18.208475 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3616/7493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:18 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:18.439358 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8d27b7-5a9c-41f8-a680-213c9a39e849", "name": "network-vif-deleted", "tag": "fa86a580-50bc-403e-bd0d-f9f9d60963a9"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:18.450518 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:18.451001 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:18.451442 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:18.464058 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] Creating event network-vif-deleted:fa86a580-50bc-403e-bd0d-f9f9d60963a9 for instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 on n-h2-852771-11 Aug 30 18:56:18.468943 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-9069429b-70b5-4b84-81a0-b3dc0d73e889 req-6da14ed6-6e91-41b5-82e3-b0aa0388c92f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Aug 30 18:56:18.469743 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3878/7494] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:56:19.229241 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:19.229871 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:19.236936 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:19.237434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:19.238465 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:19.239187 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:19.239679 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:19.240118 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:19.307617 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:19.316558 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-988211d2-4440-439c-9406-a33065a32f15 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1218 microversion: 2.1 time: 0.090552 Aug 30 18:56:19.317804 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3617/7495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:19 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:56:20.340014 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:20.340725 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:20.347426 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:20.347886 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:20.348328 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:20.349030 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:20.349486 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:20.349942 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:20.414608 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:20.422669 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-46ed7292-e76b-4172-865d-57255522e0a5 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1218 microversion: 2.1 time: 0.087826 Aug 30 18:56:20.423467 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3879/7496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:20 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:21.445210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:21.445832 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:21.452742 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:21.453234 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:21.453681 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:21.454383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:21.454846 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:21.455282 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:21.522711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:21.531791 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5c737845-59f0-46d3-8dd1-6cad515ead37 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1218 microversion: 2.1 time: 0.091547 Aug 30 18:56:21.532383 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3618/7497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:21 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:22.552651 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:22.553363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:22.560157 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:22.560634 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:22.561143 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:22.562708 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:22.562817 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:22.563153 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:22.641585 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6602ea719db2457fa6233f00ddf992cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1de6b3687b649179db40a12eaaa29f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:22.651106 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-b526c239-2b5e-48ce-9ac9-a495f91528c4 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 200 len: 1218 microversion: 2.1 time: 0.102701 Aug 30 18:56:22.651813 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3880/7498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:22 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:23.673011 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:23.673556 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] [instance: 5f8d27b7-5a9c-41f8-a680-213c9a39e849] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:23.680444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:23.680951 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:23.681375 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:23.682090 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:23.682531 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:23.682967 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:23.696463 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] HTTP exception thrown: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Request method failure captured: Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 HTTP/1.1 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDltJvj4yImjMCPUk0LmkOBomk93lr9DbKtU11d9xRBg0rqVbTP0nkFvzfCeSiCSKn7biekTiEqYnuXaTElOGq6tk2rJ__MOOdgD4MiXkIVlBkV_kUsxOMmU4Kfv_DJya28TgXsyGa7PRBFY_XIg1M0OLfCtO6pVUNscCpNc61kfy1o4 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: f1de6b3687b649179db40a12eaaa29f6 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestShelveInstance-1616690349 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f1de6b3687b649179db40a12eaaa29f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f1de6b3687b649179db40a12eaaa29f6"}]}] Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestShelveInstance-1616690349 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: f1de6b3687b649179db40a12eaaa29f6 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestShelveInstance-1616690349 Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestShelveInstance-1616690349-project Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 6602ea719db2457fa6233f00ddf992cf Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestShelveInstance-1616690349-project Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '5f8d27b7-5a9c-41f8-a680-213c9a39e849'} Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:56:23.698176 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Returning 404 to user: Instance 5f8d27b7-5a9c-41f8-a680-213c9a39e849 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-dfaba8c3-7997-4103-8cb7-7cdffc5e11fc tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849" status: 404 len: 111 microversion: 2.1 time: 0.030748 Aug 30 18:56:23.703174 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3619/7499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:23 2022] GET /compute/v2.1/servers/5f8d27b7-5a9c-41f8-a680-213c9a39e849 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:56:23.866120 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-6fcd28bd-3755-4e89-ba33-53e33d6f3d93 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] Calling method '.version_select at 0x7f2d93332940>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:23.897417 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-6fcd28bd-3755-4e89-ba33-53e33d6f3d93 tempest-TestShelveInstance-1616690349 tempest-TestShelveInstance-1616690349-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-872510059" status: 202 len: 0 microversion: 2.1 time: 0.035687 Aug 30 18:56:23.898018 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3881/7500] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 18:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-872510059 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:56:41.333119 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:41.334524 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:41.527815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6ab7a5cb-4538-4d52-b619-976686c55758 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Action: 'create', calling method: .version_select at 0x7f2d90531e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1959048411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQKpno7Jwaw2ZG4fA1ccU5Z/olkrc4FZ5jZ10NFlVq8faN5OAaVYolKdmfoZMDvI/vX3aGnVMddfDbkWheSWTgg48FE6kTzJwgzxeaYI3BuQvN+i+vXz8ShT6XjBf/yNw=="}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:41.544690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6ab7a5cb-4538-4d52-b619-976686c55758 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:56:41.551043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-6ab7a5cb-4538-4d52-b619-976686c55758 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for user 7af273657bba4b08b4fed51ef1733354 and project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'key_pairs'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:56:41.582342 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6ab7a5cb-4538-4d52-b619-976686c55758 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.256600 Aug 30 18:56:41.582978 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3620/7501] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 18:56:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:56:42.671196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=22 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:42.672094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:42.677828 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-749029057", "imageRef": "565db0f0-616b-43a3-8762-95a8e129a515", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1959048411", "security_groups": [{"name": "tempest-secgroup-smoke-1054264685"}], "networks": [{"uuid": "2b09c55d-ae40-4252-a4f3-dc8f6d8d590b"}]}} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:42.786773 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.network.neutron [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] validate_networks() for [('2b09c55d-ae40-4252-a4f3-dc8f6d8d590b', None, None, None, None, None)] {{(pid=122124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:56:43.273233 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Flavor limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:56:43.273929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Image limits 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:56:43.274550 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Flavor pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:56:43.275289 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Image pref 0:0:0 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:56:43.275751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.virt.hardware [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:56:43.285738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:43.286246 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:43.286691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:43.287436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:43.287929 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:43.288365 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:43.306404 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:56:43.311758 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.quota [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for user 7af273657bba4b08b4fed51ef1733354 and project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:56:43.325121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Going to run 1 instances... {{(pid=122124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:56:43.327464 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='565db0f0-616b-43a3-8762-95a8e129a515',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:56:43.379593 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-35edb367-6863-49c1-8a38-2152ebccdd65 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710085 Aug 30 18:56:43.380881 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3882/7502] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:56:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:56:43.391379 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f6e3541d-6b1e-4263-bd86-efbcd5d2cfbd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:43.392966 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f6e3541d-6b1e-4263-bd86-efbcd5d2cfbd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:43.470958 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f6e3541d-6b1e-4263-bd86-efbcd5d2cfbd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:43.479261 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f6e3541d-6b1e-4263-bd86-efbcd5d2cfbd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1248 microversion: 2.1 time: 0.091697 Aug 30 18:56:43.479984 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3621/7503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:43 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:44.500663 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:44.502499 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:44.509961 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:44.510706 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:44.511340 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:44.512245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:44.513606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:44.517446 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:44.637094 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:44.648311 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-9cab77e4-471c-491a-b884-56ed2685678b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1300 microversion: 2.1 time: 0.152517 Aug 30 18:56:44.663438 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3883/7504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:44 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:45.670255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:45.670876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:45.678751 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:45.679248 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:45.679741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:45.680564 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:45.681063 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:45.681539 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:45.887172 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:45.903036 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e5a6ad7f-5ed1-49fd-a9c9-02bb14ed4044 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.236542 Aug 30 18:56:45.919302 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3622/7505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:45 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:46.409939 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:46.421166 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:46.421986 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:46.422676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:46.438318 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] Creating event network-changed:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 18:56:46.443809 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-2976af9c-34fd-4b67-9b01-1e0d95e16e31 req-406b5706-aac5-48cb-97a8-9d82111900fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038544 Aug 30 18:56:46.444439 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3884/7506] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:56:46.927376 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:46.928069 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:46.935023 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:46.935626 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:46.936084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:46.936794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:46.937260 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:46.937703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:47.072423 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:47.080144 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e4a42a68-8cfc-49a7-8c07-85b86940e084 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.157496 Aug 30 18:56:47.080733 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3623/7507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:46 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:48.102995 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:48.103751 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:48.109868 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:48.110363 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:48.110806 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:48.111520 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:48.113245 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:48.113692 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:48.244923 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:48.253309 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-d45e7924-a8a7-43ee-a18f-949247ca8a9c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.154832 Aug 30 18:56:48.253893 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3885/7508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:48 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:49.273693 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:49.274345 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:49.281480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:49.281976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:49.282458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:49.283156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:49.283651 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:49.284086 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:49.415808 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:49.423893 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-e90d863a-576a-4081-b43f-1467f52c2056 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.154024 Aug 30 18:56:49.424975 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3624/7509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:49 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:56:50.444831 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:50.445479 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:50.452346 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:50.452835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:50.453276 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:50.453975 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:50.454436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:50.454866 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:50.590096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:50.597991 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-82c7f576-010f-4540-9c82-4689428b396a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.157115 Aug 30 18:56:50.598574 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3886/7510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:50 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:51.618822 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:51.619377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:51.626547 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:51.627127 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:51.627721 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:51.628434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:51.628903 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:51.629346 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:51.764873 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:51.773403 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bdf0b5a0-1394-41ea-a60a-e0f52814ebea tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.158772 Aug 30 18:56:51.773987 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3625/7511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:51 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:51.960318 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "name": "network-vif-plugged", "status": "completed", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:51.969876 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:51.970360 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:51.970801 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:51.981982 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] Creating event network-vif-plugged:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 18:56:51.987632 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-15440c54-c331-45ff-91cd-1c9d9e91e45c req-30b0e5cb-5022-4c23-83df-fb4e9fc3a746 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093869 Aug 30 18:56:51.988295 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3887/7512] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:56:52.794558 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:52.795185 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:52.803303 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:52.803831 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:52.804294 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:52.805006 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:52.805474 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:52.805915 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:52.941156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:52.948949 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-1f1fb8e4-9769-476d-9e7e-b1012f6f5c48 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1374 microversion: 2.1 time: 0.158299 Aug 30 18:56:52.949530 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3626/7513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:52 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:53.971737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:53.972451 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:53.975224 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:53.976066 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=6 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:53.982676 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:53.983167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:53.983645 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:53.984354 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:53.984827 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:53.985262 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:54.118612 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:54.126406 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-199eedec-ac43-4e4e-b589-838c5a56b262 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1558 microversion: 2.1 time: 0.159799 Aug 30 18:56:54.126994 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3888/7514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:53 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:54.146174 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:56:54.146794 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:56:54.148707 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:56:54.154899 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:54.155383 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:54.155853 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:54.156576 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:54.157031 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:54.157461 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:54.294876 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:56:54.303941 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-5edadfb4-3b3e-47f7-95ad-2b33f4fb86cd tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1558 microversion: 2.1 time: 0.161649 Aug 30 18:56:54.304547 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3627/7515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:56:54 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:56:55.920519 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:56:55.931394 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:56:55.932186 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:56:55.932622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:56:55.945142 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] Creating event network-changed:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 18:56:55.950869 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-a48d89c4-5cd2-4e74-9fc3-311fa3311fe2 req-f7942d1b-5465-4389-8841-e461b94ca58b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Aug 30 18:56:55.951857 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3889/7516] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:58:51.208968 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:58:51.210137 n-d-852771-11 devstack@n-api.service[122123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:58:51.210669 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:51.211629 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=36 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:51.212999 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:58:51.213185 n-d-852771-11 devstack@n-api.service[122123]: Tue Aug 30 18:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f/action (ip 10.222.0.50) !!! Aug 30 18:58:51.218815 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-449961078"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:58:51.221162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:51.232137 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:51.232630 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:51.233099 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:51.233833 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:51.234292 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:51.234725 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:51.423726 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-22ecc007-7c9e-41b2-923b-731173f6fdb1 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "POST /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f/action" status: 202 len: 0 microversion: 2.1 time: 0.216367 Aug 30 18:58:51.424390 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3628/7517] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 18:58:51 2022] POST /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:58:56.580030 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:58:56.580814 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:58:56.581424 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:56.582834 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=32 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:56.584237 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:58:56.584592 n-d-852771-11 devstack@n-api.service[122124]: Tue Aug 30 18:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 30 18:58:56.601689 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "name": "network-vif-plugged", "status": "completed", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:58:56.615202 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:56.615712 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:56.616144 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:56.627438 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] Creating event network-vif-plugged:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 18:58:56.632827 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-cc3f6cb1-59bd-4fb3-88c2-b6735760ab45 req-53690ae0-960c-49e0-8a74-d1b2a37a5747 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054595 Aug 30 18:58:56.633938 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3890/7518] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:03.946521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:03.947314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:03.955179 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1559585775", "imageRef": "cff0d87c-44e2-44ad-bb35-7bfebe6ff76e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1959048411", "security_groups": [{"name": "tempest-secgroup-smoke-1054264685"}], "networks": [{"uuid": "2b09c55d-ae40-4252-a4f3-dc8f6d8d590b"}]}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:03.971991 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d59639a-7a47-4911-b428-78c071c0ba72] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39292. Aug 30 18:59:03.986134 n-d-852771-11 devstack@n-api.service[122123]: INFO oslo.messaging._drivers.impl_rabbit [-] [2533fb56-e002-426e-ada1-a1b4c9155ba2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39294. Aug 30 18:59:04.077637 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.network.neutron [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] validate_networks() for [('2b09c55d-ae40-4252-a4f3-dc8f6d8d590b', None, None, None, None, None)] {{(pid=122123) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:59:04.456005 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Flavor limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:59:04.456444 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Image limits 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:59:04.457458 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Flavor pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:59:04.457890 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Image pref 0:0:0 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:59:04.458319 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.virt.hardware [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:59:04.467210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:04.467737 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:04.468182 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:04.468917 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:04.469380 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:04.469845 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:04.487130 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:59:04.493513 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.quota [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Getting quotas for user 7af273657bba4b08b4fed51ef1733354 and project 3c23fb16f92048809a120a02eb96b5d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:59:04.506863 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Going to run 1 instances... {{(pid=122123) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:59:04.509370 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cff0d87c-44e2-44ad-bb35-7bfebe6ff76e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:59:04.557616 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-bf0df2c2-e3be-4ecf-b04f-2c12535d052a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.613960 Aug 30 18:59:04.558272 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3629/7519] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 18:59:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:59:04.570738 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-166c654e-6bb9-4c80-9a5a-d1ef18c057e9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:04.571443 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-166c654e-6bb9-4c80-9a5a-d1ef18c057e9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:04.600592 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [6266b63a-d75e-4d6b-bc07-19b303e71e7f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39306. Aug 30 18:59:04.601860 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [-] [03a84abf-74ab-4f98-8b5e-cfca87b12b9d] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39308. Aug 30 18:59:04.635672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-166c654e-6bb9-4c80-9a5a-d1ef18c057e9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:04.644184 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-166c654e-6bb9-4c80-9a5a-d1ef18c057e9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1249 microversion: 2.1 time: 0.078904 Aug 30 18:59:04.645033 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3891/7520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:04 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:05.666299 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:05.666924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:05.674441 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:05.675203 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:05.675735 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:05.676460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:05.677377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:05.678029 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:05.750374 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:05.759920 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-71470fc7-6c7c-4372-b3ee-e3242d853881 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1307 microversion: 2.1 time: 0.098270 Aug 30 18:59:05.760303 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3630/7521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:05 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:06.785152 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:06.786624 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:06.793285 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:06.796101 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:06.807208 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:06.807767 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:06.808535 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:06.809000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:06.809436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:06.967540 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:06.977410 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-cfe589b4-20cf-452c-b193-df0cefdeb4c9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.196455 Aug 30 18:59:06.991716 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3892/7522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:06 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:07.999324 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:08.000073 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:08.007835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:08.008331 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:08.008774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:08.009485 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:08.009940 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:08.010372 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:08.181546 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:08.192924 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-565eb406-457d-4bd7-99ff-4e8baa6c2473 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.197356 Aug 30 18:59:08.193602 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3631/7523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:07 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:08.589062 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "name": "network-vif-unplugged", "status": "completed", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:08.601265 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:08.601954 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:08.602400 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:08.614159 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] Creating event network-vif-unplugged:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 18:59:08.619687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7f412131-bd3b-4732-89c5-bb5382783fb6 req-b522762f-07c6-4697-ac6a-075e9d3f7b52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034327 Aug 30 18:59:08.620613 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3893/7524] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:09.214162 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:09.214789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:09.221918 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:09.223092 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:09.223598 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:09.224314 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:09.224777 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:09.225214 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:09.374160 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:09.382881 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-678c7f70-0ad3-45dc-8d93-7cebda517ff3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.172570 Aug 30 18:59:09.383491 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3632/7525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:09 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:10.405327 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:10.406035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:10.413465 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:10.413955 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:10.414393 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:10.415281 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:10.415765 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:10.416195 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:10.569205 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:10.579710 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-53917c94-7a8b-4fd0-b0ab-f1234a979980 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.178179 Aug 30 18:59:10.581118 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3894/7526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:10 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:11.608364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:11.608364 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:11.614098 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:11.614969 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:11.615748 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:11.616844 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:11.618429 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:11.618979 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:11.767795 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:11.776304 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-6684471e-454d-44d0-9392-bcbf1c32048c tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.177096 Aug 30 18:59:11.776893 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3633/7527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:11 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:12.800558 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:12.801963 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:12.809702 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:12.810414 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:12.810933 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:12.811735 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:12.812259 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:12.812749 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:12.959072 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:12.967877 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5def8e95-e1c1-4936-98ca-8a86dc7181f2 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.173251 Aug 30 18:59:12.979725 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3895/7528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:12 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:13.989548 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:13.990799 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:13.997976 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:13.998477 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:13.998928 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:13.999901 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:14.000125 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:14.000571 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:14.148703 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:14.158961 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-0683641f-01b5-41cf-900e-0ffa7f1a4b64 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.173343 Aug 30 18:59:14.173011 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3634/7529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:13 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:14.481333 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:14.490872 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:14.491344 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:14.491973 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:14.503177 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] Creating event network-changed:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 18:59:14.508675 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e57b019c-6fa8-4d65-92aa-c2b6ddbb2693 req-31cb75da-07e8-4b8c-b1ce-118985e2e8e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089573 Aug 30 18:59:14.509282 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3896/7530] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:15.181233 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:15.181782 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:15.183709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:15.184377 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell0:SELECT=6 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:15.192269 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:15.192784 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:15.193222 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:15.193916 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:15.194373 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:15.194804 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:15.332199 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:15.339946 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-9eb52e6d-a89c-42f3-9201-203b1f293f95 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.162644 Aug 30 18:59:15.340524 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3635/7531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:15 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:16.359092 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell0:SELECT=2 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:16.365423 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:16.367006 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:16.374606 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:16.375099 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:16.375569 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:16.376277 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:16.376737 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:16.377167 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:16.533652 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:16.545850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-1780f5e5-d6fa-472a-b9b4-e35cfb70960a tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.187573 Aug 30 18:59:16.546464 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3897/7532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:16 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:17.567472 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:17.568043 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:17.574847 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:17.575332 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:17.575806 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:17.576502 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:17.576961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:17.577391 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:17.711628 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:17.719376 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-ad50542c-bcdb-4eef-8738-b5ce17208115 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.156396 Aug 30 18:59:17.719991 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3636/7533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:17 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:18.711204 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "name": "network-vif-plugged", "status": "completed", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:18.723121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:18.723764 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:18.724086 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:18.735464 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] Creating event network-vif-plugged:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 18:59:18.740150 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:18.740687 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-e0f897bb-c146-4699-a87a-4169c5f3a219 req-0d8ff249-b8e6-41f2-92ee-a6e0a3518e63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033932 Aug 30 18:59:18.740789 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:18.741560 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3898/7534] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:18.748210 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:18.748711 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:18.749155 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:18.749877 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:18.750340 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:18.750769 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:18.887709 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:18.902203 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-95d97cac-b20f-4026-9fff-e000094777c3 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1375 microversion: 2.1 time: 0.165796 Aug 30 18:59:18.902816 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3637/7535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:18 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:59:19.924065 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:19.924774 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:19.933466 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:19.933835 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:19.934287 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:19.934999 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:19.935457 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:19.935912 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:20.068951 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:20.076792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-0d118fdb-934d-470e-9a18-43b6df8a1765 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1560 microversion: 2.1 time: 0.157086 Aug 30 18:59:20.077371 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3899/7536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:19 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:20.097435 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:20.098065 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:20.104925 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:20.105420 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:20.105872 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:20.106580 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:20.107047 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:20.107506 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:20.244650 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:20.252826 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-f0f77cc8-77b2-4380-9936-a23aaf6b421b tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1560 microversion: 2.1 time: 0.159359 Aug 30 18:59:20.254166 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3638/7537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:20 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:21.864800 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:21.875138 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:21.875672 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:21.876110 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:21.890280 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] Creating event network-changed:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 18:59:21.895907 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-b43bfcbe-6747-40f0-8cd8-ef2d12b55bd0 req-3be1740b-51a3-4a3d-be6c-18434a0101da service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035658 Aug 30 18:59:21.896569 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3900/7538] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:00:51.464103 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:00:51.464861 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=56 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:00:51.469038 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-23823708"}} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:00:51.471460 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:00:51.478589 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:00:51.479084 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:00:51.479550 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:00:51.480266 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:00:51.480774 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:00:51.481156 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:00:51.885010 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-b5789f02-d743-4235-87f7-ed528ee4f392 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "POST /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934/action" status: 202 len: 0 microversion: 2.1 time: 0.422652 Aug 30 19:00:51.885663 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3639/7539] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 19:00:51 2022] POST /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 19:00:57.276478 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_api:SELECT=24 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:00:57.279063 n-d-852771-11 devstack@n-api.service[122124]: DEBUG dbcounter [-] [122124] Writing DB stats nova_cell1:SELECT=38 {{(pid=122124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:00:57.288286 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "name": "network-vif-plugged", "status": "completed", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:00:57.302274 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:00:57.303181 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:00:57.304261 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:00:57.319081 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] Creating event network-vif-plugged:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 19:00:57.325363 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-99fcef23-e318-4f7c-9e1d-99c6b37fcf5b req-89953705-70b8-4054-acce-e9358a6353cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052896 Aug 30 19:00:57.326706 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3901/7540] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 19:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:01:05.500741 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:05.501937 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:05.503201 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:01:05.504719 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_api:SELECT=2 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:01:05.505761 n-d-852771-11 devstack@n-api.service[122123]: DEBUG dbcounter [-] [122123] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:01:05.512670 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:05.513250 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:05.513762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:05.514588 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:05.515161 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:05.515348 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:05.516035 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:05.516434 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:05.516583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:05.529382 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] Creating event network-changed:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 19:01:05.535887 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-eebd8921-dabe-4b30-823d-8db618e13729 req-9dd7aa5b-604e-45d9-9ffe-b2f3b4c0f026 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036922 Aug 30 19:01:05.536819 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3902/7541] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 19:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:01:05.557835 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Going to try to terminate instance {{(pid=122123) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:01:05.655805 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-4b23ff5c-5e08-480c-81b6-9cde0249a5d9 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 204 len: 0 microversion: 2.1 time: 0.159264 Aug 30 19:01:05.656578 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3640/7542] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 19:01:05 2022] DELETE /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:01:05.666836 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:05.667943 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:05.674769 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:05.675348 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:05.676128 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:05.676945 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:05.677505 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:05.678007 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:05.882113 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:01:05.890000 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-64141153-c107-4629-820b-d6f368ecabbe tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1684 microversion: 2.1 time: 0.227580 Aug 30 19:01:05.890660 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3903/7543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:05 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1684 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:01:06.913455 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:06.914399 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:06.921790 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:06.922255 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:06.922705 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:06.923544 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:06.924013 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:06.924475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:07.112592 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:01:07.121507 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-77ca75b8-f7cd-4a26-8658-b3fadedc65cb tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 200 len: 1684 microversion: 2.1 time: 0.213042 Aug 30 19:01:07.122325 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3641/7544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:06 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 1684 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:01:07.601436 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc273eb7-74e3-4506-9077-8bcb6e001934", "name": "network-vif-deleted", "tag": "37648265-6bba-4b0e-9c8f-0066288e5a3a"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:01:07.612004 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:07.612494 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:07.612937 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:07.625850 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] Creating event network-vif-deleted:37648265-6bba-4b0e-9c8f-0066288e5a3a for instance dc273eb7-74e3-4506-9077-8bcb6e001934 on n-h2-852771-11 Aug 30 19:01:07.631258 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-16d74377-2a98-4ec4-bc5d-4e1aac3e542a req-a9b657e1-1379-499c-aadf-1769eb934ddd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Aug 30 19:01:07.631907 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3904/7545] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 19:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:01:08.143205 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:08.143793 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: dc273eb7-74e3-4506-9077-8bcb6e001934] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:08.151678 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:08.152166 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:08.152608 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:08.153305 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:08.153762 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:08.154191 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:08.167960 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] HTTP exception thrown: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Request method failure captured: Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 HTTP/1.1 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDl1jlB2JZkAIi3hcPX2mlFXCUBfBDWYbGXXl1WE9nFhbuckLpC1YHeUwpME3UHWxYRpvYqINzBsJI2Ln_AuHysURp_gVzs7Nd80Io3x9ujJ3IF-aAgsV8yx0yMn5RqWvvPq1OQxkMrBod5r8lKPei_ePEV2d3kJtx6LJTVb3JNACjaI Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c23fb16f92048809a120a02eb96b5d7 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c23fb16f92048809a120a02eb96b5d7"}]}] Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c23fb16f92048809a120a02eb96b5d7 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestSnapshotPattern-1330321739-project Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 7af273657bba4b08b4fed51ef1733354 Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestSnapshotPattern-1330321739-project Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': 'dc273eb7-74e3-4506-9077-8bcb6e001934'} Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:01:08.169596 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Returning 404 to user: Instance dc273eb7-74e3-4506-9077-8bcb6e001934 could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-fe158c15-8382-4f56-9c04-5ddec532d087 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934" status: 404 len: 111 microversion: 2.1 time: 0.031813 Aug 30 19:01:08.174242 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3642/7546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:08 2022] GET /compute/v2.1/servers/dc273eb7-74e3-4506-9077-8bcb6e001934 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:01:09.502622 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:09.503206 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:09.509583 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:09.510061 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:09.510497 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:09.511185 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:09.511667 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:09.512091 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:09.538740 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Going to try to terminate instance {{(pid=122124) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:01:09.622618 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-def0425d-cbee-451f-85ce-43f8d0cba7c4 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 204 len: 0 microversion: 2.1 time: 0.124795 Aug 30 19:01:09.623350 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3905/7547] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 19:01:09 2022] DELETE /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:01:09.634480 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:09.635828 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:09.643521 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:09.644016 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:09.645309 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:09.646035 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:09.646492 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:09.646924 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:09.647994 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:01:09.659230 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:09.659867 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:09.661000 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:09.674118 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.compute.server_external_events [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] Creating event network-changed:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 19:01:09.680792 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [req-7b8631ff-0c9d-4cb9-9891-f71584afa3f3 req-e0f42d8a-1fc6-47dd-870f-1be6f7c52af9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 Aug 30 19:01:09.681727 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3906/7548] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 19:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:01:09.799604 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.policy [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122123) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:01:09.808274 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-287ef7bc-ef8d-4f3f-bd56-20f96c129494 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1682 microversion: 2.1 time: 0.179765 Aug 30 19:01:09.808841 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3643/7549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:09 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:01:10.830581 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:10.831302 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:10.838605 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:10.839121 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:10.839591 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:10.840295 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:10.840815 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:10.841253 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:10.978226 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:01:10.986155 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-232eeadd-ee11-4551-824c-b18563be5718 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1682 microversion: 2.1 time: 0.160066 Aug 30 19:01:10.986746 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3907/7550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:10 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:01:11.754385 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da24c9c-ad00-4c1b-949f-c0bd38fc304f", "name": "network-vif-deleted", "tag": "55edfa34-b177-4578-84a1-a99da9578eb4"}]} {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:01:11.766432 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:11.767083 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:11.767689 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:11.781057 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.compute.server_external_events [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] Creating event network-vif-deleted:55edfa34-b177-4578-84a1-a99da9578eb4 for instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f on n-h1-852771-11 Aug 30 19:01:11.786766 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [req-73e467b2-ac06-4784-a869-ea2692a9612b req-1532ca8a-3fa2-4bf0-a5c9-ffedc13d8bde service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Aug 30 19:01:11.787594 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3644/7551] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:01:12.009010 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:12.009548 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.compute.api [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122124) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:12.016509 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:12.017013 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:12.017461 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:12.018196 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:12.018659 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:12.019096 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:12.056410 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:12.056909 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:12.057355 n-d-852771-11 devstack@n-api.service[122124]: DEBUG oslo_concurrency.lockutils [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:12.057821 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.objects.instance [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lazy-loading 'fault' on Instance uuid 4da24c9c-ad00-4c1b-949f-c0bd38fc304f {{(pid=122124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:01:12.099691 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.policy [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af273657bba4b08b4fed51ef1733354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23fb16f92048809a120a02eb96b5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122124) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:01:12.107788 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-f58e35c5-b98d-4351-94d8-2ba0e127df72 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 200 len: 1338 microversion: 2.1 time: 0.102633 Aug 30 19:01:12.108402 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3908/7552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:12 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:01:13.129690 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '>' {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:13.130398 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.compute.api [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [instance: 4da24c9c-ad00-4c1b-949f-c0bd38fc304f] Fetching instance by UUID {{(pid=122123) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:01:13.137475 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:13.137961 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:13.138404 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:13.139093 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Acquiring lock "d64e249a-e872-487f-b759-da855b1e5621" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:01:13.139581 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:01:13.140012 n-d-852771-11 devstack@n-api.service[122123]: DEBUG oslo_concurrency.lockutils [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Lock "d64e249a-e872-487f-b759-da855b1e5621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:01:13.154733 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.wsgi [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] HTTP exception thrown: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Request method failure captured: Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: request: GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f HTTP/1.1 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Accept: application/json Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Accept-Encoding: identity Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Connection: close Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Content-Length: 0 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Content-Type: application/json Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Host: 10.222.0.50 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: Openstack-System-Scope: None Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: User-Agent: python-urllib3/1.26.12 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Auth-Token: gAAAAABjDl1jlB2JZkAIi3hcPX2mlFXCUBfBDWYbGXXl1WE9nFhbuckLpC1YHeUwpME3UHWxYRpvYqINzBsJI2Ln_AuHysURp_gVzs7Nd80Io3x9ujJ3IF-aAgsV8yx0yMn5RqWvvPq1OQxkMrBod5r8lKPei_ePEV2d3kJtx6LJTVb3JNACjaI Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Id: None Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Domain-Name: None Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Identity-Status: Confirmed Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Is-Admin-Project: True Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Id: default Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Domain-Name: Default Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Id: 3c23fb16f92048809a120a02eb96b5d7 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Project-Name: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Role: reader,member Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Roles: reader,member Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c23fb16f92048809a120a02eb96b5d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c23fb16f92048809a120a02eb96b5d7"}]}] Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Id: 3c23fb16f92048809a120a02eb96b5d7 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-Tenant-Name: tempest-TestSnapshotPattern-1330321739 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-User: tempest-TestSnapshotPattern-1330321739-project Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Id: default Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Domain-Name: Default Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Id: 7af273657bba4b08b4fed51ef1733354 Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: X-User-Name: tempest-TestSnapshotPattern-1330321739-project Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: method: > Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: exception: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: action_args: {'id': '4da24c9c-ad00-4c1b-949f-c0bd38fc304f'} Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: {{(pid=122123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:01:13.156400 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: ERROR nova.api.openstack.wsgi Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: DEBUG nova.api.openstack.wsgi [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Returning 404 to user: Instance 4da24c9c-ad00-4c1b-949f-c0bd38fc304f could not be found. {{(pid=122123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: INFO nova.api.openstack.requestlog [None req-63f0c5a2-de1f-4397-a48d-10248119c606 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f" status: 404 len: 111 microversion: 2.1 time: 0.032389 Aug 30 19:01:13.161654 n-d-852771-11 devstack@n-api.service[122123]: [pid: 122123|app: 0|req: 3645/7553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 19:01:13 2022] GET /compute/v2.1/servers/4da24c9c-ad00-4c1b-949f-c0bd38fc304f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:01:13.643371 n-d-852771-11 devstack@n-api.service[122124]: DEBUG nova.api.openstack.wsgi [None req-5fae536f-38d1-4551-8ec3-40d0bb1fdc46 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] Calling method '.version_select at 0x7f2d932f7280>' {{(pid=122124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:01:13.649940 n-d-852771-11 devstack@n-api.service[122124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fae536f-38d1-4551-8ec3-40d0bb1fdc46 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:01:14.658777 n-d-852771-11 devstack@n-api.service[122124]: INFO oslo.messaging._drivers.impl_rabbit [None req-5fae536f-38d1-4551-8ec3-40d0bb1fdc46 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] [9b435ed2-cae6-49dc-97bf-08cbdd9a7f3b] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39656. Aug 30 19:01:14.679585 n-d-852771-11 devstack@n-api.service[122124]: INFO nova.api.openstack.requestlog [None req-5fae536f-38d1-4551-8ec3-40d0bb1fdc46 tempest-TestSnapshotPattern-1330321739 tempest-TestSnapshotPattern-1330321739-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1959048411" status: 202 len: 0 microversion: 2.1 time: 1.040070 Aug 30 19:01:14.680189 n-d-852771-11 devstack@n-api.service[122124]: [pid: 122124|app: 0|req: 3909/7554] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 30 19:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1959048411 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)